Experimental Physics and
Industrial Control System

Mark Rivers <[email protected]> · Fri, 12 Apr 1996 9:26:18 -0500 (CDT)

    Folks,

Thanks to a suggestion from Bill Lavender I have found exactly the tool to do
what I wanted, i.e. checking all links in an HTML document.

The program is called "momspider" and is available at 
http://www.ics.uci.edu/WebSoft/MOMspider/

To quote from that document:

"MOMspider is a web-roaming robot that specializes in the maintenance of
distributed hypertext infostructures (i.e. wide-area webs). The program is 
written in Perl and, once customized for your site, should work on any 
UNIX-based system with Perl 4.036."

It is a very nice program. It can test about 1000 links/minute.  By default
for local URL's it will follow links to any depth, for remote URL's it just
verifies that the link exists (to minimize loading the network and remote Web
servers).  It produces a nice HTML document which lists all broken links,
recently modified links, etc.

____________________________________________________________
Mark Rivers                             (312) 702-2279 (office)
CARS                                    (312) 702-9951 (secretary)
Univ. of Chicago                        (312) 702-5454 (FAX)
5640 S. Ellis Ave.                      (708) 922-0499 (home)
Chicago, IL 60637                       [email protected] (Internet) 

Experimental Physics and Industrial Control System

Experimental Physics and
Industrial Control System