Larbin

This release corrects some compilation tweaks with recent gcc
versions, improves the configuration file parser, and adds new options
for following links selectively.

This release compiles on Solaris, cookie management has been added, images can be fetched with pages, and many rewrites have been done for efficiency and portability.

With this release, it is possible again to crawl through a proxy, all configurations should compile (Linux and BSD), images can now be downloaded with pages, and the robots.txt parser has been enhanced.

Many efficiency updates were made to the sequencer, to buffer recycling, and to
DNS management. A new output module for statistics has been added.

Output and buffer interfaces have been simplified. A dynamic buffer option has been added. The web server has been reworked.