Inside SpiderBot
1 line

 

 

 

 

2000 lines
2001 lines

 

 

 

 

4000 lines
4001 lines

 

 

 

 

16000 lines
16001 lines

 

 

 

 

18000 lines
./SpiderBot/

A "command line" interface to L_SBBOT_DownLoad function
(like program sync is a interface to sync() system call)
./SpiderBot/
  • ./SpiderBot.c (main program)
  • l_sbotcl.[ch] (command line options)
  • l_sbotopt.[ch] (SpiderBot options)
  • l_sbotdl.[ch] (call L_SBBOT_DownLoad)
  • l_sbotmsg.[ch] (help, about, thanks messages)
  • l_sbotmnu.[ch] (some new interface)
./lib/wpplib/l_data/
./lib/wpplib/l_robot/

Web Robot, as function.
./lib/wpplib/l_data/
  • l_log.[ch] (log protocol messages)
  • l_ws_manager.[ch] (manager weblib options)
./lib/wpplib/l_robot/
  • l_sbbot.[ch] (real SpiderBot, as function)
./lib/weblib/l_data/
Web Library
./lib/webib/
  • l_wdt (Web Data Types: url, mime header, ...)
  • l_encode (base64, hexToDec, etc)
  • l_ws (options to use in weblib)
  • l_verbose (show progress information)
  • l_vp (virtual protocol, a generic interface)
  • l_ftp (ftp protocol)
  • l_http (http protocol)
  • l_file (file protocol)
  • l_pop3 (pop3 protocol)
  • l_nntp (nntp protocol)
new protocols are added using "copy and paste", in a object-oriented-language is easier and best. See add protocols for more information.
./lib/corelib
Basic Library
./lib/corelib/
  • l_alloc (memory manager)
  • l_string (more string functions)
  • l_net (sockets utilities)
  • l_adt (abstract data types)
  • ...