hello,
i need a script or a program which works as a spider and a leecher for
URLs address.
what is the main functions of the program???????
1:i will provide the program with a list of URLs ,i can add it manually
and change it any time ,the program will go through all the links on
the main domain name only for each url and collect every line contain the below symbols,
a:url address
b:on some websites they change the url address for example instead of
using ((( http ))) they use ((( zzz ))) then the spider should collect all
the url which contain the below symbol
(((( http , // , * , : ))))
i mean the program should collect any line contain the above symbols.
2:some sites like web discussion or forums you need to login using a
username and password to go to the main section so i will provide the
program with the forum url and the username and password and the program should login to the concern sections and do the same previous job.
3:ability to use the program through a proxy server.
4:all the collected information should be saved in text file,every leeched URL should be saved on a separate line.
5:very important ,the program should go through each link on the domain name and not only on the page which i provide it.
6:the program must be very fast .
MIRC PROGRAM??
**************
this program can connect to MIRC and do the same previous job.
i mean on the MIRC there are a lot of servers like ((( dalnet ,effent
,undernet ....................))) the program should be able to connect
to a lot of server at the same time then we should be able to connect
to any channels we want and the program should collect all the above
symbols and save it to another text file .
also ability to use the program on MIRC through a proxy server.
also the program must be very fast .
thank you