Fastest way to find redirects a web URL goes through

Hi. First of all, are this urls from a different domains? I would suggest of course to use a multithreaded approach. Plus, I consider that the best for such things is to use python. So, I can deliver a script that would start n(configured) number of threads to crawl the urls and to detect redirects. I guess there can be cases then multiple level redirects are present? Let me know the details and we can continue.

Dear Sir, Greetings from velrajan!! I will create multithreaded apps for you.. The tool will be like this.. 1. Option to browser and load the list of urls from txt file. 2. You can set number of parallel thread you want to execute to increase the speed. 3. Click a button 4. The tool will generate a CSV file like this.. original url, redirected url. Please clarify this point.. "The software should have enable/disable option for redirects via meta-refresh/javascript location moves" I know we can redirect url from meta-refresj and javascript.. don't you want those redirected url? Looking forward to work with you.. Velrajan T.

HEllo, If you want, i can do it in java, calling 1000000 urls using multi threading environment. I can't launch all of them at once due to the fact that i don't have a lot of RAMs on my machine. But this can be managed, and a threshold can be established. I guess 10.000 URL in parallel. Regards, VLG

Hello, Did you try with cURL multiple threads?   Cheers,

Hi PHP is so slow when compared with C++, but if you do not use many threads, you won't get a better speed that deserves writing new code. I recommend using a thread pool. For example 20 threads are working together and each thread works on a set of URLs (let us say 100 url). By using threads, you will get a very good speed. I can build this using threads and asynchronous programming in Qt, so you get the best speed ever. When we use asynchronous programming, the threads won't consume CPU cycles while they are waiting for the reply to be received. Also in C++ we get faster parsing for response to detect redirects. We will also give enough time to test the program, so I added more days to the project. Thanks in advance

A proposal has not yet been provided