Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

How to send lots of POST requests QUICKLY

I'm planning to develop a program for our university research that has to send lots of post requests to different urls. It must work as quick as possible (we should process about 100kk urls). What language shoud i use (currently i'm writing in c++, delphi and perl a bit)?

Also, I've heard that it's possible to write an multithreaded app in perl using prefork that can process about 20-30k per minute. Is it true?

// Sorry for my bad english, but it seems to be the only place where i can get the right answer

Andrew

like image 823
user1239398 Avatar asked Nov 29 '22 15:11

user1239398


1 Answers

The 20-30k per minute is completely arbitrary. If you run this on an 8-core machine with a beefy network connection you could probably surpass that.

However, I don't think your choice of programming language / library is going to matter much here. Instead, you're going to run into the number of concurrent TCP connections allowed by the machine, and also the bandwidth of the link itself.

like image 109
Jonathon Reinhart Avatar answered Dec 09 '22 13:12

Jonathon Reinhart