What is the maximum http request per second Everything can handler ?

General discussion related to "Everything".
Post Reply
Kangzilla
Posts: 1
Joined: Fri Aug 06, 2021 8:15 am

What is the maximum http request per second Everything can handler ?

Post by Kangzilla »

I am trying to access images by Everything HTTP service.
My application will try to calibrate URL link with http response.

URL sample :
http://30.222.123.99/E%3A/OBRIMAGE/OUT/ ... 0000-2.jpg

calibration target part :
202108051229 -> YYYYMMDDHH24MI

if above URL http response = 404,
my application will try again with
http://30.222.123.99/E%3A/OBRIMAGE/OUT/ ... 0000-2.jpg
or
http://30.222.123.99/E%3A/OBRIMAGE/OUT/ ... 0000-2.jpg

if http response = 200 (image found), this image URL calibration will end.

i have maximum 450 URL per minute (worst case) need to do calibration, mean maximum 450*3 = 1250 http request will send to Everything.

Can it handle ? What is the maximum http request per second Everything can handler ?

thank you for your assist.
NotNull
Posts: 5461
Joined: Wed May 24, 2017 9:22 pm

Re: What is the maximum http request per second Everything can handler ?

Post by NotNull »

I can't answer your question, but I would suggest to just try it. Everything is very fast, but nobody here knows how fast your hardware and infrastructure are.

Some other suggestions, as I suspect talking to a webserver this way is sub-optimal (but that is without knowing the exact workflow)
- Combine the searches:
202108051228 } 202108051229 | 202108051230
( | means OR)
- Use the SDK instead to integrate your queries in your program or even the command-line interface ES. That might eliminate some overhead and therefor improve speed.
When using the aformentioned search, you will get a reply with which one matches that query
void
Developer
Posts: 16753
Joined: Fri Oct 16, 2009 11:31 pm

Re: What is the maximum http request per second Everything can handler ?

Post by void »

The HTTP server should be able to handle 10,000 requests per second.

Above that, you will likely run into winsock2 limitations.

There is a db query behind each request, so the limit is more realistically around 100-1000 requests per second.

My suggestion is to just send as many requests to the HTTP server and see what happens.

You will most likely get connection failures as the winsock connection buffer is full.
-If there is a connection failure, simply re-add the request to a queue and try again.

Or, you will get read timeouts as Everything is busy performing other queries.


Note: Everything will only perform one db request at a time.
Other requests will block until the database becomes available.
Post Reply