So why bother with a low level language like C? With just plain CPython, Flask and a file based approach (including polling the modified dates and thus get live reload) I can get up to ~2500 req/s on localhost with a good CPU, i.e. network is going to be the bottleneck until a fairly high level of performance (at which it becomes a no brainer to scale out).
It would still be interesting to know what you think you can achieve with this approach, i.e. in a direct comparison with Flask (because as you wrote it's quite similar in the featureset) what do you think is the advantage of your approach? Performance is the only justification you give on the page, so I'd be curious about this.
Other than that I guess it's useful if you want to display data from a C / C++ program without going through any bindings. When it comes to that, maybe it would be great to get some automatic HTML display helpers for data structures common in C, like Arrays of numerical values or pointers to sequences of structs. For example in Python it's really fun to just use something like [1] together with Flask and get interfaces to your data without doing any template programming.
On a decent box Go/GIN will do about 180K, Elixir/Phoenix almost 200K, Node/Express about 90K. People are not trying to be mean but in everyone's mind the major reason to use C framework would be it offering a significant speed advantage over easier to use alternatives.
One question I always had in mind about such high performance web servers: What kind of networking stack do you use to actually make use of it? This is probably a limitation of our VPS host, but on a given box it usually maxes out at around 1000 req/s while the webserver could do more. Can you get AWS to 200K? Azure? Google App Engine? Or am I just doing something wrong?
Actual box 24 cores 128G ram 2X10Gbe SSDs in RAID 10 . Not really a big fan of "clouds" for high load projects Rackspace onMetal looks OK though for some things.
That's what I expected. Yes, when you actually need on the order of 100k req/s, doing this over 100 vps or even 10 dedicated doesn't look that good over just 2-3 boxes in your own datacenter. That is, if you already have one. On the other hand even Netflix has moved on to Amazon, so there must be something to it.
Netflix get's 70% discount of list price, they also consume over 30% of AWS resources. They are pretty good match for AWS as they have extremely spiky workload.
