I spend a fair bit of time these days thinking about overloaded servers and one recent problem I’ve wrestled with is how to shed load fairly when a server is overloaded. For example, if there are two separate tenants (users, accounts, clients, etc.) consuming vastly different amounts of resources, should we be treating them the same when shedding load? If one of those tenants is “misbehaving” and flooding the system with traffic, this can begin to affect everyone else sharing the system with this “noisy-neighbor”.

The different approaches to fairness I see folks taking are to either give each tenant…

Tony Allen

Programmer and aspiring lich in Seattle.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store