What happens to latency if service time is cut in half (2022)

Why is arrival rate a function of service time?

Utilization is Service Time times Arrival Rate, ie if requests arrive twice as fast utilization is doubled, and also if a service takes twice as long to process.

When the theoretical service is optimized to take half a long, the assumption is that the request rate doesn't actually change. So they use the above relationship to calculate the new utilization, given half the service time and the same arrival rate.

I don't think he's claiming that it's causally a function of service time (although this can be the case if demand is elastic). Rather, utilisation is calculated from service time and arrival rate, and they're just stating that this equation can be rearranged to calculate arrival rate if you know the other two.

so the unit for Utilization in your example is "active request" ?

I just wish the article didn't assume units are easily inferred which would imply most readers are familiar with the subject.

Having read it more than once now I think utilization is a ratio, maybe?

But that means the unit for S needs to be seconds/request such that:

utilization(ro) = S * arrival_rate(lambda) = seconds/request * request/seconds = bare ratio.

More coffee required.

Yes, that's normally how utilisation is understood - as the fraction of time used by requests, which is therefore a dimensionless quantity.