This just polls every x (default 30) seconds; if you use IMAP you can do better with IDLE (e.g. I pipe `fetchmail --check` to something that triggers a sync to immediately get new mails)
There are pub/sub notifications but it's a bit of a pain to get working. You need an HTTP endpoint the server can reach for push notifications, I think, not long polling.
The GMail web client definitely doesn't create an HTTP endpoint to receive updates. But the API it uses is likely proprietary and private (even if it was built on top of the public API there would be a backend bridging the two)
Sorry, yes, my comment was confusing. I was answering the "how do I get faster notifications in a supported manner" part rather than the "how does the Gmail web UI do this" part.