"Constrained streaming generation produces partial objects, but no good ways of interacting with the partial objects, since they are not yet parse-able."
I've successfully used the ijson Python streaming JSON parser for this, notes here: https://til.simonwillison.net/json/ijson-stream