Some of these, including one I had as a kid, produce sound through a small gramophone inside. No electronic amplification at all, just a needle on a tiny "record", mechanically connected to some kind of speaker shaped cone.
Here's someone taking apart the exact robot I had, and showing that mechanism: https://www.windytan.com/2013/02/the-atomic-powered-robot.ht...