The Americans drilled daily with live cannon, while the British drilled less often, and without live fire (presumably to conserve powder and balls).
As an unsurprising result, American crews were more experienced at reloading under the duress of cannonade. The sound on the gun decks was so great it would burst eardrums. The smoke made it too hard to see anything a few feet from the portals.
If you've never been near a gunpowder cannon fire, it's hard to comprehend the surreal rupture of reality it causes in your perception. I was to the side, but in front, of one. My world went black, then lightening values of gray. Sound returned. Then people appeared in the fog, moving with their arms out trying to get away blindly from the threat they perceived (that was already over).
Without proper training, new sailors will stumble badly in their first firefight, and each man on the gundeck is crucial to a team. The officers were outside the deck, so they could receive orders. If you can't load your cannon while blind and deaf, your cannon sits quiet a long time.
Archer kinda gets this more-right than most things, LOL. "MAWP! MAWP!"
Part of that is because the sound volume is just so drastically different compared to normally talking; microphones have trouble with it, audio amplifiers end up clipping [0], and most speakers would blow out if the amp didn't clip (especially for the larger guns). And, assuming none of that happened then, just as you would have on a gun deck, your listeners' ears would be damaged. So the sound of gunfire in media is quieted.
Most people simply aren't around guns in the first place, let alone firing guns (eg, going to a gun range with friends/family/etc even if you don't own a gun), to understand just how much media misrepresents it.