An inventory of casual knowledge would be really fun, although it's hard to think what it would consist of now that I think about it...
There is this concept of "hidden knowledge" about all the things you know at work that no one really thinks about is knowledge so it's hard to let newcomers know about it.
But that does sound different than "casual knowledge", and so does "trivia".
Oh well!