DeepSeek: Advancing theorem proving in LLMs through large-scale synthetic data

Solutions to major mathematics problems generally require the creation of entirely new objects and the appropriate machinery to analyze them. The behavior of said objects generally ends up providing the solution to the original question as a special case. A new architecture is required but one that is probably not far off from the original transformer in nature.

sounds exactly like setting up pydantic models