(arxiv.org)

248 points doener | 1 comments | 15 Apr 25 10:17 UTC | HN request time: 0.219s | source

1. andai ◴[15 Apr 25 15:46 UTC] No.43694493[source]▶

Can someone explain this? They just reduce the English text during pretraining to balance it out? Shouldn't that harm every other benchmark though?

Teuken-7B-Base and Teuken-7B-Instruct: Towards European LLMs (2024)