Anthropic is training on a bunch of file types. It works great, and the models pick up skills like obeying XML tags. No open pre-training datasets do this. There are tons of PDFs, SVGs, and LaTeX…

Posters: georgejrjrjr. georgejrjrjr

3 likes recorded by the source corpus.