I found that anomalous tokens like SolidGoldMagikarp can be used to identify which base model an Instruct model was trained from. This idea was inspired by an idea for fingerprinting mesaoptimizers…

Posters: repligate. repligate

4 likes recorded by the source corpus.