Goldfish loss

◀ Prev | 2025-10-27, access: Free account (logged in) | Next ▶

Video training theory text Apertus copyright It may be a problem for text models to generate exact quotes from training data. This paper looks at a simple modification to the training loss function, intended to prevent models from being able to generate exact quotes. The technique was adopted by the recent Apertus models in their pursuit of "compliance."

Click here to log in to your account, or here to sign up for a free account.