Foundation model
- In French:
- Modèle de fondation
Definition
An AI model trained on very large quantities of varied data, then adapted to many different tasks. The term was proposed in 2021 by Stanford researchers to describe models such as BERT or GPT-3, which serve as a common base for many applications. This centralisation has a downside: the flaws of a foundation model are found in every model derived from it.
Checked on against the references below.