Foundation model
- In French:
- Modèle de fondation
Definition
An AI model trained on very large quantities of varied data, then adapted to many different tasks. The term was proposed in 2021 by Stanford researchers to describe models such as BERT or GPT-3, which serve as a common base for many applications. This centralisation has a downside: the flaws of a foundation model are found in every model derived from it.
Checked on against the references below. · Written with AI · checked against the sources Source: Bommasani et al., “On the Opportunities and Risks of Foundation Models”, 2021 (arXiv:2108.07258).