2022 is going to be the year of Foundational Models in AI research

Last year, researchers at Stanford University published a paper detailing a ‘paradigm shift’ in AI, driven by ‘Foundational Models.’ The term may be fresh, but the idea behind it was not. Foundational model refers to models trained to process data at scale and can be adapted to perform multiple tasks: It is a single model underlying other downstream models, hence the ‘foundation’ prefix. The foundational models are based on concepts that have been around for a while, like deep neural networks and self-supervised learning. The tipping point for foundational models came in 2018 when Google developed BERT, a natural language processing model, followed by OpenAI’s GPT3 and CLIP.  Education Student loans are a crippling problem in the United States, with the total de