{"id":1642,"date":"2022-12-19T15:57:07","date_gmt":"2022-12-19T15:57:07","guid":{"rendered":"http:\/\/www.wellformedness.com\/blog\/?p=1642"},"modified":"2022-12-20T20:09:40","modified_gmt":"2022-12-20T20:09:40","slug":"foundation-models","status":"publish","type":"post","link":"https:\/\/www.wellformedness.com\/blog\/foundation-models\/","title":{"rendered":"Foundation models"},"content":{"rendered":"<p>It is widely admitted that the use of <em>language\u00a0<\/em>in terms like\u00a0<em>formal language<\/em> and\u00a0<em>language model<\/em> tend to mislead neophytes, since they suggest the common-sense notion (roughly, <em>e-language<\/em>) rather than the narrow technical sense referring to a set of strings. Scholars at Stanford have been trying to push <em>foundation model<\/em> as an alternative to what were previously called <em>large language models<\/em>. But I don&#8217;t really like the implication\u2014which I take to be quite salient\u2014that such models <strong>ought<\/strong> to serve as the foundation for NLP, AI, whatever. I use large language models in my research, but not that often, and I actually don&#8217;t think they have to be part of every practitioner&#8217;s toolkit. I can&#8217;t help thinking that Stanford is trying to &#8220;make <em>fetch<\/em> happen&#8221;.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>It is widely admitted that the use of language\u00a0in terms like\u00a0formal language and\u00a0language model tend to mislead neophytes, since they suggest the common-sense notion (roughly, e-language) rather than the narrow technical sense referring to a set of strings. Scholars at Stanford have been trying to push foundation model as an alternative to what were previously &hellip; <a href=\"https:\/\/www.wellformedness.com\/blog\/foundation-models\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Foundation models&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"aside","meta":{"_crdt_document":"","footnotes":""},"categories":[4,5,7],"tags":[],"class_list":["post-1642","post","type-post","status-publish","format-aside","hentry","category-language","category-nlp","category-presentation-of-self","post_format-post-format-aside"],"_links":{"self":[{"href":"https:\/\/www.wellformedness.com\/blog\/wp-json\/wp\/v2\/posts\/1642","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.wellformedness.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.wellformedness.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.wellformedness.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.wellformedness.com\/blog\/wp-json\/wp\/v2\/comments?post=1642"}],"version-history":[{"count":2,"href":"https:\/\/www.wellformedness.com\/blog\/wp-json\/wp\/v2\/posts\/1642\/revisions"}],"predecessor-version":[{"id":1644,"href":"https:\/\/www.wellformedness.com\/blog\/wp-json\/wp\/v2\/posts\/1642\/revisions\/1644"}],"wp:attachment":[{"href":"https:\/\/www.wellformedness.com\/blog\/wp-json\/wp\/v2\/media?parent=1642"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.wellformedness.com\/blog\/wp-json\/wp\/v2\/categories?post=1642"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.wellformedness.com\/blog\/wp-json\/wp\/v2\/tags?post=1642"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}