Eric Nguyen, a PhD candidate at Stanford University, joins us today. We discuss his work on lengthy context foundation models, its use in biology in particular, and how it evolved into and models during our chat. We talk about Hyena, a language model built on convolutionals that was created to address the difficulties associated with large context lengths in language modeling.
↧