完成本课程,赢取 Google DeepMind:训练小语言模型高级技能徽章,展示您在以下方面的技能: 提出实际的语言模型研究问题;构建一个简单的词元化器;制作用于训练 Transformer 语言模型的数据集;运行小语言模型的训练循环。 注册免费订阅,即可免费访问此实验。每月可免费获得 35 个点数!
In this Google DeepMind course, you will learn the fundamentals of language models and gain a high-level understanding of the machine learning development pipeline. You will consider the strengths and limitations of traditional n-gram models and advanced transformer models. Practical coding labs will enable you to develop insights into how machine learning models work and how they can be used to generate text and identify patterns in language. Through real-world case studies, you will build an understanding around how research engineers operate. Drawing on these insights you will identify problems that you wish to tackle in your own community and consider how to leverage the power of machine learning responsibly to address these problems within a global and local context.