CourseIntermediate3 Course Modules

Generative AI with Large Language Models

Instructors: Antje Barth, Chris Fregly, Shelbee Eigenbrode, Mike Chambers

AWS logo

Generative AI with Large Language Models

Intermediate

3 Courses

47 Video Lessons

16 Reading Lessons

Instructors: Antje Barth, Chris Fregly, Shelbee Eigenbrode, Mike Chambers

AWS

AWS

What you’ll get from Generative AI with LLMs

  • Gain foundational knowledge, practical skills, and a functional understanding of how generative AI works

  • Dive into the latest research on Gen AI to understand how companies are creating value with cutting-edge technology

  • Instruction from expert AWS AI practitioners who actively build and deploy AI in business use-cases today

What you’ll do in Generative AI with LLMs

  • Deeply understand generative AI, describing the key steps in a typical LLM-based generative AI lifecycle, from data gathering and model selection, to performance evaluation and deployment
  • Describe in detail the transformer architecture that powers LLMs, how they’re trained, and how fine-tuning enables LLMs to be adapted to a variety of specific use cases
  • Use empirical scaling laws to optimize the model’s objective function across dataset size, compute budget, and inference requirements
  • Apply state-of-the art training, tuning, inference, tools, and deployment methods to maximize the performance of models within the specific constraints of your project
  • Discuss the challenges and opportunities that generative AI creates for businesses after hearing stories from industry researchers and practitioners
  • Receive a Coursera certificate demonstrating your skills upon completion of the course

In partnership with

AWS null We worked with AWS to develop a world-class AI course on large language models. Our instructors, with their extensive expertise in AI and machine learning, offer practical knowledge drawn from real-world experience that can be applied to your projects and career.

Who should join?

  • For data scientists: Gain deeper knowledge into the underlying structure and mechanisms of generative AI and explore avenues for further innovations in this field.
  • For machine learning engineers: Learn how to better train, optimize and fine tune generative models while learning about different use cases and applications.
  • For prompt engineers: Explore advanced prompting techniques and learn how to control your output using generative configuration parameters.
  • For research engineers: Explore the state of art generative models and architectures in depth to build on top of with your own advanced techniques in generative AI.
  • For anyone interested in generative AI: Get an extensive introduction to developing with generative AI and its fundamentals.

Instructors

Antje Barth

Antje Barth

Principal Developer Advocate, Generative AI, Amazon Web Services (AWS)
Chris Fregly

Chris Fregly

Principal Solutions Architect, Generative AI, Amazon Web Services (AWS)
Shelbee Eigenbrode

Shelbee Eigenbrode

Principal Solutions Architect, Generative AI, Amazon Web Services (AWS)
Mike Chambers

Mike Chambers

Developer Advocate for Generative AI at AWS, Co-instructor of Generative AI with Large Language Models

What do I need to succeed in this course?

This is an intermediate course, so you should have some experience coding in Python to get the most out of it. You should also be familiar with the basics of machine learning, such as supervised and unsupervised learning, loss functions, and splitting data into training, validation, and test sets. If you have taken the Machine Learning Specialization or Deep Learning Specialization, you’ll be ready to take this course and dive deeper into the fundamentals of generative AI.

Learner Reviews

Frequently Asked Questions

Course Outline

47 Video Lessons • 16 Reading Lessons

Course Introduction

Video • 6 mins

Contributor Acknowledgments

Reading • 10 mins

Introduction - Week 1

Video • 5 mins

Generative AI & LLMs

Video • 4 mins

Join the DeepLearning.AI Forum to ask questions, get support, or share amazing ideas!

Reading

LLM use cases and tasks

Video • 2 mins

Text generation before transformers

Video • 2 mins

Transformers architecture

Video • 7 mins

Generating text with transformers

Video • 5 mins

Transformers: Attention is all you need

Reading • 10 mins

Prompting and prompt engineering

Video • 5 mins

Generative configuration

Video • 7 mins

Generative AI project lifecycle

Video • 4 mins

[IMPORTANT] About the labs in this course

Reading • 5 mins

Lab 1 walkthrough

Video • 13 mins

Lab 1 - Generative AI Use Case: Summarize Dialogue

Pre-training large language models

Video • 9 mins

Computational challenges of training LLMs

Video • 10 mins

Optional video: Efficient multi-GPU compute strategies

Video • 8 mins

Scaling laws and compute-optimal models

Video • 8 mins

Pre-training for domain adaptation

Video • 5 mins

Domain-specific training: BloombergGPT

Reading • 10 mins

Week 1 quiz

Graded・Quiz • 1 hour

Week 1 resources

Reading • 10 mins

Lecture Notes Week 1

Reading • 1 min

Generative AI with Large Language Models

Intermediate

3 Courses

47 Video Lessons

16 Reading Lessons

Instructors: Antje Barth, Chris Fregly, Shelbee Eigenbrode, Mike Chambers

AWS

AWS

Want to learn more about Generative AI?

Keep learning with updates on curated AI news, courses, and events, as well as Andrew's thoughts from DeepLearning.AI!

Enroll for Free

Also available on Coursera