Intro to AI Transformers
Learn about what transformers are (the T of GPT) and how to work with them using Hugging Face libraries
Skill level
IntermediateTime to complete
Average based on combined completion rates — individual pacing in lessons, projects, and quizzes may vary2 hoursProjects
1Prerequisites
2 coursesWe suggest you complete the following courses before you get started with Intro to AI Transformers:- Intro to Hugging Face
- Intro to PyTorch and Neural Networks
About this course
Generative AI tools like ChatGPT are powered by neural networks called transformers. In this course, you will learn how transformers work and use Hugging Face’s transformer tools to generate text (with GPT-2) and perform sentiment analysis (with BERT). Along the way, you’ll learn about the history of transformer models and how to address carbon impacts of model training.
Skills you'll gain
Understand how transformers work
Use Hugging Face’s Transformers package
Create pipelines for NLP tasks
Select the right model for a task
Syllabus
2 lessons • 1 project • 2 quizzesCertificate of completion available with Plus or Pro
Earn a certificate of completion and showcase your accomplishment on your resume or LinkedIn.
Earn a certificate of completion
Show your network you've done the work by earning a certificate of completion for each course or path you finish.- Show proofReceive a certificate that demonstrates you've completed a course or path.
- Build a collectionThe more courses and paths you complete, the more certificates you collect.
- Share with your networkEasily add certificates of completion to your LinkedIn profile to share your accomplishments.
Reviews from learners
- The progress I have made since starting to use codecademy is immense! I can study for short periods or long periods at my own convenience - mostly late in the evenings.ChrisCodecademy Learner @ USA
- I felt like I learned months in a week. I love how Codecademy uses learning by practice and gives great challenges to help the learner to understand a new concept and subject.RodrigoCodecademy Learner @ UK
- Brilliant learning experience. Very interactive. Literally a game changer if you're learning on your own.John-AndrewCodecademy Learner @ USA
Our learners work at
Frequently asked questions about Intro to AI Transformers
A transformer is a type of neural network - “transformer” is the T in ChatGPT. Transformers work with all types of data, and can easily learn new things thanks to a practice called transfer learning. This means they can be pretrained on a general dataset, and then finetuned for a specific task.
Join over 50 million learners and start Intro to AI Transformers today!
Looking for something else?
Related resources
- Article
Getting Started With Hugging Face
An introduction to one of the most popular new ML education and model-building resources. - Article
Getting Started with OpenAI Models
Learn how to use an OpenAI model and fine-tune it tailoring it to better fit tasks or topics. - Article
What Are GPT Assistants?
Learn how to create and use GPT Assistants.
Related courses and paths
- Course
Learn Text Classification with PyTorch
Learn how to use PyTorch in Python to build text classification models using neural networks and fine-tuning transformer models.With CertificateIntermediate1 hour - Free course
Intro to Hugging Face
Learn about the Hugging Face AI and machine learning platform, and how their tools can streamline ML and AI development.Beginner Friendly< 1 hour - Course
Learn How To Build Your Own GPT
Learn how to build a Generative Pre-trained Transformer (GPT) from scratch using PyTorch.With CertificateIntermediate1 hour
Browse more topics
- AI2,062,471 learners enrolled
- Data science4,643,249 learners enrolled
- Machine learning688,046 learners enrolled
- Code foundations7,637,066 learners enrolled
- Computer science6,099,208 learners enrolled
- Web development5,118,062 learners enrolled
- Python3,748,379 learners enrolled
- For business3,512,754 learners enrolled
- JavaScript2,933,358 learners enrolled
Unlock additional features with a paid plan
Practice Projects
Guided projects that help you solidify the skills and concepts you're learning.Assessments
Auto-graded quizzes and immediate feedback help you reinforce your skills as you learn.Certificate of Completion
Earn a document to prove you've completed a course or path that you can share with your network.