Course

Learn How To Build Your Own GPT

Learn how to build a Generative Pre-trained Transformer (GPT) from scratch using PyTorch.

This course includes
1,880 learners enrolled
This course includes

  • Skill level

    Intermediate

  • Time to complete

    Average based on combined completion rates — individual pacing in lessons, projects, and quizzes may vary
     
    1 hour

  • Prerequisites

    2 courses
     
    We suggest you complete the following courses before you get started with Learn How To Build Your Own GPT:
    • Intro to PyTorch and Neural Networks
    • Generating Text with PyTorch

About this course

Learn how to build your own GPT (Generative Pre-trained Transformer) from scratch using PyTorch in this course. You will use PyTorch to construct a transformer, train it on a text corpus, and then use the trained transformer to generate new text.

Skills you'll gain

  • Understand the steps involved in building a GPT model

  • Train a transformer on text data to generate text

  • Tweak hyperparameters in a GPT model to achieve optimal performance

Syllabus

The platform

Hands-on learning

Animated GIF of an AI provided error explanation within Codecademy's learning environment
An AI-generated hint within the instructions of a Codecademy project
Animated GIF of Codecademy's Job Readiness Checker tool generating a compatibility report for a senior software engineer role
Animated GIF of building a phone screen interview using Codecademy's Interview Simulator
A fill-in-the-blank JavaScript question in a Codecademy assessment
Explore features

Earn a certificate of completion

Show your network you've done the work by earning a certificate of completion for each course or path you finish.
  • Show proofReceive a certificate that demonstrates you've completed a course or path.
  • Build a collectionThe more courses and paths you complete, the more certificates you collect.
  • Share with your networkEasily add certificates of completion to your LinkedIn profile to share your accomplishments.

Reviews from learners

  • The progress I have made since starting to use codecademy is immense! I can study for short periods or long periods at my own convenience - mostly late in the evenings.
    Chris
    Codecademy Learner @ USA
  • I felt like I learned months in a week. I love how Codecademy uses learning by practice and gives great challenges to help the learner to understand a new concept and subject.
    Rodrigo
    Codecademy Learner @ UK
  • Brilliant learning experience. Very interactive. Literally a game changer if you're learning on your own.
    John-Andrew
    Codecademy Learner @ USA

Our learners work at

  • Google Logo
  • Meta Logo
  • Apple Logo
  • EA Logo
  • Amazon Logo
  • IBM Logo
  • Microsoft Logo
  • Reddit Logo
  • Spotify Logo
  • Uber Logo
  • YouTube Logo
  • Instagram Logo

Join over 50 million learners and start Learn How To Build Your Own GPT today!

Looking for something else?

Related resources

Related courses and paths

Browse more topics

View full catalog

Unlock additional features with a paid plan

  • Practice Projects

    Guided projects that help you solidify the skills and concepts you're learning.

  • Assessments

    Auto-graded quizzes and immediate feedback help you reinforce your skills as you learn.

  • Certificate of Completion

    Earn a document to prove you've completed a course or path that you can share with your network.
See pricing and plans