Online Course

Generative AI for Robotics

Learn all you need to go from knowing nothing about the technology behind ChatGPT to using it in a robot for moving, perception, and human command understanding.

START LEARNING

Course Overview

Generative AI is the next step after the DeepLearning revolution. It allows systems to create new behaviors, movements, information, and data based on their training.

This discipline in AI is here to stay, and any engineer now needs to master these skills as soon as possible because this train is picking up steam.

What You Will Learn

N

Foundations of Generative AI

N

Generative AI Models Basics

N

Generative AI for Robot Actions

N

Vision Language Models

N

Navigation with AI



100% Online

No ROS setup is required. Everything is online.



Intermediate Level

}

Approx. 24 hours to complete

i

Prerequisites

Simulated Robot Used

deepmind_bot & Mo

Generativa AI for robotics robots with name

Syllabus

Unit 1: Intro

In this unit, you will gain a comprehensive insight into the core themes and objectives of our Generative AI course.

Unit 2: Foundations of Generative AI

In this unit, learn the basic elements before training a generative model, including:

Database
Tokenize

Byte-pair Encoding (BPE) Tokenization
WordPiece Tokenization
Unigram Tokenization
SentencePiece Tokenization
How to Use the Hugging Face Tokenizers Library
How to Train and Deploy Tokenizers to Hugging Face

Unit 3: Generative AI Model Basics

In this unit, learn how generative models are trained and created, including:

Pre-processing data for training.
Retraining an existing trained model, known as fine-tuning.
Training an existing model from scratch.
Designing your own model and training it.

Unit 4: Generative AI for Robot Actions

In this unit, learn how to move a robot using a Generative AI model, including:

Training a text-to-text model.
Applying this model to control the robot based on textual commands.

Unit 5: Vision Language Models for Robotics

In this unit, learn how to use Vision Language Models for robotics applications, including:

What are Vision Language Models
How to finetune for your needs
How to train them from scratch
How to use them in a robotics application

Unit 6: Navigation with Generative AI models

In this unit, learn how to use a Generative AI model to navigate using the ROS2 navigation stack, including:

How to generate the dataset from training
How to fine-tune the model
How to send human-understandable commands to the robot and navigate accordingly

What our students think

“I am wholeheartedly grateful for this outstanding opportunity. I wouldn’t have found a better ROS beginner-friendly course elsewhere. Thanks, ConstructSim !“

Francois Gonothi Toure

“I have tried to start learning ROS before and that was so difficult because I didn’t understand how to start, now with these introductory courses I am very excited because I can finally start to enter this world.“

Daniel Martínez

“I really enjoy the practical aspect and learning by doing. I feel like I learn way faster and with a rich understanding.”

Jose Dos Santos