Weeks 8-10: NVIDIA Isaac Platform
This block is dedicated to the NVIDIA Isaac platform, integrating advanced AI capabilities for perception, control, and training.
Topics Covered
- NVIDIA Isaac SDK and Isaac Sim: Detailed exploration of the software development kit (SDK) and the powerful Isaac Sim simulation environment.
- AI-powered Perception and Manipulation: Implementing deep learning models for tasks such as object recognition, pose estimation, and fine-grained manipulation.
- Reinforcement Learning for Robot Control: Applying RL techniques to teach the humanoid robot complex behaviors and motion policies dynamically.
- Sim-to-Real Transfer Techniques: Learning the methodology and tooling required to train models in simulation (Isaac Sim) and deploy them successfully to physical hardware (Isaac ROS).
warning
Access to an RTX-enabled GPU is mandatory for this module due to the requirements of Isaac Sim.