Series
Rl Manipulation
The "Rl Manipulation" series has 8 parts — read them in order from part 1.
ManipulationRL for Manipulation: MDP, Reward Design & Environment Setup
Build the foundation of RL for manipulation — from MDP formulation and reward function design to setting up MuJoCo environments from scratch.
Grasping with RL: Stable Grasp & Object Variety
Train robots to grasp diverse objects with RL — from grasping reward design to curriculum learning with PPO and SAC.

RL Force Control: Balancing a Cup of Water
Train a robot to carry a cup of water without spilling using RL — reward design for force control, impedance baseline, and SAC training.
Precision Pick-and-Place: Position & Orientation Control
Train precise pick-and-place with RL — HER for sparse rewards, 6-DOF placement, and orientation alignment with sub-cm accuracy.
Carrying & Transporting Objects: Stability During Motion
Train robots to carry objects stably with RL — from carry-flat to pouring, multi-objective reward balancing speed vs stability.

Contact-Rich Manipulation: Assembly, Insertion & Peg-in-Hole
Solve contact-rich manipulation with RL — peg-in-hole, assembly, tactile sensing, and domain randomization for sim-to-real transfer.
Tool Use: Teaching Robots to Use Tools with RL
Teach robots to use tools with RL — affordance learning, two-phase grasp-then-use, and screwdriver insertion in MuJoCo.
Multi-Step Manipulation: Curriculum Learning for Long-Horizon Tasks
Solving long-horizon manipulation with RL — curriculum learning, hierarchical RL, skill chaining, and IKEA furniture assembly benchmarks.