Learning Systems and Robotics Lab, Munich & Toronto

Learning Systems and Robotics Lab, Munich & Toronto Headed by Prof. Angela Schoellig, located at the TU Munich and the University of Toronto. The Learning Systems and Robotics Lab, headed by Prof.

Angela Schoellig, envisions a new generation of intelligent robotic systems that seamlessly interacts with the physical world. In particular, our research interests are centered around the challenges associated with robots operating in increasingly unstructured, uncertain, and changing scenes. By conducting research at the intersection of robotics, controls, and machine learning, we enhance the performance, safety, and autonomy of robots navigating in human-centric environments.

ICYMI: We had a blast at   2026 in Singapore last weekend presenting our IEEE Transactions on Robotics (T-RO) paper  : S...
28/01/2026

ICYMI: We had a blast at 2026 in Singapore last weekend presenting our
IEEE Transactions on Robotics (T-RO) paper : Safe and Interactive Crowd Navigation Using MPC and Bilevel Optimization.
Paper, Code, Videos: https://sepehr.fyi/projects/sicnav

16/12/2025

SwarmGPT meets the new Crazyflie Colour LED Deck ๐Ÿš๐ŸŒˆ

We are excited to share our recent collaboration with Bitcraze, showcasing how Bitcraze's new Crazyflie Colour LED Deck takes drone swarm choreographies to the next level.

The programmable LED Deck adds a powerful visual layer to our swarm performance: synchronization, grouping, role assignment, and timing become immediately visible in the air. This not only makes swarm behaviour more expressive and engaging, but also easier to inspect and understand in real time.

In parallel, our recent work, SwarmGPT (https://ieeexplore.ieee.org/document/11197931), explores how large language models can be used as a high-level interface for designing such choreographies. Instead of manually specifying trajectories, SwarmGPT translates natural-language intent and music-derived cues into structured swarm behaviours that are executed safely using model-based planning and control.

Together with Bitcraze, we demonstrate SwarmGPT on the Crazyflie brushless platform equipped with the new Colour LED Deck, highlighting how hardware innovation and swarm research can seamlessly reinforce each other. Hope you enjoy the video and happy holidays!

Special thanks to Fredrik Ehrenstrรฅle and Marcel Rath for creating the soundtrack and for making the video.

-collaborations

17/09/2025

Looking for an easy-to-use way to deploy your VLAs and diffusion policies on real robots (maybe even before the ICRA video deadline next week ๐Ÿ‘€)?

๐Ÿš€ Excited to share our latest work: ๐—–๐—ฅ๐—œ๐—ฆ๐—ฃ - ๐—–๐—ผ๐—บ๐—ฝ๐—น๐—ถ๐—ฎ๐—ป๐˜ ๐—ฅ๐—ข๐—ฆ2 ๐—–๐—ผ๐—ป๐˜๐—ฟ๐—ผ๐—น๐—น๐—ฒ๐—ฟ๐˜€ ๐—ณ๐—ผ๐—ฟ ๐—Ÿ๐—ฒ๐—ฎ๐—ฟ๐—ป๐—ถ๐—ป๐—ด-๐—•๐—ฎ๐˜€๐—ฒ๐—ฑ ๐— ๐—ฎ๐—ป๐—ถ๐—ฝ๐˜‚๐—น๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐—ฃ๐—ผ๐—น๐—ถ๐—ฐ๐—ถ๐—ฒ๐˜€ ๐—ฎ๐—ป๐—ฑ ๐—ง๐—ฒ๐—น๐—ฒ๐—ผ๐—ฝ๐—ฒ๐—ฟ๐—ฎ๐˜๐—ถ๐—ผ๐—ป!

Why CRISP?
Most learning-based policies (diffusion, VLAs, etc.) output low-frequency or discontinuous commands, which donโ€™t play nicely with real hardware. CRISP bridges that gap with lightweight, compliant, torque-based controllers built on hashtag control.

Features:
๐Ÿ ๐—ฃ๐˜†๐˜๐—ต๐—ผ๐—ป ๐—ถ๐—ป๐˜๐—ฒ๐—ฟ๐—ณ๐—ฎ๐—ฐ๐—ฒ โ€” control your robot around without worrying about topics, spinning, etc., but still keep full ROS2 flexibility.
๐Ÿ” ๐—š๐˜†๐—บ๐—ป๐—ฎ๐˜€๐—ถ๐˜‚๐—บ ๐—ฒ๐—ป๐˜ƒ๐—ถ๐—ฟ๐—ผ๐—ป๐—บ๐—ฒ๐—ป๐˜ โ€” use teleoperation to record robot and visual data in hashtag format & seamlessly deploy learning-based policies.
๐ŸŽฅ ๐——๐—ฒ๐—บ๐—ผ-๐—ฟ๐—ฒ๐—ฎ๐—ฑ๐˜† โ€” examples for single-arm & bimanual manipulation with the Franka FR3.
๐Ÿค– ๐—–๐—ฎ๐—ฟ๐˜๐—ฒ๐˜€๐—ถ๐—ฎ๐—ป & ๐—ท๐—ผ๐—ถ๐—ป๐˜-๐˜€๐—ฝ๐—ฎ๐—ฐ๐—ฒ ๐—ฐ๐—ผ๐—ป๐˜๐—ฟ๐—ผ๐—น๐—น๐—ฒ๐—ฟ๐˜€ โ€“ built for torque control and smooth, compliant interaction.
๐Ÿšซ ๐—ก๐—ผ ๐— ๐—ผ๐˜ƒ๐—ฒ๐—œ๐˜ ๐—ผ๐—ฟ ๐—ต๐—ฒ๐—ฎ๐˜ƒ๐˜† ๐—ฝ๐—น๐—ฎ๐—ป๐—ป๐—ถ๐—ป๐—ด ๐˜€๐˜๐—ฎ๐—ฐ๐—ธ๐˜€ required, ready to use.

Our goal: Make deploying learning-based methods on real robots as frictionless as possible, reducing the gap between data collection, simulation, and deployment.

๐Ÿ“„ Paper: https://arxiv.org/abs/2509.06819
๐Ÿ’ป Code: https://github.com/utiasDSL/crisp_controllers
๐ŸŒ Website: https://utiasdsl.github.io/crisp_controllers/

This work is the result of a great team effort by Daniel San Josรฉ Pro, Oliver Hausdรถrfer, Ralf Rรถmer, Maximilian Dรถsch, and Martin Schuck!

25/08/2025

Some summer entertainment needed? Prof. Schoellig is giving a virtual seminar tomorrow Tuesday, Aug 26th, 13:00-14:30 (CEST) / 7:00-8:30 (EST) on "Aerial Swarms: From Safe Motion Planning to Language-Based Interaction." Teaser video below.

Join live (or watch the recording): https://youtu.be/fY5CAQrRJRI?si=Nl4UuvNyuST53KfI

This is a pre-event of the IROS workshop on Multi-Agent Cooperative Systems and Swarm Robotics in the Era of Generative AI workshop with amazing fellow speakers: https://lnkd.in/dzZtb_PF

Adresse

Munich
80333

Benachrichtigungen

Lassen Sie sich von uns eine E-Mail senden und seien Sie der erste der Neuigkeiten und Aktionen von Learning Systems and Robotics Lab, Munich & Toronto erfรคhrt. Ihre E-Mail-Adresse wird nicht fรผr andere Zwecke verwendet und Sie kรถnnen sich jederzeit abmelden.

Teilen