Logo Xingxin on Bug

HKUST PhD Chronicle, Week 61, PICO 4 Teleop and Franka DUO

October 15, 2026
3 min read
No tags available

Pico4 Single Arm Teleoperation

This week, I completed the single arm teleoperation setup using the PICO 4. It is really pleasing to see how smooth our trajectory look in the LeRobot Dataset Visualizer. Meantime, the latency between my teleoperated command and the robot updating its state is very low, matching the performance of the DROID. I am pretty satisfied with the result.

SetupDiagram
Ours(Xbox, legacy)lerobot-visualizer-xbox-teleop-data.webp
Ours(Pico4, current)lerobot-visualizer-pico4-teleop-data.webp
DROIDlerobot-visualizer-droid-teleop-data.webp

Franka DUO

It’s also time for me to explore what a Franka DUO actually is. Because it is currently a prototype, I found its documentation and setup quite confusing. Here is my visual summary of the different embodiments related to the “Franka DUO”.

Stationary Franka DUOSpine Franka DUOMobile Franka DUO
Stationary-FR3-Duo-viser.webpSpine-FR3-Duo-viser.webpMobile-FR3-Duo-viser.webp
the DUO can’t movemoving zz 1DOFmoving zz 1 DOF + x,yx,y 2 DOF

This table only compares their visuals and basic kinematics. After digging into the franka_ros2: ROS 2 integration for Franka research robots, I realized that implementing the controller is even more complex. Even the official Franka team doesn’t have a single standard solution for it yet!

Approximate Value Function

After warming up my brain last week, I was finally able to pick up some new knowledge from ADM. Here are my study notes from this week: How to Approximate Value Functions with Linear Regression?.

New Water Sport Center

I tried out a different water sport center in the northeast of Hong Kong: the Wong Shek Water Sport Center, located in a beautiful region called Sai Kung. I was also fortune enough to practice a new technique called the “flare gybe” with a licensed instructor. He told me this is a fundamental skill to master before learning the fast gybe! : -)

wong-shek-wsc.webp

However, the wind direction there is super weird because the bay is surrounded by mountains. The wind can completely shift directions between the morning and the afternoon! Some areas have strong wind while others have none at all. This was the first time I learned how to avoid getting trapped in a “no-wind zone”. It is actually quite easy to spot. You just look at the water’s surface and avoid the flat, glass-like patches.

See also...