Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
27 changes: 20 additions & 7 deletions docs/source/how-to/cloudxr_teleoperation.rst
Original file line number Diff line number Diff line change
Expand Up @@ -556,7 +556,7 @@ hand tracking from the headset is occluded or when higher-precision finger data
.. code-block:: bash

# Copy a shipped profile and enable push devices
cp $(python -c "from isaaclab_teleop import CLOUDXR_JS_ENV; print(CLOUDXR_JS_ENV)") ~/manus.env
cp $(uv run python -c "from isaaclab_teleop import CLOUDXR_JS_ENV; print(CLOUDXR_JS_ENV)") ~/manus.env
sed -i 's/NV_CXR_ENABLE_PUSH_DEVICES=0/NV_CXR_ENABLE_PUSH_DEVICES=1/' ~/manus.env

uv run python scripts/environments/teleoperation/teleop_se3_agent.py \
Expand All @@ -569,7 +569,7 @@ hand tracking from the headset is occluded or when higher-precision finger data
.. code-block:: bash

# Copy a shipped profile and enable push devices
cp $(python -c "from isaaclab_teleop import CLOUDXR_JS_ENV; print(CLOUDXR_JS_ENV)") ~/manus.env
cp $(./isaaclab.sh -p -c "from isaaclab_teleop import CLOUDXR_JS_ENV; print(CLOUDXR_JS_ENV)") ~/manus.env
sed -i 's/NV_CXR_ENABLE_PUSH_DEVICES=0/NV_CXR_ENABLE_PUSH_DEVICES=1/' ~/manus.env

./isaaclab.sh -p scripts/environments/teleoperation/teleop_se3_agent.py \
Expand All @@ -589,17 +589,30 @@ Requirements:

* Manus gloves with a Manus SDK license

The Manus plugin is included in the ``isaacteleop`` package and activated automatically when
configured in the environment's retargeting pipeline. Manus tracking data flows through the same
API as headset-based optical hand tracking in Isaac Teleop, so the same retargeters and pipelines
work with both input sources.
The Manus plugin is included in the ``isaacteleop`` package. In Isaac Lab, ``--xr``
auto-launches CloudXR and enables the same retargeting pipeline used for headset optical
hand tracking, so no extra Python-side integration is required. The native Manus plugin
binary still runs as a separate process.

For plugin configuration details, see the `Manus plugin documentation
<https://nvidia.github.io/IsaacTeleop/main/device/manus.html>`_.

The recommended workflow:

#. Start Isaac Lab and click **Start XR**.
#. Start Isaac Lab and click **Start XR**. This auto-launches the CloudXR runtime and
writes its environment file.
#. In a separate terminal, source that environment file and launch the Manus plugin
Comment thread
Aniket-Manus marked this conversation as resolved.
from your Isaac Teleop checkout (replace ``<isaac_teleop_root>`` with the path
where you built the plugin per the `Manus plugin documentation
<https://nvidia.github.io/IsaacTeleop/main/device/manus.html>`_):

.. code-block:: bash

source ~/.cloudxr/run/cloudxr.env
cd <isaac_teleop_root>
./install/plugins/manus/manus_hand_plugin
Comment thread
Aniket-Manus marked this conversation as resolved.

Keep this process running for the duration of the session.
#. Put on the Manus gloves and headset.
#. Use voice commands to launch the Isaac XR Teleop Sample Client and connect to Isaac Lab.

Expand Down