Training Isaac-Lift-Cube-Franka-v0 example environment doesn't succeed

[itsmehere]

I currently have the Isaac-Reach-Franka-v0 task working with the following commands:
Training: ./isaaclab.sh -p source/standalone/workflows/skrl/train.py --task Isaac-Reach-Franka-v0 --headless
Playing: ./isaaclab.sh -p source/standalone/workflows/skrl/play.py --task Isaac-Reach-Franka-v0 --num_envs=1 --checkpoint="logs/skrl/reach_franka/2025-01-18_01-23-54_ppo_torch/checkpoints/best_agent.pt"

Now, I’m trying to train the Isaac-Lift-Cube-Franka-v0 task by running very similar commands but for the franka lift environment:
Training: ./isaaclab.sh -p source/standalone/workflows/skrl/train.py --task Isaac-Lift-Cube-Franka-v0 --headless
Playing: ./isaaclab.sh -p source/standalone/workflows/skrl/play.py --task Isaac-Lift-Cube-Franka-v0 --num_envs=1 --checkpoint="logs/skrl/franka_lift/2025-01-18_02-08-25_ppo_torch/checkpoints/best_agent.pt"

The franka arm moves but doesn’t go anywhere near the cube. Am I doing something incorrect when training this particular environment, or is there some value I have to set before the lift task works? I've tried the skrl and rsl_rl libraries, but none of them seem to perform correctly. All I’ve done is setup IsaacLab and IsaacSim by following the installation instructions, and I haven’t changed any code. I’m running a few examples right off the bat, and I’m just trying to get Isaac-Lift-Cube-Franka-v0 as listed here to work. The trained policy when played does the following:

Untitled.mov

[RandomOakForest]

Thank you for posting this. I will move this to our Discussions section for the team to follow up.

[RandomOakForest]

There are other RL libraries you may try, listed in this doc. Have you tried training with RSL RL?

[itsmehere]

I have tried with both RSL RL and skrl, and they both lead to something similar :/