Full offline RL results

Full per-task table from the Drift Q-Learning appendix.

Back to project page
TaskBCIQLReBRACIDQLSRPOCACFAWACFBRACIFQLFQLDriftQL
OGBench AntMaze Large
antmaze-large-navigate-singletask-task1-v0 (*)0 ± 048 ± 991 ± 100 ± 00 ± 042 ± 71 ± 170 ± 2024 ± 1780 ± 895 ± 2
antmaze-large-navigate-singletask-task2-v06 ± 342 ± 688 ± 414 ± 84 ± 41 ± 10 ± 135 ± 128 ± 357 ± 1085 ± 9
antmaze-large-navigate-singletask-task3-v029 ± 572 ± 751 ± 1826 ± 83 ± 249 ± 1012 ± 483 ± 1552 ± 1793 ± 397 ± 1
antmaze-large-navigate-singletask-task4-v08 ± 351 ± 984 ± 762 ± 2545 ± 1917 ± 610 ± 337 ± 1818 ± 880 ± 491 ± 1
antmaze-large-navigate-singletask-task5-v010 ± 354 ± 2290 ± 22 ± 21 ± 155 ± 69 ± 576 ± 838 ± 1883 ± 492 ± 1
OGBench AntMaze Giant
antmaze-giant-navigate-singletask-task1-v0 (*)0 ± 00 ± 027 ± 220 ± 00 ± 00 ± 00 ± 00 ± 10 ± 04 ± 532 ± 2
antmaze-giant-navigate-singletask-task2-v00 ± 01 ± 116 ± 170 ± 00 ± 00 ± 00 ± 04 ± 70 ± 09 ± 779 ± 1
antmaze-giant-navigate-singletask-task3-v00 ± 00 ± 034 ± 220 ± 00 ± 00 ± 00 ± 00 ± 00 ± 00 ± 143 ± 2
antmaze-giant-navigate-singletask-task4-v00 ± 00 ± 05 ± 120 ± 00 ± 00 ± 00 ± 09 ± 40 ± 014 ± 2364 ± 3
antmaze-giant-navigate-singletask-task5-v01 ± 119 ± 749 ± 220 ± 10 ± 00 ± 00 ± 06 ± 1013 ± 916 ± 2885 ± 5
OGBench HumanoidMaze Medium
humanoidmaze-medium-navigate-singletask-task1-v0 (*)1 ± 032 ± 716 ± 91 ± 10 ± 038 ± 196 ± 225 ± 869 ± 1919 ± 1228 ± 2
humanoidmaze-medium-navigate-singletask-task2-v01 ± 041 ± 918 ± 161 ± 11 ± 147 ± 3540 ± 276 ± 1085 ± 1194 ± 387 ± 2
humanoidmaze-medium-navigate-singletask-task3-v06 ± 225 ± 536 ± 130 ± 12 ± 183 ± 1819 ± 227 ± 1149 ± 4974 ± 1856 ± 3
humanoidmaze-medium-navigate-singletask-task4-v00 ± 00 ± 115 ± 161 ± 11 ± 15 ± 41 ± 11 ± 21 ± 13 ± 439 ± 3
humanoidmaze-medium-navigate-singletask-task5-v02 ± 166 ± 424 ± 201 ± 13 ± 391 ± 531 ± 763 ± 998 ± 297 ± 299 ± 2
OGBench HumanoidMaze Large
humanoidmaze-large-navigate-singletask-task1-v0 (*)0 ± 03 ± 12 ± 10 ± 00 ± 01 ± 10 ± 00 ± 16 ± 27 ± 62 ± 1
humanoidmaze-large-navigate-singletask-task2-v00 ± 00 ± 00 ± 00 ± 00 ± 00 ± 00 ± 00 ± 00 ± 00 ± 00 ± 0
humanoidmaze-large-navigate-singletask-task3-v01 ± 17 ± 38 ± 43 ± 11 ± 12 ± 31 ± 110 ± 248 ± 1011 ± 723 ± 1
humanoidmaze-large-navigate-singletask-task4-v01 ± 01 ± 01 ± 10 ± 00 ± 00 ± 10 ± 00 ± 01 ± 12 ± 31 ± 1
humanoidmaze-large-navigate-singletask-task5-v00 ± 11 ± 12 ± 20 ± 00 ± 00 ± 00 ± 01 ± 10 ± 01 ± 31 ± 0
OGBench AntSoccer
antsoccer-arena-navigate-singletask-task1-v02 ± 114 ± 50 ± 044 ± 122 ± 11 ± 322 ± 217 ± 361 ± 2577 ± 479 ± 4
antsoccer-arena-navigate-singletask-task2-v02 ± 217 ± 70 ± 115 ± 123 ± 10 ± 08 ± 18 ± 275 ± 388 ± 391 ± 2
antsoccer-arena-navigate-singletask-task3-v00 ± 06 ± 40 ± 00 ± 00 ± 08 ± 1911 ± 516 ± 314 ± 2261 ± 660 ± 3
antsoccer-arena-navigate-singletask-task4-v0 (*)1 ± 03 ± 20 ± 00 ± 10 ± 00 ± 012 ± 324 ± 416 ± 939 ± 648 ± 5
antsoccer-arena-navigate-singletask-task5-v00 ± 02 ± 20 ± 00 ± 00 ± 00 ± 09 ± 215 ± 40 ± 136 ± 948 ± 9
OGBench Cube Single
cube-single-play-singletask-task1-v010 ± 588 ± 389 ± 595 ± 289 ± 777 ± 2881 ± 973 ± 3379 ± 497 ± 294 ± 3
cube-single-play-singletask-task2-v0 (*)3 ± 185 ± 892 ± 496 ± 282 ± 1680 ± 3081 ± 983 ± 1373 ± 397 ± 293 ± 2
cube-single-play-singletask-task3-v09 ± 391 ± 593 ± 399 ± 196 ± 298 ± 187 ± 482 ± 1288 ± 498 ± 295 ± 2
cube-single-play-singletask-task4-v02 ± 173 ± 692 ± 393 ± 470 ± 1891 ± 279 ± 679 ± 2079 ± 694 ± 392 ± 3
cube-single-play-singletask-task5-v03 ± 378 ± 987 ± 890 ± 661 ± 1280 ± 2078 ± 1076 ± 3377 ± 793 ± 390 ± 3
OGBench Cube Double
cube-double-play-singletask-task1-v08 ± 327 ± 545 ± 639 ± 197 ± 621 ± 821 ± 747 ± 1135 ± 961 ± 949 ± 1
cube-double-play-singletask-task2-v0 (*)0 ± 01 ± 17 ± 316 ± 100 ± 02 ± 22 ± 122 ± 129 ± 536 ± 623 ± 5
cube-double-play-singletask-task3-v00 ± 00 ± 04 ± 117 ± 80 ± 13 ± 11 ± 14 ± 28 ± 522 ± 59 ± 3
cube-double-play-singletask-task4-v00 ± 00 ± 01 ± 10 ± 10 ± 00 ± 10 ± 00 ± 11 ± 15 ± 23 ± 1
cube-double-play-singletask-task5-v00 ± 04 ± 34 ± 21 ± 10 ± 03 ± 22 ± 12 ± 217 ± 619 ± 1043 ± 2
OGBench Scene
scene-play-singletask-task1-v019 ± 694 ± 395 ± 2100 ± 094 ± 4100 ± 187 ± 896 ± 898 ± 3100 ± 0100 ± 0
scene-play-singletask-task2-v0 (*)1 ± 112 ± 350 ± 1333 ± 142 ± 250 ± 4018 ± 846 ± 100 ± 076 ± 989 ± 3
scene-play-singletask-task3-v01 ± 132 ± 755 ± 1694 ± 44 ± 449 ± 1638 ± 978 ± 1454 ± 1998 ± 193 ± 3
scene-play-singletask-task4-v02 ± 20 ± 13 ± 34 ± 30 ± 00 ± 06 ± 14 ± 40 ± 05 ± 183 ± 10
scene-play-singletask-task5-v00 ± 00 ± 00 ± 00 ± 00 ± 00 ± 00 ± 00 ± 00 ± 00 ± 02 ± 2
OGBench Puzzle 3x3
puzzle-3x3-play-singletask-task1-v05 ± 233 ± 697 ± 452 ± 1289 ± 597 ± 225 ± 963 ± 1994 ± 390 ± 487 ± 9
puzzle-3x3-play-singletask-task2-v01 ± 14 ± 31 ± 10 ± 10 ± 10 ± 04 ± 22 ± 21 ± 216 ± 539 ± 2
puzzle-3x3-play-singletask-task3-v01 ± 13 ± 23 ± 10 ± 00 ± 00 ± 01 ± 01 ± 10 ± 010 ± 320 ± 3
puzzle-3x3-play-singletask-task4-v0 (*)1 ± 12 ± 12 ± 10 ± 00 ± 00 ± 01 ± 12 ± 20 ± 016 ± 510 ± 6
puzzle-3x3-play-singletask-task5-v01 ± 03 ± 25 ± 30 ± 00 ± 00 ± 01 ± 12 ± 20 ± 016 ± 319 ± 1
OGBench Puzzle 4x4
puzzle-4x4-play-singletask-task1-v01 ± 112 ± 226 ± 448 ± 524 ± 944 ± 101 ± 232 ± 949 ± 934 ± 872 ± 8
puzzle-4x4-play-singletask-task2-v00 ± 07 ± 412 ± 414 ± 50 ± 10 ± 00 ± 15 ± 34 ± 416 ± 54 ± 2
puzzle-4x4-play-singletask-task3-v00 ± 09 ± 315 ± 334 ± 521 ± 1029 ± 121 ± 120 ± 1050 ± 1418 ± 547 ± 10
puzzle-4x4-play-singletask-task4-v0 (*)0 ± 05 ± 210 ± 326 ± 67 ± 41 ± 10 ± 05 ± 121 ± 1111 ± 310 ± 3
puzzle-4x4-play-singletask-task5-v00 ± 04 ± 17 ± 324 ± 111 ± 10 ± 00 ± 14 ± 32 ± 27 ± 32 ± 1
D4RL AntMaze
antmaze-umaze-v2557798949766 ± 590 ± 694 ± 392 ± 696 ± 296 ± 2
antmaze-umaze-diverse-v2475484808266 ± 1155 ± 782 ± 962 ± 1289 ± 586 ± 9
antmaze-medium-play-v206690848149 ± 2452 ± 1277 ± 756 ± 1578 ± 781 ± 5
antmaze-medium-diverse-v21748485750 ± 144 ± 1577 ± 660 ± 2571 ± 1375 ± 8
antmaze-large-play-v20425264540 ± 010 ± 632 ± 2155 ± 984 ± 783 ± 6
antmaze-large-diverse-v20306468540 ± 016 ± 1020 ± 1764 ± 883 ± 484 ± 6
D4RL Adroit
pen-human-v1717810376 ± 1069 ± 764 ± 867 ± 577 ± 771 ± 1253 ± 651 ± 10
pen-cloned-v1528310364 ± 761 ± 756 ± 1062 ± 1067 ± 980 ± 1174 ± 1163 ± 9
pen-expert-v1110128152140 ± 6134 ± 4103 ± 9118 ± 6119 ± 7139 ± 5142 ± 6145 ± 6
door-human-v123-06 ± 23 ± 35 ± 22 ± 14 ± 27 ± 20 ± 00 ± 0
door-cloned-v1-0300 ± 00 ± 01 ± 00 ± 10 ± 02 ± 22 ± 10 ± 0
door-expert-v1105107106105 ± 1105 ± 098 ± 3103 ± 1104 ± 1104 ± 2104 ± 1105 ± 1
hammer-human-v13202 ± 11 ± 12 ± 02 ± 12 ± 13 ± 11 ± 11 ± 1
hammer-cloned-v11252 ± 12 ± 11 ± 11 ± 02 ± 12 ± 111 ± 91 ± 1
hammer-expert-v1127129134125 ± 4127 ± 092 ± 11118 ± 3119 ± 9117 ± 9125 ± 3127 ± 9
relocate-human-v10000 ± 00 ± 00 ± 00 ± 00 ± 00 ± 00 ± 00 ± 0
relocate-cloned-v1-002-0 ± 0-0 ± 0-0 ± 0-0 ± 01 ± 1-0 ± 0-0 ± 00 ± 0
relocate-expert-v1108106108107 ± 1106 ± 293 ± 6105 ± 3105 ± 2104 ± 3107 ± 1102 ± 5
D4RL Locomotion
halfcheetah-medium-v24247645160---55 ± 159 ± 159 ± 1
halfcheetah-medium-replay-v23645514651---44 ± 150 ± 153 ± 1
halfcheetah-medium-expert-v256961049692---79 ± 289 ± 196 ± 1
hopper-medium-v254591026596---37 ± 662 ± 675 ± 6
hopper-medium-replay-v230959592102---25 ± 136 ± 683 ± 6
hopper-medium-expert-v25299110109100---69 ± 271 ± 11110 ± 3
walker2d-medium-v26381868384---35 ± 269 ± 581 ± 1
walker2d-medium-replay-v22273848585---13 ± 139 ± 558 ± 7
walker2d-medium-expert-v299110112113114---94 ± 896 ± 4110 ± 1

Values are averaged over 8 seeds unless otherwise noted in the paper. Values at or above 95% of the best performance in each row are bolded.