Minari Integration with CORL

[Howuhh]

There we will track out progress for Minari integration with CORL. Minari is a standard format for offline RL datasets, with popular reference datasets and related utilities, which we believe will replace D4RL in the future by combining most of the existing benchmarks under unified interface and storage. And we want to be prepared! Eventually this will become a CORLv2.

The plan is to add an experimental separate directory with algorithms using Minari and to retraing all algorithms on the D4RL datasets currently (and in the future) re-created in the Minari.

Adapted algorithms:

• BC
• TD3 + BC
• AWAC
• CQL
• IQL
• SAC-N
• EDAC
• DT

Retrained algorithms (only Adroit for now):

• BC
• TD3 + BC
• AWAC
• CQL
• IQL
• SAC-N
• EDAC
• DT