Merge main DI-engine#3

Open

karroyan wants to merge 314 commits into

karroyan:wandbfrom

This pull request is big! We're only showing the most recent 250 commits

Commits on Feb 12, 2023

feature(nyz): setup evogym docker (#580)
PaParaZz1
authored

Commits on Feb 13, 2023

Commits on Feb 14, 2023

style(nyz): extend treetensor lowest version(ci skip)
PaParaZz1
committed

Commits on Feb 15, 2023

Commits on Feb 16, 2023

fix(nyz): fix ppof collect_data and deploy cuda mismatch bug
PaParaZz1
committed

Commits on Feb 18, 2023

Commits on Feb 20, 2023

fix(nyz): fix deque buffer wrapper PER bug (#586)
PaParaZz1
committed

Commits on Feb 22, 2023

style(nyz): add d4rl docker (#591)
PaParaZz1
authored

Commits on Feb 24, 2023

fix(nyz): fix evaluator return_info tensor type bug (#592)
PaParaZz1
committed

Commits on Mar 1, 2023

Commits on Mar 2, 2023

Commits on Mar 5, 2023

Commits on Mar 6, 2023

Commits on Mar 7, 2023

Commits on Mar 9, 2023

feature(whl): add PC algorithm (#514)
kxzxvbk
authored

Commits on Mar 10, 2023

Commits on Mar 16, 2023

Commits on Mar 20, 2023

polish(gry): polish dqn config (#611)
ruoyuGao
authored

Commits on Mar 21, 2023

fix(nyz): fix logger assertion and unittest bug
PaParaZz1
committed

Commits on Mar 22, 2023

refactor(nyz): remove policy cfg sub fields requirements (#620)
PaParaZz1
authored

Commits on Mar 24, 2023

style(nyz): update contributing doc(ci skip)
PaParaZz1
committed

Commits on Mar 28, 2023

Commits on Mar 29, 2023

fix(nyz): fix zergling collector unittest bug
PaParaZz1
committed

Commits on Apr 1, 2023

feature(wgt): add torch-rpc fix dockerfile (#628)
SolenoidWGT
authored

Commits on Apr 2, 2023

test(nyz): disable some distributer unittests
PaParaZz1
committed

Commits on Apr 3, 2023

polish(gry): polish reward model and td error (#624)
ruoyuGao
authored

Commits on Apr 6, 2023

feature(whl): add gpt utils (#625)
kxzxvbk
authored

Commits on Apr 7, 2023

feature(lxy): add popart & value rescale & symlog to ppof (#605)
karroyan
authored

Commits on Apr 11, 2023

Commits on Apr 16, 2023

feature(wgt): add barrier middleware (#570)
SolenoidWGT
authored

Commits on Apr 18, 2023

fix(nyz): fix to_item compatibility bug (#646)
PaParaZz1
committed

Commits on Apr 19, 2023

feature(zjow): add PPO demo for complex env observation (#644)
zjowowen
authored

Commits on Apr 20, 2023

fix(nyz): fix trainer dtype transform compatibility bug
PaParaZz1
committed

Commits on Apr 25, 2023

Commits on Apr 26, 2023

fix(nyz): fix ensemble head unittest bug
PaParaZz1
committed

Commits on Apr 27, 2023

fix(zjow): fix incompatible gym version bug in Dockerfile.env (#653)
zjowowen
authored

Commits on Apr 28, 2023

fix(eltociear): typo in gyn any_trading env (#654)
eltociear
authored

Commits on May 6, 2023

fix(zjow): fix atari env id (#655)
zjowowen
authored

Commits on May 8, 2023

fix(lxy): add normal value norm baseline (#658)
karroyan
authored

Commits on May 9, 2023

fix(nyz): polish bipedalwalker configs and fix default stop_value config
PaParaZz1
committed

Commits on May 11, 2023

polish(pu): add LN and GN norm_type support in ResBlock (#660)
puyuan1996
authored

Commits on May 12, 2023

feature(nyz): add MAPPO/MASAC task example (#661)
PaParaZz1
authored

Commits on May 13, 2023

fix(zjow): update td3bc d4rl config (#659)
zjowowen
authored

Commits on May 16, 2023

Commits on May 22, 2023

fix(nyz): fix gym hybrid reward dtype bug (#664)
PaParaZz1
committed

Commits on May 25, 2023

Commits on May 29, 2023

fix(nyz): fix cql example entry wrong config bug
PaParaZz1
committed

Commits on May 30, 2023

feature(zc): add bcq algorithm (#640)
Super1ce
authored

Commits on May 31, 2023

Commits on Jun 3, 2023

Doc(zjow): Huggingface badge (#674)
zjowowen
authored

Commits on Jun 10, 2023

feature(cy): add tensor stream merging tools (#673)
Cloud-Pku
authored

Commits on Jun 21, 2023

feature(cxy): add cliffwalking env (#677)
Mossforest
authored

Commits on Jun 26, 2023

feature(nyz): fix py37 macos ci bug and update default pytorch to 1.12.1 (#678)
PaParaZz1
authored

Commits on Jun 30, 2023

feature(yzj): add scatter connection model (#680)
jayyoung0802
authored

Commits on Jul 13, 2023

polish(nyz): polish offpolicy RL multi-gpu DDP training (#679)
PaParaZz1
authored

Commits on Jul 18, 2023

fix(nyz): fix enable_save_figure env interface
PaParaZz1
committed

Commits on Jul 21, 2023

fix(nyz): fix redundant env info bug in evaluator
PaParaZz1
committed

Commits on Jul 31, 2023

doc(nyz): polish edac and mbsac doc tables(ci skip)
PaParaZz1
committed

Commits on Aug 1, 2023

doc(zjow): update README.md with openxlab badge (#695)
zjowowen
authored

Commits on Aug 11, 2023

feature(zjow): add middleware for ape-x structure pipeline (#696)
zjowowen
authored

Commits on Aug 15, 2023

Commits on Aug 16, 2023

Commits on Aug 18, 2023

fix(lixuelin): to_ndarray fails to assign dtype for scalars (#708)
lxl2gf
authored

Commits on Aug 19, 2023

refactor(lyd): refactor dt_policy in new pipeline and add img input support (#693)
AltmanD
authored

Commits on Aug 20, 2023

Commits on Aug 21, 2023

Commits on Aug 22, 2023

Commits on Aug 23, 2023

Commits on Aug 28, 2023

Commits on Aug 31, 2023

Commits on Sep 4, 2023

Commits on Sep 7, 2023

style(nyz): polish env manager/wrapper comments
PaParaZz1
committed

Commits on Sep 9, 2023

style(nyz): polish model common modules comments
PaParaZz1
committed

Commits on Sep 13, 2023

style(nyz): polish model template comments (#722)
PaParaZz1
authored

Commits on Sep 14, 2023

feature(zjow): add new pipeline agent sac/ddpg/a2c (#637)

authored

Commits on Sep 15, 2023

Commits on Sep 17, 2023

style(eltociear): fix typo in optimizer_helper.py (#726)
eltociear
authored

Commits on Sep 18, 2023

fix(zjow): fix typo for QAC class (#729)
zjowowen
authored

Commits on Sep 19, 2023

Commits on Sep 20, 2023

polish(cy): polish anytrading (#731)
Cloud-Pku
authored

Commits on Sep 21, 2023

feature(zjow): polish ppof agent code for opendilab huggingface (#730)
zjowowen
authored

Commits on Oct 7, 2023

doc(zjow): polish rl_utils doc (#724)
zjowowen
authored

Commits on Oct 9, 2023

Commits on Oct 17, 2023

doc(zjow): update README.md and Colab demo (#733)
zjowowen
authored

Commits on Oct 18, 2023

Commits on Oct 26, 2023

feature(zc): add plan diffuser (#700)
PaParaZz1
committed

Commits on Oct 30, 2023

style(nyz): update metaworld image (ci skip, metaworld docker)
PaParaZz1
committed

Commits on Nov 1, 2023

Commits on Nov 6, 2023

polish(zc): change PD config name (#749)
Super1ce
authored

Commits on Dec 5, 2023

v0.5.0
PaParaZz1
committed

Commits on Dec 11, 2023

Commits on Dec 14, 2023

polish(rjy): polish the comments of collate_fn/profiler_helper/metric (#755)
nighood
authored

Commits on Dec 15, 2023

fix(zjow): fix bug in cliffwalking env (#759)
zjowowen
authored

Commits on Dec 20, 2023

doc(whl): polish doc for loss, compression helper and bfs helper. (#747)
kxzxvbk
authored

Commits on Dec 21, 2023

Commits on Dec 22, 2023

fix(nyz): fix comm unittest bug
PaParaZz1
committed

Commits on Dec 27, 2023

Commits on Dec 28, 2023

Commits on Dec 29, 2023

fix(pu): fix hppo entropy_weight to avoid nan error in log_prob (#761)
puyuan1996
authored

Commits on Jan 8, 2024

polish(nyz): polish dt entry
PaParaZz1
committed

Commits on Jan 11, 2024

feature(rjy): add HAPPO algorithm (#717)
nighood
authored

Commits on Jan 15, 2024

fix(nyz): fix env typo bugs
PaParaZz1
committed

Commits on Jan 22, 2024

Commits on Jan 23, 2024

Commits on Jan 25, 2024

polish(pu): polish comments in a2c/bcq/fqf/ibc policy (#768)
puyuan1996
authored

Commits on Jan 29, 2024

polish(rjy): polish pg/iqn/edac policy doc (#764)
nighood
authored

Commits on Jan 31, 2024

Commits on Feb 1, 2024

feature(cy): add dreamerV3 + MiniGrid code (#725)
Cloud-Pku
authored

Commits on Feb 20, 2024

fix(eltociear): typo in config.py (#776)
eltociear
authored

Commits on Mar 7, 2024

feature(ooo): add deprecated function decorator (#778)
ooooo-create
authored

Commits on Mar 11, 2024

demo(nyz): add naive PWIL demo
PaParaZz1
committed

Commits on Mar 13, 2024

feature(xrk): add new env named Flozen Lake and DQN algorithm. (#781)
rongkunxue
authored

Commits on Apr 2, 2024

style(nyz): add discord link (ci skip)
PaParaZz1
committed

Commits on Apr 7, 2024

fix(zjow): fix complex obs demo for ppo pipeline (#786)
zjowowen
authored

Commits on Apr 8, 2024

feature(nyz): add GPU utils (#788)
PaParaZz1
authored

Commits on Apr 12, 2024

Commits on Apr 15, 2024

polish(nyz): polish rl_utils api docs
PaParaZz1
committed

Commits on Apr 16, 2024

config(nyz): fix masac smac config multi_agent=True bug (#791)
PaParaZz1
committed

Commits on Apr 23, 2024

env(rjy): add ising model env (#782)
nighood
authored

Commits on Apr 24, 2024

fix(nyz): fix marl nstep td compatibility bug
PaParaZz1
committed

Commits on May 6, 2024

Commits on May 7, 2024

fix(nyz): fix unittest and platformtest bug
PaParaZz1
committed

Commits on May 8, 2024

Commits on May 24, 2024

config(nyz): update/speed up pendulum ppo
PaParaZz1
committed

Commits on May 28, 2024

fix(nyz): fix gtrxl compatibility bug (#796)
PaParaZz1
committed

Commits on May 30, 2024

feature(wrh): add taxi env (#799)
ruiheng123
authored

Commits on Jun 13, 2024

polish(zym): optimize ppo continuous act (#801)
YinminZhang
authored

Commits on Jun 17, 2024

style(hus): add new badge (hellogithub) in readme (#805)
TuTuHuss
authored

Commits on Jun 20, 2024

Commits on Jun 22, 2024

Commits on Jun 26, 2024

style(nyz): relax flask requirement (#811)
PaParaZz1
authored

Commits on Jun 27, 2024

v0.5.2
PaParaZz1
committed

Commits on Jul 1, 2024

Commits on Jul 6, 2024

Commits on Jul 19, 2024

polish(nyz): remove unused config fields in mujoco PPO
PaParaZz1
committed

Commits on Jul 29, 2024

style(nyz): polish citation authors(ci skip)
PaParaZz1
committed

Commits on Aug 14, 2024

feature(nyz): add encoder in MAVAC (#823)
PaParaZz1
committed

Commits on Sep 18, 2024

polish(TairanMK): update trading env (#831)
TairanMK
authored

Commits on Sep 20, 2024

polish(mark): add hybrid action space support to ActionNoiseWrapper (#829)
MarkHolmstrom
authored

Commits on Sep 26, 2024

feature(whl): add AWR algorithm (#828)
kxzxvbk
authored

Commits on Nov 5, 2024

feature(pu): add resume_training option to allow the envstep and train_iter resume seamlessly (#835)
puyuan1996
authored

Commits on Nov 25, 2024

feature(pu): add pistonball_env, its unittest and qmix config (#833)
puyuan1996
authored

Commits on Nov 27, 2024

fix(nyz): downgrade pyecharts log level to warning and polish installation doc (#838)
PaParaZz1
committed

Commits on Dec 2, 2024

fix(nyz): fix priority buffer delete bug (#844)
PaParaZz1
committed

Commits on Dec 3, 2024

fix(nyz): fix middleware collector env reset bug (#845)
PaParaZz1
committed

Commits on Dec 5, 2024

fix(nyz): fix multiple model wrappers reset bug (#846)
PaParaZz1
committed

Commits on Dec 7, 2024

Commits on Dec 8, 2024

Commits on Dec 9, 2024

fix(nyz): fix many unittest bugs
PaParaZz1
committed

Commits on Dec 12, 2024

fix(nyz): fix mock and config bugs
PaParaZz1
committed

Commits on Dec 13, 2024

Commits on Dec 19, 2024

feature(pu): add ddp config of dqn and onppo (#842)
puyuan1996
authored

Commits on Dec 23, 2024

v0.5.3
PaParaZz1
committed

Commits on Jan 13, 2025

fix(nyz): fix env check bugs (#852)
PaParaZz1
committed

Commits on Jan 23, 2025

fix(nyz): fix env check multi-discrete bug (#852)
PaParaZz1
committed

Commits on Jan 24, 2025

test(nyz): upgrade python version and setup-python version
PaParaZz1
committed

Commits on Jan 27, 2025

Commits on Feb 6, 2025

feature(nyz): add rlhf dataset (#854)
PaParaZz1
authored

Commits on Mar 1, 2025

Commits on Mar 10, 2025

style(nyz): update atari link (ci skip)
PaParaZz1
committed

Commits on Mar 13, 2025

Commits on Mar 15, 2025

style(nyz): add rust installation in docker
PaParaZz1
committed

Commits on Mar 17, 2025

demo(nyz): add ppo lunarlander continuous example
PaParaZz1
committed

Commits on Jun 3, 2025

fix(pu): fix noise layer's usage based on the original paper (#866)
puyuan1996
authored

Commits on Jun 6, 2025

style(nyz): fix flake8 style(ci skip)
PaParaZz1
committed

Commits on Jul 29, 2025

feature(wyx): add three KL-divergence variants (#870)
xiaoyi1734
authored

Commits on Oct 22, 2025

doc(nyz): create SECURITY.md
PaParaZz1
authored

Commits on Dec 6, 2025

Commits on Dec 7, 2025

doc(nyz): disable doc docker
PaParaZz1
committed