| license: apache-2.0 | |
| language: | |
| - en | |
| GPT-J (with value head weights) trained on HH with PPO following @reciprocate's `trlx` example https://github.com/CarperAI/trlx/blob/2f90ba0ecd640ae18cd62adb5e934a4b779f534b/examples/hh/ppo_hh.py | |
| Logs: https://wandb.ai/jon-tow/trlx/reports/hh-gpt-j--VmlldzozODE1NjAw | |