Join Our Discord (750+ Members)

36 Reinforcement Learning Frameworks and Environments

Explore open source reinforcement learning frameworks and environments, enabling the development of intelligent agents

Open Source RL Frameworks

  • Acme

    Acme is a library of reinforcement learning (RL) building blocks that strives to expose simple, efficient, and readable agents.

    License: Apache License 2.0

  • AI-Optimizer

    AI-Optimizer is a next-generation deep reinforcement learning suit, providing rich algorithm libraries ranging from model-free to model-based RL algorithms, from single-agent to multi-agent algorithms. Moreover, AI-Optimizer contains a flexible and easy-to-use distributed training framework for efficient policy training.

    License: No License

  • ALF

    ALF is a reinforcement learning framework emphasizing on the flexibility and easiness of implementing complex algorithms involving many different components.

    License: Apache License 2.0

  • AlpacaFarm

    AlpacaFarm is a simulation framework for methods that learn from human feedback.

    License: Apache License 2.0

  • CityLearn

    CityLearn is an open source OpenAI Gym environment for the implementation of Multi-Agent Reinforcement Learning (RL) for building energy coordination and demand response in cities.

    License: MIT License

  • CleanRL

    CleanRL is a Deep Reinforcement Learning library that provides high-quality single-file implementation with research-friendly features. The implementation is clean and simple, yet we can scale it to run thousands of experiments using AWS Batch.

    License: Other

  • CompilerGym

    CompilerGym is a library of easy to use and performant reinforcement learning environments for compiler tasks.

    License: MIT License

  • d3rlpy

    d3rlpy is an offline deep reinforcement learning library for practitioners and researchers.

    License: MIT License

  • DIAMBRA

    DIAMBRA Arena is a software package featuring a collection of high-quality environments for Reinforcement Learning research and experimentation.

    License: Other

  • Dopamine

    Dopamine is a research framework for fast prototyping of reinforcement learning algorithms. It aims to fill the need for a small, easily grokked codebase in which users can freely experiment with wild ideas (speculative research).

    License: Apache License 2.0

  • EvoTorch

    EvoTorch is an open source evolutionary computation library developed at NNAISENSE, built on top of PyTorch.

    License: Apache License 2.0

  • FinRL

    FinRL is the first open-source framework to demonstrate the great potential of financial reinforcement learning.

    License: MIT License

  • garage

    garage is a toolkit for developing and evaluating reinforcement learning algorithms, and an accompanying library of state-of-the-art implementations built using that toolkit.

    License: MIT License

  • Gymnasium

    Gymnasium is an open source Python library for developing and comparing reinforcement learning algorithms by providing a standard API to communicate between learning algorithms and environments, as well as a standard set of environments compliant with that API.

    License: MIT License

  • Gymnasium-Robotics

    Gymnasium-Robotics contains a collection of Reinforcement Learning robotic environments that use the Gymansium API. The environments run with the MuJoCo physics engine and the maintained mujoco python bindings.

    License: MIT License

  • Jumanji

    Jumanji is a suite of Reinforcement Learning (RL) environments written in JAX providing clean, hardware-accelerated environments for industry-driven research.

    License: Apache License 2.0

  • MALib

    MALib is a parallel framework of population-based learning nested with reinforcement learning methods. MALib provides higher-level abstractions of MARL training paradigms, which enables efficient code reuse and flexible deployments on different distributed computing paradigms.

    License: MIT License

  • MARLlib

    MARLlib is a comprehensive Multi-Agent Reinforcement Learning algorithm library based on RLlib. It provides MARL research community with a unified platform for building, training, and evaluating MARL algorithms.

    License: MIT License

  • Mava

    Mava is a framework for distributed multi-agent reinforcement learning in JAX.

    License: Apache License 2.0

  • Melting Pot

    Melting Pot is a suite of test scenarios for multi-agent reinforcement learning.

    License: Apache License 2.0

  • MetaDrive

    MetaDrive is a driving simulator that composes diverse driving scenarios for generalizable RL.

    License: Apache License 2.0

  • Minigrid

    The Minigrid library contains a collection of discrete grid-world environments to conduct research on Reinforcement Learning. The environments follow the Gymnasium standard API and they are designed to be lightweight, fast, and easily customizable.

    License: Other

  • MiniHack

    MiniHack is a sandbox framework for easily designing rich and diverse environments for Reinforcement Learning

    License: Apache License 2.0

  • MiniWorld

    MiniWorld is a minimalistic 3D interior environment simulator for reinforcement learning & robotics research.

    License: Apache License 2.0

  • ML-Agents

    ML-Agents is an open-source project that enables games and simulations to serve as environments for training intelligent agents.

    License: Other

  • MushroomRL

    MushroomRL is a Python Reinforcement Learning (RL) library whose modularity allows to easily use well-known Python libraries for tensor computation (e.g. PyTorch, Tensorflow) and RL benchmarks (e.g. OpenAI Gym, PyBullet, Deepmind Control Suite).

    License: MIT License

  • PARL

    PARL is a flexible and high-efficient reinforcement learning framework.

    License: Apache License 2.0

  • PettingZoo

    PettingZoo is a Python library for conducting research in multi-agent reinforcement learning, akin to a multi-agent version of Gymnasium.

    License: Other

  • RLlib

    RLlib is an open-source library for reinforcement learning (RL), offering support for production-level, highly distributed RL workloads, while maintaining unified and simple APIs for a large variety of industry applications.

    License: Unknown

    GitHub
    Website: Unknown
  • RLMeta

    RLMeta is a flexible lightweight research framework for Distributed Reinforcement Learning based on PyTorch and moolib

    License: MIT License

  • Safety-Gymnasium

    Safety-Gymnasium is a highly scalable and customizable safe reinforcement learning environment library.

    License: Apache License 2.0

  • skrl

    skrl is an open-source modular library for Reinforcement Learning written in Python (using PyTorch) and designed with a focus on readability, simplicity, and transparency of algorithm implementation.

    License: MIT License

  • Stable Baselines

    A fork of OpenAI Baselines, implementations of reinforcement learning algorithms.

    License: MIT License

  • SuperSuit

    SuperSuit introduces a collection of small functions which can wrap reinforcement learning environments to do preprocessing (‘microwrappers’).

    License: Other

  • TF-Agents

    A reliable, scalable and easy to use TensorFlow library for contextual bandits and reinforcement learning.

    License: Apache License 2.0

  • TRL

    Train transformer language models with reinforcement learning.

    License: Apache License 2.0

Last Updated: Dec 26, 2023