Open Source Model Training Orchestration
Accelerate abstracts exactly and only the boilerplate code related to multi-GPU/TPU/mixed-precision and leaves the rest of your code unchanged.
License: Apache License 2.0
Aqueduct enables you to easily define, run, and manage AI & ML tasks on any cloud infrastructure.
License: Apache License 2.0
Continuous Machine Learning (CML) is an open-source library for implementing continuous integration & delivery (CI/CD) in machine learning projects.
License: Apache License 2.0
Deep learning training platform with integrated support for distributed training, hyperparameter tuning, and model management (supports Tensorflow and Pytorch).
License: Apache License 2.0
Machine learning development environment for data science and AI/ML engineering teams.
License: Apache License 2.0
Hopsworks is a data-intensive platform for the design and operation of machine learning pipelines that includes a Feature Store - (Video) .
License: GNU Affero General Public License v3.0
Standardisation of pipeline and model serialization for Spark, Tensorflow and sklearn.
License: Apache License 2.0
nos
is an open-source platform to efficiently run AI workloads on Kubernetes, increasing GPU utilization and reducing infrastructure and operational costs.License: Apache License 2.0
TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.
License: Apache License 2.0
Production scale vision AI platform, with fully integrated components for model building, automated labeling, data processing and model training pipelines.
License: Apache License 2.0
Platform that provides complete AI model training and resource management capabilities.
License: MIT License
Skaffold is a command line tool that facilitates continuous development for Kubernetes applications. You can iterate on your application source code locally then deploy to local or remote Kubernetes clusters.
License: Apache License 2.0
Run LLMs, AI, and batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution – all with a simple interface.
License: Apache License 2.0
A Data Streaming Library for Efficient Neural Network Training.
License: Apache License 2.0
Production oriented configuration framework for ML based on TensorFlow, incl. monitoring and model version management.
License: Apache License 2.0
TonY is a framework to natively run deep learning jobs on Apache Hadoop. It currently supports TensorFlow, PyTorch, MXNet and Horovod.
License: Other
ZenML is an extensible, open-source MLOps framework to create reproducible ML pipelines with a focus on automated metadata tracking, caching, and many integrations to other tools.
License: Apache License 2.0
Last Updated: Dec 26, 2023