Awesome Cloud Native

A curated list of open-source cloud native tools, software, and tutorials.

Cloud Native is a behavior and design philosophy. At its essence, any behavior or approach that improves resource utilization and application delivery efficiency in the cloud is called Cloud Native.

Table of Contents

• AI & Machine Learning Platforms
• API Design & Documentation
• API Gateways & Proxies
• Build & Packaging Automation
• Cluster Provisioning & Lifecycle
• Configuration & Policy Automation
• Continuous Delivery & GitOps
• Cost & Governance
• Dashboards & Portals
• Data Processing & Analytics
• Data Protection & Backup
• Databases
• Developer Workspaces & Productivity
• Diagnostics & Troubleshooting
• Edge & IoT
• Kubernetes Operators
• Load Balancing & Ingress
• Logging
• Networking & Connectivity
• Networking Utilities
• Observability & Monitoring
• Reliability & Chaos Engineering
• RPC Frameworks
• Runtimes & Platforms
• Security & Compliance
• Serverless Platforms
• Service Discovery & Registry
• Service Mesh
• Storage & Data Management
• Streaming & Messaging
• Testing & Conformance
• Tracing & Profiling
• Tutorials & Learning
• Workload Orchestration & Scheduling

AI & Machine Learning Platforms

• allennlp - An open-source NLP research library, built on PyTorch.
• caffe2 - Caffe2 is a lightweight, modular, and scalable deep learning framework.
• elasticdl - Kubernetes-native Deep Learning Framework.
• h2o-3 - Open Source Fast Scalable Machine Learning API For Smarter Applications (Deep Learning, Gradient Boosting, Random Forest, Generalized Linear Modeling (Logistic Regression, Elastic Net), K-Means, PCA, Stacked Ensembles.)
• jina - Cloud-native neural search framework for 𝙖𝙣𝙮 kind of data.
• keras - Keras is a high-level neural networks API, written in Python and capable of running on top of TensorFlow, CNTK, or Theano.
• kserve - Standardized Serverless ML Inference Platform on Kubernetes.
• kubedl - Run your deep learning workloads on Kubernetes more easily and efficiently.
• kubeflow - Machine Learning Toolkit for Kubernetes.
• leaf - Open Machine Intelligence Framework for Hackers. (GPU/CPU).
• paddlepaddle - PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice（『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）.
• predictionio - PredictionIO, a machine learning server for developers and ML engineers.
• pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration.
• seldon-core - A framework to deploy, manage and scale your production machine learning to thousands of models.
• tensorflow - Computation using data flow graphs for scalable machine learning.

Data Processing & Analytics

• fast-data-dev - Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, Landoop Tools, 20+ connectors.
• pachyderm - Reproducible Data Science at Scale!
• spark - Apache Spark enhanced with native Kubernetes scheduler back-end.
• spark-on-kubernetes-helm - Spark on Kubernetes infrastructure Helm charts repo.
• sqlflow - Brings SQL and AI together.
• v6d - vineyard (v6d), an in-memory immutable data manager.
• wallaroo - Ultrafast and elastic data processing.

API Gateways & Proxies

• alb - ALB (Another Load Balancer) is a Kubernetes Gateway powered by OpenResty with years of production experience from Alauda.
• apisix - The Cloud-Native API Gateway.
• batch-processing-gateway - The gateway component to make Spark on K8s much easier for Spark users.
• bricksllm - Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
• easegress - A Cloud Native traffic orchestration system.
• emissary-gateway - Open source Kubernetes-native API gateway for microservices built on the Envoy Proxy.
• express-gateway - A microservices API Gateway built on top of ExpressJS.
• gateway - Manages Envoy Proxy as a standalone or Kubernetes-based application gateway.
• gloo - The Feature-rich, Kubernetes-native, Next-Generation API Gateway Built on Envoy.
• hango-gateway - Hango API Gateway, build on Envoy & Istio.
• haproxy-ingress - HaProxy Ingress.
• higress - Next-generation Cloud Native Gateway.
• kong - The Microservice API Gateway.
• litellm - Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq].
• lura - Ultra performant API Gateway with middlewares. A project hosted at The Linux Foundation.

Continuous Delivery & GitOps

• argo - Get stuff done with container-native workflows for Kubernetes.
• argo-cd - Declarative continuous deployment for Kubernetes.
• argo-rollouts - Progressive delivery controller for blue-green, canary, and experiments on Kubernetes.
• arkade - Kubernetes apps for developers.
• armada - A python orchestrator for a installing, upgrading, and managing a collection of helm charts, dependencies, and values overrides.
• autoapply - Automatically apply changes from a git repository to Kubernetes.
• ballerina-lang - Ballerina is a new programming language for integration built on a sequence diagram metaphor.
• beetle - Kubernetes multi-cluster deployment automation service.
• binderhub - Run your code in the cloud, with technology so advanced, it feels like magic!
• build - A Kubernetes-native Build resource.
• capact - A framework to manage applications and infrastructure in a unified way.
• carvel - Carvel provides a set of reliable, single-purpose, composable tools that aid in your application building, configuration, and deployment to Kubernetes. This repo contains information regarding the Carvel open-source community.
• cdk8s - Define Kubernetes native apps and abstractions using object-oriented programming.
• cds - Enterprise-Grade Continuous Delivery & DevOps Automation Open Source Platform.
• charitify - Generate Helm Charts from Kubernetes objects.