A comprehensive reference for all topics related to building and maintaining microservices

This pandect (πανδέκτης is Ancient Greek for encyclopedia) was created to help you find and understand almost anything related to Microservices that is available online.

Other Pandects from the series:

• The NLP Pandect

General Resources

• Microservices (Martin Fawler & James Lewis) [Blog, March 2014]
• What are Microservices? - Chris Richardson, Author of "Microservices Patterns"
• The Architecture Behind A One-Person Tech Startup [Blog, April 2021]

Platforms

• AWS - Amazon Web Services on-demand cloud computing platform
• Azure - cloud computing service created by Microsoft
• Google Cloud Platform - GCP - suite of cloud computing services from Google
• OpenStack - free, open standard cloud computing platform
• Digital Ocean - DigitalOcean provides developers with cloud services
• Linode - cloud hosting company that provides virtual private servers

Stories from the Industry

• Kubernetes Failure Stories
• How they AWS - curated collection of resources on how organizations use AWS [GitHub, 419 stars]
• This is My Architecture - Innovative cloud architectures from AWS partners and customers [Video Series, AWS]

Compilations & Resource Collections

• Cloud Native Computing Foundation - CNCF - list of graduated and incubating projects
• Everything AWS - GitHub search and catalogue of AWS-related repositories

Roadmaps

• Containers Roadmap - public roadmap for AWS container services [GitHub, 3714 stars]

• Cloudcast - independent Cloud Computing podcast [Years: 2011 - now, Status: active]
• PodCTL - podcast focused on Cloud-native applications (by Red Hat) [Years: 2017 - now, Status: active]
• Kubernetes Podcast - Kubernetes Podcast from Google [Years: 2018 - now, Status: active]
• Data Engineering Podcast - Data management, microservices, ETL and more [Years: 2017 - now, Status: active]
• The Secure Developer - A podcast about security for developers [Years: 2017 - now, Status: active]
• APIs you won't hate - podcast about building and designing APIs [Years: 2019 - now, Status: active]

• Continuous Delivery - Continuous Delivery Pipelines and Processes [Youtube, 57k Subscribers]
• CNCF - Cloud Native Computing Foundation - provides educational and informative content on cloud native computing [Youtube, 65k Subscribers]
• Snyk - build cloud native applications securely [Youtube, 2k Subscribers]
• CloudBeesTV - cloud conferences from the end-to-end automated software delivery company [Youtube, 9k Subscribers]
• Containers from the Couch - learning resources on Container Services [Youtube, 4k Subscribers]
• GOTO Conferences - GOTO is a software development content and events platform [Youtube, 230k Subscribers]

General Monitoring

• Prometheus - open-source systems monitoring and alerting toolkit
• Prometheus Federation
• kubewatch - Watch k8s events and trigger Handlers [GitHub, 1996 stars]
• cortex - multi-tenant, long term Prometheus [GitHub, 4033 stars]

Error Monitoring

• Sentry

Alerting

• Prometheus AlertManager
• StreamAlert - serverless, real-time data analysis framework for alerting [GitHub, 2538 stars]

Logging

• loki - horizontally-scalable, highly-available, multi-tenant log aggregation system [GitHub, 13077 stars]

Visualizing

• grafana - observability and data visualization platform [GitHub, 42460 stars]

General Deployment Tools

• kubespray - Deploy a Production Ready Kubernetes Cluster [GitHub, 10705 stars]

Zero Downtime Deploys

Tools:

• flagger - Canary, A/B Testing and Blue/Green deployments for Kubernetes [GitHub, 2950 stars]

CI/CD

General

• Tekton - open-source framework for creating CI/CD systems

GitOps:

• flux - The GitOps Kubernetes operator [GitHub, 6405 stars]
• ArgoCD - A declarative, GitOps continuous delivery tool for Kubernetes

General

• The Cost of Cloud, a Trillion Dollar Paradox [Blog, May 2021]

AWS

• Spot Fleet [AWS Services]
• AutoSpotting - open source spot market automation tool for EC2 [GitHub, 1946 stars]

Autoscaling

• keda - Kubernetes-based Event Driven Autoscaling [GitHub, 3284 stars]

General Tools

• Komiser - Multi-cloud environment inspector for costs and security [GitHub, 2599 stars]
• Infracost - Cloud cost estimates for Terraform in your CLI and pull requests [GitHub, 3135 stars]

Databases and Operators

General

• OperatorHub.io - OperatorHub.io is a resource for the Kubernetes community to find and share Operators

In-memory

• redis - Redis is an open source, in-memory data structure store

MySQL

• MariaDB - MariaDB Server: The open source relational database
• vitess - Canary, A/B Testing and Blue/Green deployments for Kubernetes [GitHub, 2950 stars]

PostgreSQL

• CrunchyData Operator [GitHub, 1737 stars]
• Zalando Operator [GitHub, 1818 stars]
• Amazon Aurora [AWS, Paid Service]

OLAP - Online Analytical Processing

• What is OLAP? Cube, Operations & Types in Data Warehouse [Blog, Feb 2018]
• Comparison of ClickHouse, Druid, and Pinot [Blog]
• Druid [GitHub, 10889 stars]
• ClickHouse
• Apache Pinot / Pinot on Github [GitHub, 3093 stars]

Object Storage

• Ceph - implements object storage on a single distributed computer cluster

General

• AWS Lambda
• Azure Functions Serverless Compute
• Google CloudFunctions

Examples and Learning Resources

• serverless examples - collection of boilerplates and examples of serverless architectures [GitHub, 9009 stars]
• Wild Rydes Serverless Workshops - labs to set up serverless applications on AWS [GitHub, 3312 stars]

Tools & Frameworks

• serverless - Serverless Framework using AWS Lambda, Azure Functions, Google CloudFunctions [GitHub, 39898 stars]
• Chalice - Python Serverless Microframework for AWS [GitHub, 7972 stars]
• OpenFaaS - Serverless Functions Made Simple [GitHub, 19866 stars]
• Up - deploy infinitely scalable serverless apps, apis, and sites [GitHub, 8230 stars]
• Dapr - portable, serverless, event-driven runtime for stateless and stateful microservices [GitHub, 13585 stars]
• Nuclio - High-Performance Serverless event and data processing platform [GitHub, 3938 stars]

General Tools

• kubesploit - Cross-platform post-exploitation HTTP/2 Command & Control server [GitHub, 475 stars]
• consul - Consul automates networking for simple and secure application delivery
• Komiser - Multi-cloud environment inspector for costs and security [GitHub, 2599 stars]
• tfsec - Security scanner for your Terraform code [GitHub, 2797 stars]

Security Audit Tools

• kube-bench - Checks usage of security best practices as defined in the CIS Kubernetes Benchmark [GitHub, 3755 stars]
• Prowler - security tool to perform AWS security best practices assessments [GitHub, 3478 stars]
• ScoutSuite - Multi-Cloud Security Auditing Tool [GitHub, 3478 stars]

Secrets

• sealed-secrets - A Kubernetes controller and tool for one-way encrypted Secrets [GitHub, 3490 stars]
• Vault - Manage Secrets and Protect Sensitive Data
• aws-vault - securely store and access AWS credentials in development environments [GitHub, 4960 stars]
• SOPS: Secrets OPerationS - Simple and flexible tool for managing secrets on any platform [GitHub, 7611 stars]

Protocols

• Kerberos
• OpenLDAP

Auth, API Gateways etc.

• Grant - OAuth Proxy [GitHub, 3339 stars]
• Dex - OpenID Connect (OIDC) identity and OAuth 2.0 provider [GitHub, 5806 stars]
• Kong - Cloud-Native API Gateway [GitHub, 29353 stars]
• Gloo Edge - Kubernetes-native API Gateway Built on Envoy [GitHub, 2945 stars]

Other

• Awesome WAF - Everything about web-application firewalls (WAF) [GitHub, 3598 stars]
• PENTESTING-BIBLE - Learn ethical hacking [GitHub, 8200 stars]

Kubernetes

• Kubernetes Workshop - Gentle introduction to Kubernetes with more than just the basics
• Kubernetes Guide - Kubernetes clusters for the hobbyist [GitHub, 5021 stars]
• Learn Kubernetes Basics
• Introduction to Kubernetes

AWS

• Understanding Amazon EC2 Terminology [Blog, Oct 2018]

Kafka

• Learn Apache Kafka by Confluent

DevOps

• DevOps Guide - from basic to advanced with Interview Questions and Notes [GitHub, 3680 stars]
• DevOps Exercises - questions and exercises on technical topics related to DevOps and SRE [GitHub, 8531 stars]

Docker

• Docker Curriculum - comprehensive tutorial on getting started with Docker [GitHub, 4244 stars]

Infrastructure as Code Tools

• Terraform - open-source infrastructure as code software tool for consistent CLI workflow
• CloudFormation - cloud provisioning with infrastructure as code for AWS
• Azure Resource Manager - manage your app resources on Azure
• Cloud Deployment Manager - create and manage cloud resources on GCP with simple templates
• HashiCorp Vagrant / [GitHub, 22046 stars]
• CFEngine - automate your infrastructure, security & compliance
• Ansible - automation across open hybrid cloud deployments
• CHEF - Policy-Based Configuration Management Automation Architecture
• Pulumi - Modern Infrastructure as Code. Any cloud, any language [GitHub, 8896 stars]

Additional Tooling

• Terraformer - CLI tool to generate terraform files from existing infrastructure (reverse Terraform) [GitHub, 4962 stars]
• Checkov - static code analysis tool for infrastructure-as-code [GitHub, 2775 stars]

Examples and Learning Resources

• Ansible for DevOps examples [GitHub, 4629 stars]
• Ansible for Kubernetes Examples [GitHub, 440 stars]

Streaming Frameworks / Engines

• Apache Flink - stream processing framework [GitHub, 16407 stars]
• Apache Beam - unified programming model for Batch and Streaming [GitHub, 4842 stars]
• Apache Storm / Apache Storm on GitHub - distributed realtime computation system [GitHub, 6238 stars]
• Amazon Kinesis Streams [AWS]

Effective Containerization

• distroless - Language focused docker images, minus the operating system [GitHub, 9770 stars]

Testing

• Terratest - Go library to write automated tests for your infrastructure code [GitHub, 5289 stars]
• Serverless Offline - Emulate AWS λ and API Gateway locally [GitHub, 4131 stars]
• Moto - easily mock out tests based on AWS infrastructure [GitHub, 4682 stars]
• LocalStack - fully functional local AWS cloud stack [GitHub, 4682 stars]

PaaS - Platform-as-a-service

• Empire - PaaS built on top of Amazon EC2 Container Service with Heroku like workflow [GitHub, 2644 stars]

Container Network Interface (CNI)

• CNI - networking for Linux containers [GitHub, 3524 stars]

Kafka

• strimzi - Apache Kafka running on Kubernetes [GitHub, 2434 stars]

License CC0

Attributions

Resources

• All linked resources belong to original authors

Icons

• skill book by HideMaru from the Noun Project
• Harp by Marina Pugacheva from the Noun Project
• Ancient Greek Theater by Leonidas Oikonomou from the Noun Project
• deity by Eucalyp from the Noun Project
• trojan by Eucalyp from the Noun Project
• Fire Torch by Eucalyp from the Noun Project
• acropolis by Eucalyp from the Noun Project
• papyrus by IconMark from the Noun Project
• Hammer by IconMark from the Noun Project
• balance by Flatart from the Noun Project
• Atlas by parkjisun from the Noun Project
• olympus by IconMark from the Noun Project

Fonts

• Dalek Font