Centralised Logging In Kubernetes Using Fluentd Daemonset

How To Setup Fluentd Daemonset In Kubernetes

#Prerequisites

1. Kubernetes cluster
2. Elasticsearch with Kibana
3. Kubectl setup

#End Goal

1. Creating configmap in kubernetes
2. Creating fluentd daemonset in kubernetes
3. Visualising kubernetes logs in kibana

#Video Tutorial

#Create Fluentd Configmap

In Kubernetes, configmap is a kubernetes object used to store configuration for some application. For example we will be using configmap here to store fluent configuration in kubernetes and will use this configmap in daemonset.

#Create Fluentd Daemonset

We want fluentd pod/container to run on every node of k8s cluster so that all application can send logs to fluentd or may be fluentd can collect and parse other application-container logs and forward to Elasticsearch. Daemonset is used for this purpose.

#Creating Configmap and Daemonset

kubectl apply -f fluentd-configmap.yml

kubectl apply -f fluentd-es-ds.yml

#Visualising On Kibana