Grafana Loki
Grafana Loki
by Grafana Labs

Version 0.4.0

KUBERNETESLOGGING

Description

Grafana Loki is a horizontally scalable, highly available, multi-tenant log aggregation system inspired by Prometheus. It is designed to be very cost effective and easy to operate. It does not index the contents of the logs, but rather a set of labels for each log stream.

Compared to other log aggregation systems, Loki:

  • Does not do full text indexing on logs. By storing compressed, unstructured logs and only indexing metadata, Loki is simpler to operate and cheaper to run.
  • Indexes and groups log streams using the same labels you’re already using with Prometheus, enabling you to seamlessly switch between metrics and logs using the same labels that you’re already using with Prometheus.
  • Is an especially good fit for storing Kubernetes Pod logs. Metadata such as Pod labels is automatically scraped and indexed.
  • Has native support in Grafana (needs Grafana v6.0). Loki is like Prometheus, but for logs: we prefer a multidimensional label-based approach to indexing, and want a single-binary, easy to operate system with no dependencies. Loki differs from Prometheus by focussing on logs instead of metrics, and delivering logs via push, instead of pull.

Software Included

Getting started after deploying Grafana Loki

After you deploy the stack you will have the following deployed to your cluster in the loki namespace:

  1. Loki: The log-aggregation system and the queriers.
  2. Promtail: The agent that is used to collect the logs.
  3. Grafana: The UI using which you can now query your logs.

Check that the Loki pods are running as expected:

kubectl --namespace loki get pods
NAME                            READY   STATUS    RESTARTS   AGE
loki-0                          1/1     Running   0          47h
loki-grafana-5dc6466b8d-2xkwf   1/1     Running   0          47h
loki-promtail-8ggnr             1/1     Running   0          47h
loki-promtail-fhxjw             1/1     Running   0          47h
loki-promtail-hpq7j             1/1     Running   0          47h

Then grab the admin password for grafana:

kubectl get secret --namespace loki loki-grafana -o jsonpath="{.data.admin-password}" | base64 --decode

Now port-forward to Grafana (using your own loki-grafana-xxxxxxxxx-xxxx pod name) and login using the username admin and password you got above. To access Grafana, port-forward:

kubectl --namespace loki port-forward loki-grafana-5dc6466b8d-2xkwf 3000

and visit http://localhost:3000/explore

In the explore UI, enter the query {app="loki"} or similar to get the logs. Happy querying!

API Creation

In addition to creating Grafana Loki via the control panel, you can also use the DigitalOcean API.

As an example, to create a 3 node DigitalOcean Kubernetes cluster made up of Basic Droplets in the SFO2 region, you can use the following curl command. You’ll need to either save your API access token to an environment variable or substitute it into the command below.


  curl -X POST -H "Content-Type: application/json" \
      -H "Authorization: Bearer '$TOKEN'" -d \
      '{"name": "choose-a-name","region": "sfo2","version": "1.17.5-do.0","node_pools": [{"size": "s-1vcpu-2gb","count": 3,"name": "choose-a-name"}]}' \
      "https://api.digitalocean.com/v2/kubernetes/clusters"
      

Support Details

Supported By:Grafana Labs
Support URL:https://github.com/grafana/loki/issues

More DigitalOcean Links

DigitalOcean Community

Developers supporting developers

Ask a Question

Ask anything related to system administration, programming, devops, open source, or the DigitalOcean platform.

List your 1-Click App in the DigitalOcean Marketplace

Partner with us to build traction for your open source project or software company