There’s a short answer, and a long answer. The short answer, that will satisfy your needs in the vast majority of cases, is: /var/ / / /< >/< >- . lib docker containers container_id container_id json log From here you need to to a , and for your Docker containers. Let me elaborate on with the long answer below. ship logs central location enable log rotation why Where Are Docker Container Logs Stored by Default? You see, by default, Docker containers emit logs to the and output streams. , and the . stdout stderr Containers are stateless logs are stored on the Docker host in JSON files by default Why? The . What’s a logging driver? default logging driver is json-file A logging driver is a mechanism for getting info from your running containers. Here’s a more elaborate explanation from the . There are several different log drivers you can use except for the default json-file, like syslog, , fluentd, or . Docker docs journald logagent These logs are emitted from output streams, annotated with the log origin, either stdout or stderr, and a timestamp. Each log file contains information about only one container and is in JSON format. Remember, . one log file per container You find these JSON log files in the directory on a Linux Docker host. The here is the id of the running container. /var/lib/docker/containers/ <container_id> /var/ / / /< >/< >- . lib docker containers container_id container_id json lo If you’re not sure which id is related to which container, you can run the command to list all running containers. The container id is located in the first column. docker ps docker ps

[Output]
CONTAINERID  IMAGE     COMMAND       CREATED    STATUS    PORTS    NAMES
cf74b6fce535 foo_image X min ago  Up X min  3000/tcp foo_app "node app.js" Now you know where the container logs are stored, and you can continue to troubleshoot and debug any issues that come up. That’s where comes into play. You collect the logs with a log aggregator and store them in a place where they’ll be available forever. It’s dangerous to keep logs on the Docker host because they can build up over time and eat into your disk space. That’s why you should use a for your logs and for your Docker containers. logging central location enable log rotation Debugging Docker Issues with Container Logs Docker has a for working with logs. But, keep in mind, it will only work if you use the json-file log driver. I strongly recommend not changing the log driver! Let’s start debugging. dedicated API First of all, to list all running containers, use the command. docker ps docker ps Then, with the command you can list the logs for a particular container. docker logs docker logs <container_id> Most of the time you’ll end up tailing these logs in real time, or checking the last few logs lines. Using the or flag will (follow) the Docker container logs: --follow -f tail -f docker logs -f < > container_id The flag will show the last number of log lines you specify: --tail docker logs <container_id> --tail N The or flag will show the timestamps of the log lines: -t --timestamp docker logs -t < > container_id The flag will show extra details about the log lines: --details docker logs <container_id> --details But what if you only want to see specific logs? Luckily, works with Docker logs as well. grep docker logs <container_id> | grep pattern This command will only show errors: docker logs | <container_id> grep -i error Once an application starts growing, you tend to start using Docker Compose. Don’t worry, it has a logs command as well. docker-compose logs This will display the logs from all services in the application defined in the Docker Compose configuration file. Storing Docker Container Logs in a Central Location Using a Log Shipper With your infrastructure growing, you can rely on just using the Docker API to troubleshoot logs. You need to store all logs in a secure place, so you can analyze and troubleshoot any issues after-the-fact. You need a steady influx of logs so you can get actionable insight into what is happening to your Docker containers. Setting up log rotation is just step one. By storing logs in one place you can also set up alerts that notify you if anything breaks, or whenever you’re experiencing unexpected behavior. Container logs can be a mix of plain text messages from start scripts and structured logs from applications, which makes it difficult for you to tell which log event belongs to what container and application. Although Docker log drivers can ship logs to , most of them don’t allow you to parse container logs. You need a separate tool called a log shipper, such as , to structure and enrich the logs before shipping them. log management tools Logagent Logstash or rsyslog The solution is to have a container dedicated solely to logging and collecting logs. You deploy the dedicated logging container within your Docker environment. It will automatically from all containers, as well as monitor, and store or forward them to a central location. aggregate logs analyze, This makes it easier to move containers between hosts and easily scale your infrastructure. It also lets you collect logs through various streams, including log events, Docker API data, stats, etc. This is what I’d suggest you use. By far the most reliable and convenient way of log collection is to use the json-file driver and set up a log shipper to ship the logs. You always have a local copy of logs on your server and you get the . advantage of centralized log management If you were to use there are a to follow in order to start sending logs to Sematext. After , run these commands in a terminal. Sematext Logagent few simple steps creating a Logs App docker pull sematext/logagent

docker -d =always --name st-logagent \
  -e =YOUR_LOGS_TOKEN \
  -e = \
  -v /var/run/docker.sock:/var/run/docker.sock \
  sematext/logagent run --restart LOGS_TOKEN LOGS_RECEIVER_URL "https://logsene-receiver.sematext.com" This will start sending all container logs to Sematext. You can read more about how Logagent works and how to use it for monitoring logs in our post on . Docker Container Monitoring with Sematext Conclusion There we go, both a short and long answer to where Docker Container logs are stored. By default, Docker uses the json-file log driver that stores logs in dedicated directories on the host: /var/ / / /< >/< >- . lib docker containers container_id container_id json log The long answer, and what I’d suggest you do, is to set up a dedicated logging container that will structure and enrich your container logs, then send them to a central location. This makes troubleshooting and searching through logs much easier. But, you also get which is the main point. You want to know what breaks before your users do. alerting Hope you guys and girls enjoyed reading this as much as I enjoyed writing it. If you liked it, feel free to hit the share button so more people will see this tutorial. Until next time, be curious and have fun. Previously published at https://sematext.com/blog/docker-logs-location

Different

Keep

Mind

How To Find Your Docker Logs

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

A crash course on Serverless APIs with Express and MongoDB

105 Stories To Learn About K8s

10 Best Practices for Using Kubernetes Network Policies

1 Stories To Learn About Weekly Sponsor

3 Free Ways to Learn Kubernetes and Red Hat OpenShift

21 Resources and Tutorials to Learn Kubernetes

A crash course on Serverless APIs with Express and MongoDB

105 Stories To Learn About K8s

10 Best Practices for Using Kubernetes Network Policies

1 Stories To Learn About Weekly Sponsor

3 Free Ways to Learn Kubernetes and Red Hat OpenShift

21 Resources and Tutorials to Learn Kubernetes

Light-Mode

Classic

Newspaper

Minty

Dark-Mode

Neon Noir

Minty

HN StartUps