Difficulty: Beginner
Estimated Time: 2 hours 30 mins

Part 1 - Beyond log collection, implementing log management best practices


Your logs are key to enhancing APM traces, providing metrics, detecting potential security threats, and maintaining regulatory compliance. Getting the full value from your logs requires more than just collecting and analyzing log lines.

This activity is split in two main parts:

  • Part one: We will focus on a Apache logs and use them as example to leverage log parsing, logging without limits, log monitors, and log analytics.
  • Part two: We will use a real application fully instrumented to demonstrate how logs can bring context to your metrics and traces.

When you are ready to continue, click Start Scenario.

That feeling when you've finished the workshop \(^O^)/

[Outdated] Beyond Collection: Building Observability with Logs

Step 1 of 13

Running the Agent

Install the Agent to collect logs

In order to collect logs from your environment, the first thing you need to do is to run the Datadog Agent.

Connect to your Datadog application. You should see a new account available just for the workshop if you already have an account associated to your email.

To start log collection, enable the log management product by entering the log menu:

log enable

After clicking Getting Started reach out to the Docker Agent instructions to install it with log collection enabled:

log getting started

Check that the Agent is running with docker ps

Log generation

Once the Agent is running, generate some fake Apache logs with:

docker run -d -it --rm mingrammer/flog -f apache_combined -l -n 100000 -d 0.2

Note: This uses the mingrammer/flog in order to generate fake log in the apache_combined format.