Difficulty: Beginner
Estimated Time: 20 minutes

Note: In this staging of the Katacoda scenario, startup will take 3 minutes or so. When we go live this should drop to no more than 20 seconds

Now we have an informational monitor configured for our environment. In the next section we will set up a notification monitor.

Creating an Informational Alert

Create a metric monitor

  1. From the first terminal, launch the light script.
  2. Login to your Datadog account and navigate to the New Monitor page.
  3. Choose Metric to create a new Metric monitor.
  4. Choose Change Alert under Choose the detection method.
  5. The metric we want to watch is apache.net.hits.
  6. Set a Multi Alert by server by selecting avg by and then select host in the (everything) textbox.
    Do you think its more valuable to have a monitor for each web server, or for the combination of all of them?
  7. Set the Set alert conditions group of choices to: The average of the change over 5 minutes compared to 1 minute before is above the threshold for any host.
    This section lets you configure when you want this monitor to fire.
  8. Then set the alert threshold to 500 and the warning threshold to 250.
    This says if the average over 5 minutes is 500 more than the average over 5 minutes a minute ago, then fire the monitor.
  9. In the "Say what's happening" section of the screen, populate these fields as shown:

    Example Monitor Name: Lots of Apache Hits Happening
    Example Monitor Message: Host {{host.name}} with IP {{host.ip}} is under heavy load.

    Note: For more examples of what you can put in the ExampleMonitor Message dialog, click the Use message template variables link to learn about conditional statements, variables, and more.

  10. Since this is just going to be informational and not a notification, leave the Notify your team section blank.
  11. Scroll to the bottom of the page and click Save.
  12. From the first terminal tab, run the heavy script.
  13. Navigate to the Manage Monitors page to see the status for the alert change.
  14. Navigate to the Triggered Monitors page to see a triggered monitor for each of the three webservers.
  15. Click on the name of one of the triggered monitors.
    This page shows you the current status of the monitor and it's history.

When you are finished, run grademe in the terminal. If you have earned the full score, click the Continue button to end the scenario.