Integrating with PagerDuty

Our PagerDuty integration makes it easy to link incidents in PagerDuty to incidents in FireHydrant. This lets you coordinate incident response directly within FireHydrant after an initial alert comes in from PagerDuty.

Configuration steps

First, you need a PagerDuty API key.

  1. Go to your PagerDuty dashboard and navigate to the page where you can set up API keys. (This will be something like Integrations > API Access Keys ). Screen_Shot_2021-08-23_at_10.52.32_AM.png
  2. On the API Access page, click Create New API Key and provide a description for the API key.
  3. Click Create Key.
  4. Copy the API Key that PagerDuty generates. Then go to FireHydrant's integrations page.
  5. Click the PagerDuty integration card, then click Setup PagerDuty.
  6. Enter the PagerDuty API key that was just generated and click Save.

Make sure you confirm that the Domain matches your PagerDuty Domain. For instance, if you are using an EU instance of PagerDuty, update the domain to https://api.eu.pagerduty.com. 

Using Alert Routes with PagerDuty

Once your PagerDuty instance is configured, you can setup Alert Routes to take action on your alerts based on the data included in the alert. You can automatically open new incidents, send alerts to any Slack channel, log an alert in FireHydrant, or simply ignore it. To learn more, read about Alert Routes.

Linking PagerDuty Services to FireHydrant Services

Once your PagerDuty instance is configured, you have the capability to link and/or import PagerDuty services into FireHydrant's services. This enables multiple capabilities, including:

  1. From Slack, directly paging out to teams that own services via PagerDuty
  2. Automatically creating PagerDuty incidents for a particular service from FireHydrant (because PagerDuty requires all incidents/alerts to have a service attached or specified).

Process Steps

  1. Head over to Service Catalog > Services and click the Add services  dropdown and  Import from third party. 
  2. Click the Import  button next to PagerDuty.
  3. From here, you can import all of your services, or you can load all of the available services in PagerDuty and selectively pick which ones you'd like to import or link.
  4. Tick the checkbox next to services you want to import/link, and then in the dropdown box, you can specify two choices:
  5. Create New  - Will create a new entry in the FireHydrant service catalog with the same name as the PagerDuty service. This will also automatically link the new FireHydrant service and the PagerDuty Service.
  6. Link to Existing  - If you already have services in FireHydrant, you can choose which one you'd like to link this PagerDuty service to.

Screen_Shot_2022-11-04_at_3.04.59_PM.png

Paging Teams

Via Slack, FireHydrant gives you the capability to directly page the teams that respond to a service through PagerDuty. To make use of this, there are two prerequisites:

  1. You must complete the section/steps above to link PagerDuty services to FireHydrant services - FireHydrant relies on this link to find the correct on-call/escalation schedule for a particular service.
  2. You must fill in the Default User Email field in the integration settings. This is because PagerDuty requires a user as part of each request's header to log who the request is on behalf of.

We recommend using a service account in PagerDuty that you create to represent FireHydrant as a whole.

mceclip0.png

Once you complete the above steps, you should be able to run /fh page service [NAME] within Slack, or pull up a list of services to page with just /fh page service.

Last updated on 3/28/2023