[P2] Jobs are Queued - pet instances #349
Description
[no value] jobs are queueing, please investigate. Max queue time: [no value] mins, Max queue size: [no value] runners. Please visit http://hud.pytorch.org/metrics to see which runners are queueing.
Alert Details
- Occurred At: Oct 10, 11:31am PDT
- State: FIRING
- Team: pytorch-dev-infra
- Priority: P2
- Description: Alerts when any of the regular runner types is queuing for a long time or when many of them are queuing.
- Runbook: https://hud.pytorch.org/metrics
- View Alert: https://pytorchci.grafana.net/alerting/grafana/aez5q4um9pd6of/view?orgId=1
- Silence Alert: https://pytorchci.grafana.net/alerting/silence/new?alertmanager=grafana&matcher=__alert_rule_uid__%3Daez5q4um9pd6of&matcher=rulename%3DJobs+are+Queued+-+pet+instances&matcher=type%3Dalerting-infra&orgId=1
- Source: grafana
- Fingerprint:
954c4327a039b83f2959f9adaae3334fb13339d1f3e74a0111d0c4491803ceb6