CD Events Visualization

[elmsdata]

From @afrittoli amazing presentation at CD Con 2023, a general discussion began around having a tool for visualizing the CD Events data. From the presentation, Andrea's architecture contained a layer after the data brokers for the end user to store, visualize and perform analysis on the CD Events data. I wanted to start a discussion around this capability and what open source tools that may already exist we could leverage.

For this first iteration, I think we should primarily focus on the storage and visualization of the data. Here are a few initial thoughts:

1. The storage and data visualization should be IaC that can easily have swappable parts. For example, if someone wants to deploy this capability to AWS they could opt to use S3.
2. We should try to use an CNCF project, if one exists (I'll start digging later this week), for the visualization to help promote another projects. We may need to create our own visualization depending on how customizable end users will want to make the dashboard.

Will continue to add more but Fatih wanted me to start the initial post before I forgot! 😆

[afrittoli]

/cc @rjalander @adamkenihan

[agardnerIT]

Does OpenTelemetry fit well here as the instrumentation technology? Then we can leverage any already-existing OS tool (like Jaeger) or any vendor that supports OTEL.

For example, this Go module adds span attributes for things like cloud events.type: https://pkg.go.dev/github.com/cloudevents/sdk-go/observability/opentelemetry/v2#section-readme

[rjalander]

Added the presentation slides here, which describes working PoC on different types of visualization using CDEvents aware tool and Grafana/Prometheus

[elmsdata]

Terribly sorry that I posted this in May and then didn't have a chance to followup, been out due to life events and an accident. 😭 Great start to the presentation @rjalander and I think Grafana/Prometheus would be a great approach! It's grown hugely in popularity over the past few years and we use it a lot at our company. Would love to explore this idea further! I see Andrea already made a visualization repository. Happy to help with the visualization!