[Feature] Rich context alarm message

[wu-sheng]

Search before asking

• I had searched in the issues and found no similar feature requirement.

Description

SkyWalking has support MQE in the alarm setting. Right now, we forward the triggered alarm to the notifications, but lack of the context of metrics' values in the windows.

Use case

We need the context of metrics' values because the values in the database are always the latest, but they can be different when the alarting kernel was checking the in-memory time windows.
We should consider forwarding all values in the alarm kernel context.

Related issues

Further, alarm UI should also support to visualize this part. @wankai123 @Fine0830 Right now, we don't have UI dashboard configuration for those metrics in the alarm rules, so, the values showing up could be unfriendly to the end users.
We should consider to add more configurations to the alarm list page, and config the value of showing graphs for the metrics in the alarm context, which will be newly added in here.

Are you willing to submit a pull request to implement this on your own?

• Yes I am willing to submit a pull request on my own!

Code of Conduct

• I agree to follow this project's Code of Conduct

[wu-sheng]

To support this alarm in a proper way, we could include values of each metric for every time bucket, and the calculation result of MQE for every time bucket.

@Fine0830 The configurations for alarm page could be linked to metrics name. We should show the value of alarm rule MQE values by default, and support to show each metric value by a selector.

Note, about the metric like successful rate, its original value are not formatted, e.g. 9900 represents 99%. Showing the original 900 is exactly what we expect. This could indicate why the configurations of MQE are not proper.