To push operator metering metrics to Kafka or NoSQL DBs

[amalkurup89]

Description :

From the current documentation & whatever experimentation I have done on operator metering, I don't see a feature to upload or push the operator metering metrics to a NoSQL database like Cassandra or Kafka topic instead of Presto DB

This can be useful to query operator metering metrics from web applications as Presto is relatively slow

Please share your thoughts on this or are you folks looking at any such feature soon

Motivation :

Feature enhancement for operator metering

[bentito]

Hi Amal, I don't think we've been looking to cut Presto out of the loop. We actually now have a connector we are contributing to the Presto project that allows Presto to directly query Prometheus (trinodb/trino#2321). As we transition the metering code base to use Presto queries rather than the roundabout manner of Prometheus to Hive to Presto, I think the logical streamlining will also result in a speed up as well. -Brett

[timflannagan]

On top of what Brett mentioned, if you're looking to speed up Presto query execution, a more immediate fix would be to scale some Presto "worker" replicas or pump up the CPU/memory limits for that Pod: https://github.com/operator-framework/operator-metering/blob/master/manifests/metering-config/recommended-resource-limits.yaml#L38-L63