Prometheus use of avg_over_time with absent Ask Question Asked 2 years, 1 month ago Active 2 years, 1 month ago Viewed 6k times 0 we have started to use prometheus for … To select all HTTP status codes except 4xx ones, you could run: http_requests_total{status!~"4.."} Subquery Return the 5-minute rate of the http_requests_total metric for the
The following is what I came up with. And still use the plain query, not query_range. My metrics are of type Summary, sum(sum_over_time(metric_sum[interval])) / sum(sum_over_time(metric_count[interval])) !!! He shall have supervision over all officersand members thereof. That exact an timestamp is unnatural.I am making use of Prometheus query language and alerting for data values in DB.As there are some filters associated with it I am using sum_over_time function to get summation over a hour, which somehow is also considering next range second.These are the semantics of the language, this is not the way you're meant to ingest this sort of data.It sounds like you should be using direct instrumentation and a counter instead.You can close the issue if you feel that's the not the idea behind the range vectors.We've discussed it before, and inclusive ranges are the right behaviour. Prometheusでは蓄積されたデータに対し、その値をそのまま単純にグラフ化するだけでなく、さまざまな条件を指定してクエリ処理を行って集計し、その結果をグラフ化するという機能も備えている。また、特定の条件を満たしたときにメールなどの手段でアラートを送信する機能もある。 I would like to know the number of created jobs in Kubernetes based on a specific label. Each Prometheus server is standalone, not depending on network storage or other remote services. Is it possible to say instead of [1h] something like start=2pm and end=3pm? Please open a new issue for related bugs.Successfully merging a pull request may close this issue.Summation received in with sum_over_time is different from actual values.You signed in with another tab or window.http://prometheus.mytest.com/api/v1/query_range?query=sum,http://prometheus.mytest.com/api/v1/query?time=2016-08-07T10:10:00Z&query=(metric1{label_1%20=%222344461436%22,label_2%20=%20%22288364153%22,job=%22PerfData%22}[1h]),http://prometheus.mytest.com/api/v1/query?time=2016-08-07T11:10:00Z&query=(metric1{label_1%20=%222344461436%22,label_2%20=%20%22288364153%22,job=%22PerfData%22}[1h]). What did kiranalii changed the title Hi, I want to use sum_over_time on range queries.Hi, I want to use sum_over_time on range queries. I am pushing values to Prometheus with help of Pushgateway server. You can define a recording rule for sum(my_metric) by (label1) and then max_over_time. GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.By clicking “Sign up for GitHub”, you agree to our.I want to use sum_over_time on range queries. All regular expressions in Prometheus use RE2 syntax. Can you please advice?Thanks you this works good.
I see nothing implausible here based on what you've provided so far.Your questions made me curious to check values without aggregation function.So values are getting added at every intersection of time.Below are the raw values as per the query requested for two different values(10:00 and 11:00).Below is the image of graph panel with max_over_time function to show spike at intersection.You're not allowing slack in your ranges for oddness, so this sort of thing will happen.What exactly are you monitoring? Dismiss Join GitHub today GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together. If you have further questions, please use our.Successfully merging a pull request may close this issue.How to get maximum of a sum over a period of time.You signed in with another tab or window.https://prometheus.io/docs/prometheus/latest/querying/api/#instant-queries. – Vaisakh Rajagopal Aug 15 '18 at 17:33 1 GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.By clicking “Sign up for GitHub”, you agree to our.I can't use push gateway since I can't discover Prometheus from metric exporter component, so we use pull of the metric from it.I need to sum all the data for certain period of time. Please open a new issue for related bugs.Successfully merging a pull request may close this issue.You signed in with another tab or window.
Currently I use the following query:and I want to see the maximum value even if the metrics got reported only once, however the values I see depends on the.When I use different step I got different results - I know this is useful for graph purposes but I don't know how to query for the max value of the sum withing certain period of time. But if I try for a different period of time for the same metric it shows correct value even with sum_over_time. Thanks.I'm closing it for now. And all values are getting pushed correctly. You Since there are gaps between certain intervals I would like to do a count over time. But it's not working.But i don't know what is difference between [1s] and step size.Disclaimer: I don't think your query makes any sense semantically.This thread has been automatically locked since there has not been any recent activity after it was closed. IIUC you want to do max_over_time((sum(my_metric) by (label1))[1h]) but it isn't supported (yet, see prometheus/prometheus#1227). The Police Chief shall be the head of the department and itschief executive officer. In any case we'd not be able to consider changing this until 2.0.This thread has been automatically locked since there has not been any recent activity after it was closed. GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.By clicking “Sign up for GitHub”, you agree to our.Check that the above value for second entry comes as 17(should be 8), but first value(9) in vector is same in both query results.Can you share the raw data that you're working off? Prometheus is designed for reliability, to be the system you go to during an outage to allow you to quickly diagnose problems.
The following is what I came up with. And still use the plain query, not query_range. My metrics are of type Summary, sum(sum_over_time(metric_sum[interval])) / sum(sum_over_time(metric_count[interval])) !!! He shall have supervision over all officersand members thereof. That exact an timestamp is unnatural.I am making use of Prometheus query language and alerting for data values in DB.As there are some filters associated with it I am using sum_over_time function to get summation over a hour, which somehow is also considering next range second.These are the semantics of the language, this is not the way you're meant to ingest this sort of data.It sounds like you should be using direct instrumentation and a counter instead.You can close the issue if you feel that's the not the idea behind the range vectors.We've discussed it before, and inclusive ranges are the right behaviour. Prometheusでは蓄積されたデータに対し、その値をそのまま単純にグラフ化するだけでなく、さまざまな条件を指定してクエリ処理を行って集計し、その結果をグラフ化するという機能も備えている。また、特定の条件を満たしたときにメールなどの手段でアラートを送信する機能もある。 I would like to know the number of created jobs in Kubernetes based on a specific label. Each Prometheus server is standalone, not depending on network storage or other remote services. Is it possible to say instead of [1h] something like start=2pm and end=3pm? Please open a new issue for related bugs.Successfully merging a pull request may close this issue.Summation received in with sum_over_time is different from actual values.You signed in with another tab or window.http://prometheus.mytest.com/api/v1/query_range?query=sum,http://prometheus.mytest.com/api/v1/query?time=2016-08-07T10:10:00Z&query=(metric1{label_1%20=%222344461436%22,label_2%20=%20%22288364153%22,job=%22PerfData%22}[1h]),http://prometheus.mytest.com/api/v1/query?time=2016-08-07T11:10:00Z&query=(metric1{label_1%20=%222344461436%22,label_2%20=%20%22288364153%22,job=%22PerfData%22}[1h]). What did kiranalii changed the title Hi, I want to use sum_over_time on range queries.Hi, I want to use sum_over_time on range queries. I am pushing values to Prometheus with help of Pushgateway server. You can define a recording rule for sum(my_metric) by (label1) and then max_over_time. GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.By clicking “Sign up for GitHub”, you agree to our.I want to use sum_over_time on range queries. All regular expressions in Prometheus use RE2 syntax. Can you please advice?Thanks you this works good.
I see nothing implausible here based on what you've provided so far.Your questions made me curious to check values without aggregation function.So values are getting added at every intersection of time.Below are the raw values as per the query requested for two different values(10:00 and 11:00).Below is the image of graph panel with max_over_time function to show spike at intersection.You're not allowing slack in your ranges for oddness, so this sort of thing will happen.What exactly are you monitoring? Dismiss Join GitHub today GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together. If you have further questions, please use our.Successfully merging a pull request may close this issue.How to get maximum of a sum over a period of time.You signed in with another tab or window.https://prometheus.io/docs/prometheus/latest/querying/api/#instant-queries. – Vaisakh Rajagopal Aug 15 '18 at 17:33 1 GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.By clicking “Sign up for GitHub”, you agree to our.I can't use push gateway since I can't discover Prometheus from metric exporter component, so we use pull of the metric from it.I need to sum all the data for certain period of time. Please open a new issue for related bugs.Successfully merging a pull request may close this issue.You signed in with another tab or window.
Currently I use the following query:and I want to see the maximum value even if the metrics got reported only once, however the values I see depends on the.When I use different step I got different results - I know this is useful for graph purposes but I don't know how to query for the max value of the sum withing certain period of time. But if I try for a different period of time for the same metric it shows correct value even with sum_over_time. Thanks.I'm closing it for now. And all values are getting pushed correctly. You Since there are gaps between certain intervals I would like to do a count over time. But it's not working.But i don't know what is difference between [1s] and step size.Disclaimer: I don't think your query makes any sense semantically.This thread has been automatically locked since there has not been any recent activity after it was closed. IIUC you want to do max_over_time((sum(my_metric) by (label1))[1h]) but it isn't supported (yet, see prometheus/prometheus#1227). The Police Chief shall be the head of the department and itschief executive officer. In any case we'd not be able to consider changing this until 2.0.This thread has been automatically locked since there has not been any recent activity after it was closed. GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.By clicking “Sign up for GitHub”, you agree to our.Check that the above value for second entry comes as 17(should be 8), but first value(9) in vector is same in both query results.Can you share the raw data that you're working off? Prometheus is designed for reliability, to be the system you go to during an outage to allow you to quickly diagnose problems.