Merge lp://staging/~ev/daisy/time-to-retrace into lp://staging/daisy

Proposed by Evan
Status: Merged
Approved by: Brian Murray
Approved revision: 321
Merged at revision: 320
Proposed branch: lp://staging/~ev/daisy/time-to-retrace
Merge into: lp://staging/daisy
Diff against target: 132 lines (+47/-1)
4 files modified
daisy/retracer.py (+20/-0)
daisy/schema.py (+4/-0)
daisy/submit_core.py (+5/-1)
test/test_retracer.py (+18/-0)
To merge this branch: bzr merge lp://staging/~ev/daisy/time-to-retrace
Reviewer Review Type Date Requested Status
Brian Murray (community) Approve
Review via email: mp+160694@code.staging.launchpad.net

Description of the change

This branch starts tracking the time it takes to retrace a crash from the point it hits the Rabbit queue to the point that we're writing data back to Cassandra.

We currently measure the size of the Rabbit queue over time:
https://graphite.engineering.canonical.com/render/?width=1129&height=614&_salt=1366818304.688&target=daisy_servers.rabbitmq.messages.retrace_amd64&target=daisy_servers.rabbitmq.messages.retrace_i386&from=-7days

As well as the time it takes to actually retrace a core file:
https://errors.ubuntu.com/retracers-average-processing-time/

And what the ratio of success to failure is when retracing those core files:
https://errors.ubuntu.com/retracers-results/

With this change in place, we can measure the amount of time elapsed from receiving a core file to it being completely processed, anchored to the day that the core file was received.

So if we received a core file four days ago (20130420) and it took us two days to process it off the queue, then the row in TimeToRetrace for the key 20130420 will have a column named by the OOPS ID and a column value of 172800 (two days in seconds).

"timestamp" is a standard property in an AMQP Message:
https://code.google.com/p/py-amqplib/source/browse/amqplib/client_0_8/basic_message.py#93

To post a comment you must log in.
Revision history for this message
Brian Murray (brian-murray) wrote :

This looks good to me but I wonder if it is worth keeping track of the microseconds.

review: Approve

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
The diff is not available at this time. You can reload the page or download it.

Subscribers

People subscribed via source and target branches

to all changes: