Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

[09:24:27 CST(-0600)] <jwennmacher> I was thinking about the event aggregation issue Anthony reported. I think both he and the person at the Apereo conference indicated their raw events table was growing at around 1M rows a day.

[09:25:35 CST(-0600)] <jwennmacher> I'm not sure if this is that there were 1M inserts or the net is a growth of 1M rows. I just did a rough calculation. If the aggregation is running every 20 minutes and it does at most 10,000 aggregations, it will aggregate at most 720,000 rows in a day.

[09:26:02 CST(-0600)] <EricDalquist> well it runs ever 60 seconds

[09:26:19 CST(-0600)] <EricDalquist> and it catch-up mode (like there were more events to aggregate than aggregated) it should run continueously

[09:26:25 CST(-0600)] <EricDalquist> the problem could be aggregation rate