The eventlogging database consumer generates single-row inserts. From a performance perspective (master overhead and slave replication lag) it would be better to batch inserts.

The batches need not be large or of a particular size. The approach could simply be opportunistic grouping of small numbers of rows in the same table when more than one is available.

IRC excerpt:

<ori> one thing that would have to be rethought is table creation
<ori> right now eventlogging always just tries to insert events
<ori> if the database errors out because the table doesn't exist, *then* it

issues the create table statement

<ori> this is nice because you can drop or rename a table and it just gets

recreated anew without any downtime

<ori> i don't have a ready-made model of how this would work in a world where

we do batch inserts, but my reflexive hunch is that it's not a 
show-stopping problem, and that we could work around it

<springle> not knowing the code at all, but could it be simple opportunistic

batching? when inserting a record, check if additional records for 
the same table exist, and group them

<springle> might only get a few each time, but that would still be better
<ori> yeah, totally

Version: unspecified
Severity: enhancement
Whiteboard: u=Analyst c=EventLogging p=34 s=2014-11-13