...
[11:40:35 CST(-0600)] <TonyUnicon> an*
[11:41:06 CST(-0600)] <js70> your talking after the raw -> then one giant step validation to insure for example unique keys?
[11:41:22 CST(-0600)] <TonyUnicon> yeah, we take the vetted file
[11:41:26 CST(-0600)] <TonyUnicon> and before we start to batch write
[11:41:37 CST(-0600)] <js70> yeah, in the initial implmentation I elected to take that one giant query and break it up into itsy bitsy steps.
[11:41:58 CST(-0600)] <TonyUnicon> so for N rows, how many queries were you firing to validate?
[11:42:05 CST(-0600)] <js70> N
[11:42:05 CST(-0600)] <TonyUnicon> N/batchsize ?