Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

[11:54:21 CST(-0600)] <TonyUnicon> which could mean more iteration

[11:54:37 CST(-0600)] <TonyUnicon> so

[11:54:56 CST(-0600)] <TonyUnicon> I think that is a good enough reason to try to put as much validation in the java as we can

[11:55:05 CST(-0600)] <dmccallum54> that is still my vote (smile)

[11:55:14 CST(-0600)] <TonyUnicon> the ayes have it

[11:55:30 CST(-0600)] <dmccallum54> poking around on SO re error granularity in batched jdbc statements

[11:55:53 CST(-0600)] <dmccallum54> looks like identifying the bad row might be a bit driver specific, if possible at all

[11:56:30 CST(-0600)] <TonyUnicon> ok, well in that case i'll do my best to put as much info into the logs as we can, at least for postgres and sqlserver

[11:56:31 CST(-0600)] <dmccallum54> i.e. if the driver keeps ploughing ahead after failed statements, getUpdateCounts wont help

[11:57:59 CST(-0600)] <dmccallum54> cool. sounds like we are agreed, then

[11:58:04 CST(-0600)] <TonyUnicon> yep

[11:58:06 CST(-0600)] <TonyUnicon> thanks

[12:22:11 CST(-0600)] <js70> interesting: https://github.com/42BV/jarb/ https://blog.42.nl/articles/using-database-constraints-in-java/

[12:26:12 CST(-0600)] <js70> so, an outstanding question that I have, we still need a little information to start using the metadata for validation. mainly the table name. that is going to come from the file name correct? headers contain the columnnames and away we go?

[12:27:41 CST(-0600)] <dmccallum54> simplest thing would be for the file names to match table names and file column headers to match db column names

[12:27:57 CST(-0600)] <dmccallum54> the result, of course, is that if the db names change, the file protocol changes

[12:28:22 CST(-0600)] <dmccallum54> but… the advantage is that it's totally obvious how to go from our published spec for the db tables to what your CSV files need to look like

[12:29:08 CST(-0600)] <dmccallum54> so my vote is to try to get as far as we can with unmapped correlations between file/table and column/column names

[12:30:20 CST(-0600)] <js70> k.