[11:22:46 CDT(-0500)] <b-rock> Greetings EricDalquist: I'm working through importing data from 3.2 to up4.0.1 and have come up with an issue. http://pastebin.com/JNQAVT9X seems like groups from the grouper service are being compared to categories during the channel imports.
[11:23:30 CDT(-0500)] <b-rock> I wonder if I should just disable grouper for the import and then re-apply the group settings for each portlet from the front end.
[11:24:18 CDT(-0500)] <b-rock> other parts of the import are working with grouper enabled,
[11:24:29 CDT(-0500)] <EricDalquist> do you have portlets that are permissioned to your grouper groups?
[11:24:58 CDT(-0500)] <b-rock> yes there are some of those but the failure seems to be happening for portlets that do not use grouper groups.
[11:25:17 CDT(-0500)] <b-rock> when I have grouper turned off the portlets with grouper groups crash.
[11:25:51 CDT(-0500)] <b-rock> It may be easier though just removing those channels grouper group's and manually applying them after the import
[11:26:33 CDT(-0500)] <b-rock> I haven't figured out yet when grouper is being called during the import.
[11:26:54 CDT(-0500)] <b-rock> or where it is being called
[11:27:27 CDT(-0500)] <EricDalquist> it will be called for every portlet
[11:28:03 CDT(-0500)] <EricDalquist> when you're doing a migration your target portal instance needs to have all of the user attribute and groups sources configured that the old portal did
[11:28:07 CDT(-0500)] <b-rock> ok that makes since since there can be grouper groups in the groups section of the data but it looks like grouper is being called while the categories seciton is being compared
[11:28:19 CDT(-0500)] <EricDalquist> categories are just groups of portlets
[11:28:24 CDT(-0500)] <EricDalquist> instead of groups of people
[11:28:28 CDT(-0500)] <b-rock> ok
[11:28:37 CDT(-0500)] <EricDalquist> so it is all part of the groups system
[11:28:59 CDT(-0500)] <b-rock> I did take your advice and make sure all of the configurations in the 4.0.1 build have our settings as they are in the 3.2 builds
[11:29:18 CDT(-0500)] <EricDalquist> great
[11:29:20 CDT(-0500)] <b-rock> same dlm.xml pagsGroupStore and other configs
[11:30:05 CDT(-0500)] <b-rock> so far users, profile and fragment_layouts all import without error consistently. every other data set is hit or miss.
[11:30:45 CDT(-0500)] <b-rock> sometimes they run to completion but the data doen't make it to the db. other times it just errors out.
[11:31:39 CDT(-0500)] <b-rock> I was thinking the data needs to be imported in a certain order based on some of the errors I've been seeing. like group_membership needs to happen before permission_set
[11:33:07 CDT(-0500)] <b-rock> I know your still swamped but I thought this could be helpful for others trying to upgrade if there are still some issues in the import. probably complicated though with grouper in place.
[11:37:05 CDT(-0500)] <EricDalquist> all of the per-type ordering is very explicitly enforced by the import process
[11:37:51 CDT(-0500)] <EricDalquist> if you want to try and simplify what you see go into portal.properties in the 4.0 code and change the property org.jasig.portal.io.threadPool.maxThreads to 1
[11:37:52 CDT(-0500)] <b-rock> yeah I figured that but I dont know what the order is. is it documented somewhere or can I add it to the wiki if you have it?
[11:38:15 CDT(-0500)] <EricDalquist> well what you should be doing is just pointing the import process at your exported data dir
[11:38:28 CDT(-0500)] <EricDalquist> and the importer will load up ALL the files and import the in the right order
[11:38:40 CDT(-0500)] <EricDalquist> but the order is:
[11:38:41 CDT(-0500)] <b-rock> ok I'll make the mod and re-run.
[11:39:03 CDT(-0500)] <EricDalquist> defined by the dataTypeImportOrder bean in uportal-war/src/main/resources/properties/contexts/importExportContext.xml
[11:39:42 CDT(-0500)] <b-rock> I've been chunking it up because parts of it would run ok but then bomb half way through. I though I could do them in chunks and then focus in on debugging where the import fails.
[11:40:08 CDT(-0500)] <b-rock> initially i did just point the importer at the exported data
[11:40:41 CDT(-0500)] <b-rock> thanks. I 'll take a look at he importExportcontext.xml file to make sure I've got the order right.
[11:40:48 CDT(-0500)] <EricDalquist> sounds good
[11:40:52 CDT(-0500)] <EricDalquist> thanks for your help on this as well
[11:41:07 CDT(-0500)] <EricDalquist> I did a lot of testing but unfortunatly its still bumpy for the early adopters
[11:41:40 CDT(-0500)] <b-rock> yeah np. I hoped I would have had this process nailed down by now since I've been through 2 schema change upgrades