I’ve been doing a lot of Connections upgrades and migrations in the past few months and since I prefer to do a side-by-side upgrade there are lots of steps along the way to make sure the data is moved and upgraded from the existing servers to the new servers. The documentation on how to do this in the Knowledge Center is good but there’s a lot of jumping around all over the place between tasks and I have found it helpful for me to have a checklist to make sure I don’t miss anything.
Here’s the checklist I’m using right now with some explanation and links to the documents in the Knowledge Center for each. My steps aren’t in the same order as in the documentation but they are the order I use
In theory the migration shouldn’t make changes to your production servers, but I’m risk averse and it’s worth the extra few minutes to make sure you can back out of the migration should you need to.
Before starting anything you should have created new empty databases on your new system using the scripts / wizard from the version you are moving from. Even if you are moving to Connections 5 from Connections 4, you will need to use the Database wizard for Connections 4 to create the databases we are going to move data into. That makes sense when you consider we are going to transfer the data over from the existing production environment so the format / structure and schema must be identical from source to target.
Begin by stopping everything, all WAS servers and DB2 (or SQL, Oracle) in your production environment as well as any TDI assemblylines you may have running. The data migration requires the production site to be down and stay down until the new site comes up, that could be anywhere from a day to 3 days depending on how big your environment is and how much data you have as well as the connectivity between old and new environments when transferring the data.
Now let’s back everything up – just get the existing production configuration data somewhere you can access it and make sure you don’t lose any data during migration so backup all the DB2 databases as well as the Connections shared data /Connections/data.. /shared (I personally like to backup /Connections/data which gets local as well but that’s just me.
- Backup Connections Dmgr Profile by running backupconfig.bat /.sh from the /Dmgr01/bin directory. This will stop the Dmgr server if it’s not already stopped or if you don’t use the -NoStop parameter. (no need to backup Installation Manager when doing a side by side migration)
- Backup the Connections shared data
- Backup customisations somewhere you can access them for reading and manual copying over to the new environment
- Run the migration.bat / sh to export the Connections configuration data ready for import in your new environment. This includes the LotusConnections-Config.xml and application specific data. This is exported to a directory you then copy to your new environment where you can import it
- Migrate each of the databases, one at a time. Each one has a pre-script to run to prepare the database, then at least 2 migration scripts, one to move the data and one to clear the scheduler entries on each database. All the instructions are here however there are a couple of things to bear in mind.
When running the scripts I like to add >filename to the end of each command to pipe the output to a log file. I usually create a “Logs” directory and call the file by the name of the script _app name e.g predb_blogs.txt. This way I can check if the scripts ran OK by reading the logs and I have something to send to IBM if it comes down to opening a PMR
See my earlier blog for potential syntax issues running the scripts
To run dbt.jar which migrates the data you create an XML file and a matching Batch file for each application. I like to create all of these at once and add them to a directory from which I can run for each application (again with the >logfile at the end). Below are examples of XML and batch files I modify to use (I’ve avoided putting in carriage returns as that messes things up should you copy out of here)
XML (e.g. files.xml below)
<dbTransfer xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance“><database role=”source” driver=”com.ibm.db2.jcc.DB2Driver” url=“jdbc:db2://sourcedbserverhost:50000/FILES” userId=“db2admin” schema=“FILES” dbType=“DB2”/> <database role=”target” driver=”com.ibm.db2.jcc.DB2Driver” url=”jdbc:db2://targetdbserverhost:50000/FILES” userId=“db2admin” schema=“FILES dbType=“DB2”/> </dbTransfer>
BATCH (calls files.xml)
“e:\install\connections\wizards\jvm\win\jre\bin\java” -cp e:\dbt_home\dbt.jar;e:\ibm\sqllib\java\db2jcc.jar;e:\ibm\sqllib\java\db2jcc_license_cu.jar com.ibm.wps.config.db.transfer.CmdLineTransfer -logDir e:\dbt_home\logs -xmlfile e:\dbt_home\files.xml -sourcepassword typedb2passwordhere -targetpassword typedb2passwordhere
- Upgrade database schemas. Once all the migrations scripts have been run (don’t forget the clearScheduler and run/updateStats where needed) you can proceed to upgrade the databases. I like to back them up one more time before running the upgrade though, but that’s just me. If it took a day or more to migrate the data I don’t want to do that all again.There are two ways to update the databases on your new target server. Either using the provided (Connections 5) database wizard and choosing “Upgrade” or by running manual scripts. I prefer to run the scripts manually so I can see what’s going on and IBM recommend that for the Homepage at least you run the script manually rather than use the Wizard.
Instructions for doing both Wizard and Manual methods are here . The biggest issue with running the scripts manually is that there are slightly different syntaxes depending on which version you are coming from and it’s fiddly getting the right one, I still prefer it although I have used the Wizard for several of the applications and it has worked fine.
- Once you’ve upgraded all the databases, the Homepage requires another step and that’s to do a java migration of its data. This ensures the format and content of each individual’s homepage matches that required for Connections 5. The Homepage database is by far the largest of all those used and this could take significant time. Below is an example of the command I run (again I have taken out carriage returns and invalid quotes etc
e:\install\connections\wizards\jvm\win\jre\bin\java -Dfile.encoding=UTF-8 -Xmx1024m -classpath e:\ibm\sqllib\java\db2jcc.jar;e:\ibm\sqllib\java\db2jcc_license_cu.jar;e:\install\connections\wizards\lib\lic.dbmigration.default.jar;e:\install\connections\wizards\lib\commons-logging-1.0.4.jar;e:\install\connections\wizards\lib\news.common.jar;e:\install\connections\wizards\lib\news.migrate.jar com.ibm.lconn.news.migration.next50.NewsMigrationFrom45to50 -dbur1 jdbc://db2://targetdb2hostname:50000/HOMEPAGE -dbuser db2admin -dbpassword targetdb2password >java.out.log 2>&1
- Importing artifacts. Using the directory and contents created earlier one when we exported the Connections artifacts, we can now import them into our new Connections environment. We’re basically doing the reverse of what we did to export but this time running migration.bat /sh lc-import.
- Migrate or Rebuild the search index. Migrating can be done if the source version is 4.5 because the search index structure is the same however I prefer to rebuild cleanly if I have the time
- Custom profiles. If you have custom profile settings (strings, languages, profile types) in your existing environment and that is 4.0 these will need to be migrated / converted to the Connections 5 format. There are also settings that should have come over when restoring your artifacts that it is worth validating
The items below tend to be optional depending on what is installed in your current environment but if these elements exist currently they will need to be migrated too
That’s my list anyway. Obviously the Knowledge Center is the definitive source for all you installation / documentation needs 🙂