Lab: DataStage: Configure a Git server (BitBucket)

You can integrate your Git server with IBM DataStage. This integration allows you to publish jobs and related artifacts to different Git branches and load other versions of a job from Git onto the IBM DataStage Flow Designer canvas.

Using IBM DataStage Flow Designer with Git provides the following benefits:

• Helps with Continuous Integration Continuous Delivery (CICD) pipeline automation. Your assets are easily available in Git and you can move them from the development (DEV) branch to quality assurance (QA) to production.

• Helps with auditing requirements. You can simply tell who changed what.

• You can map a version of a job in the XMETA repository to a version in Git.

• You can work on multiple versions of a job by creating temporary branches.

• You can easily roll back to a prior version of a job.

The following Git repositories are supported:

• Bitbucket

• GitHub

• GitLab

• Microsoft Team Foundation Server

For more info check out the Managing source control with Git documentation.

In this lab we'll learn how to integrate DataStage with BitBucket Cloud, a free to register BitBucket platform available at https://bitbucket.org/.

This lab consists of the following steps:

1. Configure DataStage with BitBucket

2. Export DataStage assets to BitBucket

Before you start: Registering for BitBucket

Navigate to https://bitbucket.org/ and click on the "Get it free" button and create an account.

Create a new repo, we'll call it datastage-jobs. Ensure the option to create a README.md file is selected.

new repo

Your new repo should look like this:

generated repo

Generate an "App Password" by going to your "Personal Settings". Remmeber to give the application password the read/write permission for repositories.

app password

Before you start: Launching DataStage Flow Designer

Before we start the lab, let's switch to the iis-client VM and launch Firefox.

Switch to iis-client

Click on Classic Launchpad in the Bookmarks tab. The first time you try this out, you might see a certificate error. To get past it, click on Advanced... and then click Accept the Risk and Continue.

Classic Launchpad

Click on DataStage Flow Designer.

Select DFD

Login with the credentials isadmin/inf0Xerver.

Log into DFD

This brings up the DataStage Flow Designer. Click OK.

DFD is up

1. Configure DataStage with BitBucket

From the IBM DataStage Flow Designer, click on the username bubble on the top right. Choose the Setup option. We'll be configuring the Server and User options.

Setup git credentials

For the Server click on the Git tab and input the following:

• Git repo: Your new repo, i.e. https://bitbucket.org:stevemart/datastage-jobs.git

• Clone repo path: A new folder name, i.e. bitbucket/stevemart/datastage-jobs

• Vendor: BitBucket

Conifugre git server

For the User configuration input the following:

• Email address: Your BitBucket email

• Username: Your BitBucket username

• Personal access token: Your BitBucket app password from the previous step

Conifugre git user

2. Export DataStage assets to BitBucket

Load up any existing job or create a new one. Once loaded, click on the Export button that looks like an upload arrow.

Export

The entire DataStage project will be saved and exported to your configured BitBucket. Enter a specific commit message.

Commit

There will be a success message if everything was exported correctly.

Success

Navigate back to your BitBucket repository to see the exported files.

Exported files

CONGRATULATIONS!! You have completed this lab!