Project X Discussions

Interfaces for Enterprise Systems - ODBC vs API

We have been working over the past several months with a client who has DataStage (IBM Information Manager).  At one point we reached a fork in the road and had a choice of which interface to use into the database - ODBC vs API.

Not sure exactly why we chose ODBC stage to connect to Teradata vs the API but we did.  We felt good about doing so.

So why am I wondering if this was still a good route.  It seemed to make so much sense, but we are having so much trouble keeping the DataStage .ini configuration stable to not have random Abend issues.  ODBC should be a perfect fit except when we use fast export or another more specific utility from Teradata.

OK so it should be fine.  The Oracle interfaces don't seem to have this issue.
It was and probably is fine.
But if it can not remain stable it is not fine.

Outside of theoretical rhetoric, has anyone else had that issue?

DataStage 7.0.1 on Windows XP

So we have been buzzing along on a project and in the middle of deployment have upgraded all of our development laptops to some new IBM T-60s running Windows XP Pro SP2.

So out of nowhere, there is a bunch of functionality that does not seem to work and it is pretty crucial.

Well after an 3 hours of diddling, searching the web and so forth, I identified that there does seem to be an issue with 7.5 and they have supplied a patch "DataStage Client 7.5 Patch for XP SP2" which is called "dsclient_xpsp2.zip" which is not available online to the public.  So our IBM account administrator was able to find the  workaround/patch and email it to me.

I am tempted to publish the patch here as this took us down and was not in the standard CD, download package.  But I do not want to get in trouble from IBM.  So as soon as you hit the issue, call your IBM rep.

CoffeeCAST - CC#32 - Talking Data Warehousing and Integration

Welcome to the 32nd CoffeeCAST with Stephen Hayward of Project X.  Well welcome back.  Today I have captured Graham for another fun discussion on Data Warehousing and Integration.  So I am just finishing a great Starbucks Grande Bold and hope you have found a good coffee yourself for this CoffeeCAST and sit back while Grham and I chat about:

• Discussion on Cars - Environmentally friendly started by MIP's Smartcar (see my pic/post)
• Datawarehouse
  • New Trends - Out from build to Support and Enhance
  • Marts vs Warehouses (logical/physical)
  • Master Data Management
    • Customer Master File (CMF)
    • Customer Information File (CIF)
• Data Integration
  • In the Warehouse vs ETL
  • DataStage and Informatica
  • Teradata
  • ELT (Sunopsis)
  • Moving Data

So as always it was great to grab a chance to talk with Graham.

Download cc_32_warehouses_and_integration.mp3

Listen in and we hope you enjoy and more importantly, hope you join in the conversation.  So drop a comment in the blog or send me an email and share your thoughts on the topic.

The audiocast is available on iTunes (as a Podcast) or here for download.  Have a great day and join the conversation.

Job Opportunities @ Project X

Hello everyone, Project X is going through a growth spurt and are looking for some great people to do awesome things with us and for our clients.  Here are what we are looking for:

• ETL Developers (Intermediate to Senior) - Ascential DataStage, Sunopsis
• BEA Developers (Senior) - Java, Service Oriented Architecture (SOA) / Composite Services, DWL Customer Master File Suite (now part of IBM)
• Data Warehouse Developers (Intermediate to Senior) - Netezza, Oracle, SQL Server and Teradata
• Business Analysts (Intermediate to Senior) - Telco, Retail, Financial Service