DSXchange

[quote="qt_ky"]Our place does not have any of those technologies, but have you tried the File connector stage? Yes, we did, but unfortunately didn't get it worked due to permission issue (we set the highest security level possible for our Hadoop platform, so permission always a tough task)...

To be clear, datalake is meant created with Hadoop technology: Hive, Impala, hBase, and/or Kudu.

Thanks,

Hi there, How do you ingest your data into datalake: Datastage, Dataset, Informatica or sqoop, ...? I were trying this for a while with Datastage, creating cases with both IBM and Cloudera. With JDBC driver, we can ingest small amount of records (fewer than 1000) successfully, but ran hours for just...

Thanks, eostic. Yes, we try use file connector uploading result file to hdfs file system, then through there to Kudu. It'w a work around, not look that good.

Hello every one, does any one ingest data to Hadoop platform (Hive, Impala) or Apache Kudu? How do you resolve the performance issue? We use Datastage JDBC connector with Cloudera Impala JDBC driver, it works well for extraction, but not loading - the insert performance is terrible: 20,000 records t...

Another function works: ereplace(strg, char(8206), '')

It can be detected with function index(strg, char(8206),1) for Unicode 0x200E, but it seems convert(strg, char(8206), '') doesn't recognise the char(8206), so doesn't work as expected.

Thanks for responses. In my experience with a peek stage as reject link target, it's nothing with what's logged. It logs on the same number of info items as your parallel config. One job succeeds with 0 Abort after (rows), another job fails with the same setting. So the setting is unsure of its beha...

A DB2 connector reject link is provided to accommodating without aborting no matter how many rejects are produced. How do we accommodate this: below is from IBM knowledge centre: https://www.ibm.com/support/knowledgecenter/SSZJPZ_8.1.0/com.ibm.swg.im.iis.conn.db2db.usage.doc/topics/iisdb2_mngrejectd...

Hi There, I see there is JDBC connector for v9.1.2. Is there one for v8.7? Does this JDBC connector support connecting to Apache Kudu? Apache Kudu has JDBC driver for Unix platform. Can we use this driver for Datastage v8.7 running on AIX? https://www.ibm.com/support/knowledgecenter/SSZJPZ_9.1.0/com...

Thanks, I actually saw this page. But it doesn't explain what delete means, what edit means. It only specifies the option when delete situation occur do you want to output the record, but what the delete means?

Can any one tell what the intermediate links are different with left and right links? For the types of join: inner, left / right outer and full, are they not applied to these intermediate links?

thanks,

I Guess you can use merge stage also, don't you?

How these 14 files are brought to the join stage: after two links are added as left and right links, more links are added to the stage and will be treated as Intermediate links without any issue?

Thanks,

I'm surprised that even on its page of Change Capture stage below, It doesn't explain what the actions mean of insert, delete, copy and edit, and doesn't list what the change codes are for these. https://www-01.ibm.com/support/knowledgecenter/SSZJPZ_11.5.0/com.ibm.swg.im.iis.ds.parjob.dev.doc/topics...