Search found 82 matches

by emma
Wed Jan 17, 2018 8:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup design best practices
Replies: 2
Views: 2675

Thank you qt_ky.
by emma
Fri Jan 12, 2018 11:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup design best practices
Replies: 2
Views: 2675

Lookup design best practices

I've seen many times the Lookup stage designed with Sort on both links, the input and the reference link , that I'm wondering if the best practices changed on this one ! I'm talking about a Normal Lookup with the Input Hash Partitioned on Keys and the Reference Entire Partitioned. What would be the ...
by emma
Mon Aug 29, 2016 2:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: generate surrogate keys with SQL Server sequence
Replies: 7
Views: 7970

The right answer is that with SQL Server we don't really need a Sequence Generator or State File or a database sequence , we just need to add to the table the IDENTITY column which will auto increment for every record inserted. And to use that with the SCD stage just let the Surrogate Key option bla...
by emma
Wed Aug 24, 2016 1:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Slowly Changing Dimension stage doesn't compare fields
Replies: 0
Views: 1896

Slowly Changing Dimension stage doesn't compare fields

I have another issue now ... after taking Ray advice and using SQLServer Enterprise stage the job is updating the dates and everything , but the SCD stage doesn't compare for real updates.

Could anyone help me with any ideea ?
by emma
Tue Aug 23, 2016 1:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Slowly Changing Dimension stage update issue
Replies: 3
Views: 3661

One more question please , did you used all the build-in functionalities of the SCD stage ? like "Auto-generate Upsert SQL" ? Did the stage compare the fields by itself ?
I just noticed that the stage is updating the the SK ! :o
by emma
Thu Aug 18, 2016 3:33 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Slowly Changing Dimension stage update issue
Replies: 3
Views: 3661

Slowly Changing Dimension stage update issue

I'm trying to use the SCD stage with an ODBC connection, in the most classic way , and the result is that it doesn't update nothing , keep inserting the records. Can anyone give me any idea where to look for the issue ? I suppose is another incompatibility between DataStage and Microsoft ..but I nee...
by emma
Fri Aug 05, 2016 8:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: generate surrogate keys with SQL Server sequence
Replies: 7
Views: 7970

I'm sorry I wasn't clear about the issue I have .... I'm looking here to have the confirmation if our installation has an issue or is simply like that, because in the <Database Type> drop down list, I have options only for DB2 and Oracle ? I build the classic , standard job to create a sequence (the...
by emma
Thu Aug 04, 2016 12:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: generate surrogate keys with SQL Server sequence
Replies: 7
Views: 7970

Hi Ray ...thank you , but I don't have this option.
I have only DB2 and Oracle in the list. I use DS 11.5
by emma
Wed Aug 03, 2016 12:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: generate surrogate keys with SQL Server sequence
Replies: 7
Views: 7970

generate surrogate keys with SQL Server sequence

How do I generate surrogate keys using a SQL server sequence ; and use it with the slow changing dimension stage ?
by emma
Fri Apr 15, 2016 7:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pivot: Error parsing schema: Duplicate field identifier
Replies: 2
Views: 3304

Pivot: Error parsing schema: Duplicate field identifier

I'm trying to use 2 vertical pivot stages one after another and I have an error that doesn't make sense to me. Please let me have your opinion, what might that signal here ? file-->pvt1--->pvt2---> file pvt1(Array size 4) col_1_key group by col_2_key group by col_3_key group by col4 pivot pvt2(Array...
by emma
Wed Mar 09, 2016 10:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC join tables limitation
Replies: 10
Views: 5855

The issue was the buffer not the number of tables. After I've increased the buffer and the administrator put some indexes on the tables keys, the query worked well.
by emma
Fri Feb 26, 2016 8:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC join tables limitation
Replies: 10
Views: 5855

Hi Ray : Yes the query runs perfectly from another tool (SQL Query Manager tool) I can say definitely that ODBC doesn't handle more that 3 join tables. I tried another one ; works with 3 tables but not with the 4th one Select count (*) FROM TABLE_1 inner join TABLE_2 ON tbl1.key = tbl2.key inner joi...
by emma
Thu Feb 25, 2016 3:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC join tables limitation
Replies: 10
Views: 5855

In fact doesn't fail , is just gone for the eternity ...

In the job I have

ODBC -----> Transformer (very basic transformation) -----> Difference( DataSet ) ------> Target table

I didn't involve the support by now, I just workaround by splitting the query and using Join stages.
by emma
Thu Feb 25, 2016 8:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC join tables limitation
Replies: 10
Views: 5855

These are my query joins : from table 1 lst inner join table2 ent ON ent.ENT_NO=convert(varchar(9),lst.key) and ent.CUR_FLG = 'Y' inner join table3 ctry on ent.key = ctry.key and ctry.CUR_FLG='Y' inner join table4 on ent.ENT_NO = convert(varchar(9),dps.key) and dps.FLAG = 'Y' left outer join table5 ...
by emma
Tue Feb 23, 2016 4:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC join tables limitation
Replies: 10
Views: 5855

ODBC join tables limitation

I would like to know if there is any known limitation on how many table can I join into an ODBC connector.
It seems to have problems for 4 and more.