Search found 429 matches

by kwwilliams
Tue Oct 07, 2014 7:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Balanced Optimizer & Operations Console
Replies: 2
Views: 2367

Rows per link in a BO job that completely pushes the work down to the database would be pretty meaningless. Look at the example you are giving for performance tuning in another post: Row Generator --> Neteeza There is 1 link and the number of rows across the link is 1. Depending upon the database st...
by kwwilliams
Tue Oct 07, 2014 7:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: NULL Handling in Runtime Column Propagation
Replies: 10
Views: 8664

Oracle treats empty strings as null. http://docs.oracle.com/cd/B19306_01/server.102/b14200/sql_elements005.htm http://docs.oracle.com/cd/B28359_01/server.111/b28286/sql_elements005.htm You can work around this by providing a default value in the Oracle DDL. Understand that other loads where the colu...
by kwwilliams
Tue Nov 12, 2013 7:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance issue reading data from Oracle connector
Replies: 16
Views: 9612

ROWID is Oracle row identifier and is unique for every single row in your table. Without knowing more specifics of your job, there are only two reasons that I can think of that you would have duplicates: 1. As Ray said you have duplicates in your source table 2. You are not partitioning and/or sorti...
by kwwilliams
Mon Nov 11, 2013 7:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance issue reading data from Oracle connector
Replies: 16
Views: 9612

Re: Performance issue reading data from Oracle connector

Have you tried enabling partitioned reads? If the table is a partitioned table you can have it read from each Oracle partition. If the table is not partitioned you can still read in parallel: 1. Enable partitioned reads = Yes 2. Partitioned reads method = Rowid round robin 3. table name for partitio...
by kwwilliams
Mon Nov 11, 2013 9:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: datastage sort best performance
Replies: 9
Views: 10826

How are you building your source sequential file? From your explanation it, I am assuming that you are building the file. Are you using DataStage to build it. If you are using DataStage to build the sequential file, have you considered using a data set instead of a sequential file?
by kwwilliams
Wed Oct 30, 2013 5:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Balanced Optimizer - Transform Stage
Replies: 8
Views: 4997

You can't force datastage to push down when it doesn't want to do so. Your only option would be to manually manipulate the job if it didn't push as much logic into the database as you were hoping.
by kwwilliams
Mon Oct 14, 2013 11:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle connector Update then Insert mode not working for RCP
Replies: 8
Views: 11584

chulett wrote:... unless you specify the key(s) in your schema file.
Has there been a change to allow schema files to identify keys? We had this discussion last year:

viewtopic.php?t=147155&highlight=

If a key specification now exists it would definitely provide more flexibility.
by kwwilliams
Mon Oct 14, 2013 7:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle connector Update then Insert mode not working for RCP
Replies: 8
Views: 11584

Re: Oracle connector Update then Insert mode not working for

With RCP the best way to update/insert is to write the sql statements in a file, then reference the file for your sql statements. Having DataStage generate your sql statement won't work because it doesn't know the key for your data.
by kwwilliams
Fri May 31, 2013 10:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Poor performance - Extracting Oracle Table
Replies: 9
Views: 6111

How many bytes are in each row? A wide 10 billion row table is going to take quite some time to extract. A fairly skinnty 10 billion row table should be manageable. Have you tried to perform a parallel read? In the connector, enable parallel read and then set rowid hash and the table name equal to y...
by kwwilliams
Wed May 22, 2013 12:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: RCP with sort/join stages
Replies: 2
Views: 2818

Re: RCP with sort/join stages

Your sql can alias a column or a concatenation of columns as 'keycolumn' and then you can sort and partition based upon that column. It will also be helpful to have the key column extracted under its own column name so it can be used to insert into any target using drop unused coumn (which would dro...
by kwwilliams
Tue May 14, 2013 8:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unable to load the Latin Tilde characters into Teradata
Replies: 2
Views: 4098

The name field should be set to Unicode in Teradata and not Latin. And the SQL Server NLS is not ISO-8859-1, it is likely windows-1252. Windows 1252 was developed before the Latin-1 and is a superset of Latin-1. Once you have the column set to Unicode and the NLS MAP set to windows-1252, and then cl...
by kwwilliams
Tue Apr 30, 2013 12:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: [Microsoft][ODBC SQL Server Driver][DBNETLIB]ConnectionWrite
Replies: 22
Views: 28353

no, nothing different from the client as long as they are straight inserts.
by kwwilliams
Tue Apr 30, 2013 10:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ORA-02291 Error in Oracle conector stage
Replies: 3
Views: 2687

Does the parent table allow null in the state column? If it does not allow null then you should not be attempting to insert a null into the child table else if allows a null and there is null present in the state table then you should not be getting this error.
by kwwilliams
Tue Apr 30, 2013 10:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: [Microsoft][ODBC SQL Server Driver][DBNETLIB]ConnectionWrite
Replies: 22
Views: 28353

Just happened to look out here and see this question this morning. You can have a DSN entry as simple as this work. Driver=/opt/IBM/InformationServer/Server/branded_odbc/lib/VMsqls24.so Description=DataDirect 6.0 SQL Server Native Wire Protocol Database= LogonID= Password= Address=ipaddr, portno Quo...
by kwwilliams
Thu Apr 11, 2013 6:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Merge Statement SQL Server ODBC Connector
Replies: 8
Views: 12748

1. First deadlocking the database is more complicated than just running somethign on one node. At a mininmum you can decrease the array and transaction size to decrease the number of records effected by each node performing an upsert. The SQl Server table itself can be tuned by your DBA. 2. If you d...