DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 290 matches
Author Message
 Topic: Is File connector able to read orc partitioned files
joycerecacho

Replies: 4
Views: 1758

PostForum: General   Posted: Mon Apr 01, 2019 11:51 pm   Subject: Is File connector able to read orc partitioned files
Slightly off topic; I've been doing a little work with the Snowflake Connector in version 11.7, and it supports orc partitioning.

So the technology is in there. Joyce has found that (in v11.5 anyw ...
 Topic: Is File connector able to read orc partitioned files
joycerecacho

Replies: 4
Views: 1758

PostForum: General   Posted: Mon Apr 01, 2019 1:14 am   Subject: Re: Is File connector able to read orc partitioned files
Hello.

Did you find any solution for this issue?
I read txt file from HDFS using File Connector and have the same problem.
Actually most of times, I just rerun and it works perfectly - without an ...
Workaround Reported
 Topic: [File Connector] Not delimited Files
joycerecacho

Replies: 13
Views: 1133

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Feb 27, 2019 7:55 am   Subject: [File Connector] Not delimited Files
It didnt work here, so I let the solution like initially: I split the positional file cutting columns inside transformer.
Unfortunately, just a workaround for now.
 Topic: [File Connector] Failed to parse row
joycerecacho

Replies: 0
Views: 249

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Feb 27, 2019 12:17 am   Subject: [File Connector] Failed to parse row
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi everybody.

I am trying to read a txtfile from HDFS using the object "File Connector".
The file has about 720 millions of registers, 51 columns - the majority is varchar(200) and I can´t read it ...
Workaround Reported
 Topic: [File Connector] Not delimited Files
joycerecacho

Replies: 13
Views: 1133

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Feb 20, 2019 2:18 am   Subject: [File Connector] Not delimited Files
Hi Ray,
Could you help me?

Tks in advance.
 Topic: Stored Procedures in Oracle connector stage
joycerecacho

Replies: 13
Views: 12500

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Feb 11, 2019 11:56 pm   Subject: Stored Procedures in Oracle connector stage
The below should work for you. Note the semi-colons.

BEGIN DBMS_STATS.gather_table_stats(XXXXXXX); END;

This approach worked fine to me! (the only one)

Thank you so much.
Workaround Reported
 Topic: [File Connector] Not delimited Files
joycerecacho

Replies: 13
Views: 1133

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun Feb 10, 2019 11:06 pm   Subject: [File Connector] Not delimited Files
Try importing the Sequential File definition (not via the File Connector) then proceed as I earlier advised. You may need to share the result into the common metadata repository from DataStage Designe ...
Workaround Reported
 Topic: [File Connector] Not delimited Files
joycerecacho

Replies: 13
Views: 1133

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Feb 07, 2019 11:52 pm   Subject: [File Connector] Not delimited Files
Actually I couldn't find any site where people say exactly how to fill the field "Definition Source" when you choose File Format = "Implicit".

Nobody knows how it works, that´s the truth.
Workaround Reported
 Topic: [File Connector] Not delimited Files
joycerecacho

Replies: 13
Views: 1133

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Feb 07, 2019 2:28 am   Subject: [File Connector] Not delimited Files
Oh nice, Ray.

I am still having problems.

Actually I read that you can configure the properties of the 'File Connector' the way it can understand the fixed width of the fields:

* File format: ...
Workaround Reported
 Topic: [File Connector] Not delimited Files
joycerecacho

Replies: 13
Views: 1133

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Feb 07, 2019 1:14 am   Subject: [File Connector] Not delimited Files
hunfff
:/

I can´t read the full answear.
Sorry Ray ....
Workaround Reported
 Topic: [File Connector] Not delimited Files
joycerecacho

Replies: 13
Views: 1133

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Feb 06, 2019 9:52 am   Subject: [File Connector] Not delimited Files
Did you mean... in a transformer, as I did?
Cause I was thinking about solve it through File Connector only.
Workaround Reported
 Topic: [File Connector] Not delimited Files
joycerecacho

Replies: 13
Views: 1133

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Feb 06, 2019 1:27 am   Subject: [File Connector] Not delimited Files
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi everybody.

I am using 'File Connector' object to read txt files from HDFS. but some of them are not delimited, fields are positionals.

Example:
JoyceRecacho34 years oldBrasil

In other wo ...
 Topic: [HDFS] DataSet Not Deleted
joycerecacho

Replies: 0
Views: 439

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jan 28, 2019 5:19 am   Subject: [HDFS] DataSet Not Deleted
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi everybody.

DataStage here runs in a cluster and the '.apt' file has a dynamic configuration, which refers to 13 nodes with 2 instances each - except the 'conductor node'.

The thing is: when ...
 Topic: [Lookup Sparse] ODBC Connector & Node Map Constraint
joycerecacho

Replies: 0
Views: 471

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Dec 03, 2018 5:31 am   Subject: [Lookup Sparse] ODBC Connector & Node Map Constraint
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi everybody.

DataStage here is located in a cluster where Oracle can´t be installed, so alternatively "Unable to determine association between statement parameters and table columns. The connecto ...
Resolved
 Topic: [Clustered DataStage] ORA-01950: no privileges on tablespace
joycerecacho

Replies: 3
Views: 530

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Nov 30, 2018 2:28 am   Subject: [Clustered DataStage] ORA-01950: no privileges on tablespace
Ma Gosh, you are completely right.
It makes all sense.

Now it works ...
The action was right, but to the wrong user.

Thank you so much!!!
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours