DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 24 matches
Author Message
 Topic: subtract one day from date
TNZL_BI

Replies: 5
Views: 11454

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jul 17, 2017 9:14 pm   Subject: subtract one day from date
Thanks Rob4732 - that worked perfectly Smile
 Topic: Loading data from HDFS file into HIVE table using Datastage
TNZL_BI

Replies: 6
Views: 1592

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun May 14, 2017 10:04 pm   Subject: Loading data from HDFS file into HIVE table using Datastage
Exactly. I have been using the file connector stage now and its a better / faster way to put in data onto Hadoop rather than use a Hive or ODBC connector stage.
The other advantage is that the file ...
Resolved
 Topic: Error in Using File Connector stage
TNZL_BI

Replies: 11
Views: 1979

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun Apr 30, 2017 7:29 pm   Subject: Error in Using File Connector stage
Moreover , personally I think it is lot more simpler to use the file connector stage in comparison to the BDFS stage. the BDFS stage in fact is more suited for the Big Insight Hadoop version distribut ...
 Topic: Loading data from HDFS file into HIVE table using Datastage
TNZL_BI

Replies: 6
Views: 1592

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun Apr 30, 2017 6:01 pm   Subject: Loading data from HDFS file into HIVE table using Datastage
I have been suggested by IBM to run some patches. Will install this and then update .
 Topic: Hive Connector Vs ODBC Connector
TNZL_BI

Replies: 1
Views: 387

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun Apr 30, 2017 6:00 pm   Subject: Hive Connector Vs ODBC Connector
I have just got some patches to be installed on my services / engine tier as suggested by IBM . This may improve the speed. Will do that and then revert back with my findings
 Topic: File Connector stage :-Java related errors
TNZL_BI

Replies: 3
Views: 427

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun Apr 30, 2017 5:58 pm   Subject: File Connector stage :-Java related errors
Hi All , Just wanted to close this thread saying that I can now connect Hadoop using the file connector stage.

there were 2 main issues. Hadoop cluster had 1 Name node and 2 Data nodes. Ideally op ...
Resolved
 Topic: Error in Using File Connector stage
TNZL_BI

Replies: 11
Views: 1979

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun Apr 30, 2017 5:56 pm   Subject: Error in Using File Connector stage
Hi All , Just wanted to close this thread saying that I can now connect Hadoop using the file connector stage.

there were 2 main issues. Hadoop cluster had 1 Name node and 2 Data nodes. Ideally op ...
Resolved
 Topic: Error in Using File Connector stage
TNZL_BI

Replies: 11
Views: 1979

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun Apr 23, 2017 10:46 pm   Subject: Error in Using File Connector stage
Hey All,

I am trying to use the File Connector Stage to put a file on HDFS. I am getting the following issue when I write a file on HDFS

File_Connector_35,0: An exception occurred: java.lang.Exc ...
 Topic: connection issues between hive and datastage 11.3.1
TNZL_BI

Replies: 1
Views: 919

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun Apr 23, 2017 3:28 pm   Subject: connection issues between hive and datastage 11.3.1
Yes it is and we have just managed a connection to the Hive database using the ODBC stage and Hive Connector
 Topic: File Connector stage :-Java related errors
TNZL_BI

Replies: 3
Views: 427

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun Apr 23, 2017 3:23 pm   Subject: File Connector stage :-Java related errors
Thanks Chulett .

That's what I am also thinking but not sure where to do that from. I checked on the net and on some places it is mentioned to perhaps log on to the websphere and make changes to th ...
Resolved
 Topic: Hive Connector Stage and isjdbc.config file set up
TNZL_BI

Replies: 3
Views: 519

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun Apr 23, 2017 5:02 am   Subject: Hive Connector Stage and isjdbc.config file set up
Hi Chulett

Thanks for your response. This issue is now fixed . I contacted the Hadoop administration team and realized there was some patching activity because of which this issue was cropping.

...
 Topic: File Connector stage :-Java related errors
TNZL_BI

Replies: 3
Views: 427

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun Apr 23, 2017 4:00 am   Subject: File Connector stage :-Java related errors
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi All ,

I am using a File Connector stage to write to the HDFS ecosystem. I have used the HttpFS method to connect to the HDFS ecosystem. However when I run the Job I am getting a time out error. ...
 Topic: Hadoop Connectivity BDFS : Path of libhdfs.so in datastage
TNZL_BI

Replies: 0
Views: 287

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Apr 18, 2017 9:37 pm   Subject: Hadoop Connectivity BDFS : Path of libhdfs.so in datastage
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi All,

I am in the process of using the BDFS to connect to Hadoop . I have gone through the steps and there is one step that states the following

To use the Big Data File stage, you must ensure ...
 Topic: Hive Connector Vs ODBC Connector
TNZL_BI

Replies: 1
Views: 387

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Apr 10, 2017 10:43 pm   Subject: Hive Connector Vs ODBC Connector
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi All ,

I have recently developed a job to connect to the Hive database in the Hadoop Ecosystem. Now I have used two methods to connect to the Hive database which are :-

1. ODBC Connector
2. ...
 Topic: Loading data from HDFS file into HIVE table using Datastage
TNZL_BI

Replies: 6
Views: 1592

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Apr 10, 2017 6:22 pm   Subject: Loading data from HDFS file into HIVE table using Datastage
Hi , I have been facing a similar issue. I am using the Hive Connector Stage to load / extract data .

However , the speed is dismal . Is there something that we can do to improve the performance of ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours