Search found 23 matches
- Mon Jul 17, 2017 9:14 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: subtract one day from date
- Replies: 5
- Views: 19764
- Sun May 14, 2017 10:04 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Loading data from HDFS file into HIVE table using Datastage
- Replies: 7
- Views: 11230
- Sun Apr 30, 2017 7:29 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Error in Using File Connector stage
- Replies: 11
- Views: 13504
Moreover , personally I think it is lot more simpler to use the file connector stage in comparison to the BDFS stage. the BDFS stage in fact is more suited for the Big Insight Hadoop version distributed by IBM ( that doesn't mean it cant connect to other Hadoop versions ). The file connector stage a...
- Sun Apr 30, 2017 6:01 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Loading data from HDFS file into HIVE table using Datastage
- Replies: 7
- Views: 11230
- Sun Apr 30, 2017 6:00 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hive Connector Vs ODBC Connector
- Replies: 4
- Views: 4601
- Sun Apr 30, 2017 5:58 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: File Connector stage :-Java related errors
- Replies: 3
- Views: 3881
Hi All , Just wanted to close this thread saying that I can now connect Hadoop using the file connector stage. there were 2 main issues. Hadoop cluster had 1 Name node and 2 Data nodes. Ideally opening the firewalls for Name node and corresponding Name Node Port should suffice. However the JOb was f...
- Sun Apr 30, 2017 5:56 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Error in Using File Connector stage
- Replies: 11
- Views: 13504
Hi All , Just wanted to close this thread saying that I can now connect Hadoop using the file connector stage. there were 2 main issues. Hadoop cluster had 1 Name node and 2 Data nodes. Ideally opening the firewalls for Name node and corresponding Name Node Port should suffice. However the JOb was f...
- Sun Apr 23, 2017 10:46 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Error in Using File Connector stage
- Replies: 11
- Views: 13504
Hey All, I am trying to use the File Connector Stage to put a file on HDFS. I am getting the following issue when I write a file on HDFS File_Connector_35,0: An exception occurred: java.lang.Exception: Failed to write to file /appl/iip_data/ssd01/data/abhi.txt: HTTP/1.1 403 Forbidden Atul / Satish -...
- Sun Apr 23, 2017 3:28 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: connection issues between hive and datastage 11.3.1
- Replies: 2
- Views: 5493
- Sun Apr 23, 2017 3:23 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: File Connector stage :-Java related errors
- Replies: 3
- Views: 3881
- Sun Apr 23, 2017 5:02 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hive Connector Stage and isjdbc.config file set up
- Replies: 5
- Views: 6576
Hi Chulett Thanks for your response. This issue is now fixed . I contacted the Hadoop administration team and realized there was some patching activity because of which this issue was cropping. The new problem now is that the performance of the Hive connector stage is pathetic. Opened a case with IB...
- Sun Apr 23, 2017 4:00 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: File Connector stage :-Java related errors
- Replies: 3
- Views: 3881
File Connector stage :-Java related errors
Hi All , I am using a File Connector stage to write to the HDFS ecosystem. I have used the HttpFS method to connect to the HDFS ecosystem. However when I run the Job I am getting a time out error. The exact details are given below :- File_Connector_31,0: com.ascential.e2.common.CC_Exception: An exce...
- Tue Apr 18, 2017 9:37 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hadoop Connectivity BDFS : Path of libhdfs.so in datastage
- Replies: 0
- Views: 2567
Hadoop Connectivity BDFS : Path of libhdfs.so in datastage
Hi All, I am in the process of using the BDFS to connect to Hadoop . I have gone through the steps and there is one step that states the following To use the Big Data File stage, you must ensure that the stage can access the HDFS libhdfs.so shared library, its associated JAR libraries, and configura...
- Mon Apr 10, 2017 10:43 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hive Connector Vs ODBC Connector
- Replies: 4
- Views: 4601
Hive Connector Vs ODBC Connector
Hi All , I have recently developed a job to connect to the Hive database in the Hadoop Ecosystem. Now I have used two methods to connect to the Hive database which are :- 1. ODBC Connector 2. Hive Connector However , I am facing massive performance issues with the hive connector stage . Its taking h...
- Mon Apr 10, 2017 6:22 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Loading data from HDFS file into HIVE table using Datastage
- Replies: 7
- Views: 11230
Hi , I have been facing a similar issue. I am using the Hive Connector Stage to load / extract data . However , the speed is dismal . Is there something that we can do to improve the performance of loading into Hive. Having said that , I dont expect Hive loading to be as fast as any other database ,...