Hadoop Connectivity BDFS : Path of libhdfs.so in datastage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
TNZL_BI
Premium Member
Premium Member
Posts: 24
Joined: Mon Aug 20, 2012 5:15 am
Location: NZ

Hadoop Connectivity BDFS : Path of libhdfs.so in datastage

Post by TNZL_BI »

Hi All,

I am in the process of using the BDFS to connect to Hadoop . I have gone through the steps and there is one step that states the following

To use the Big Data File stage, you must ensure that the stage can access the HDFS libhdfs.so shared library, its associated JAR libraries, and configuration files


I have tried searching this library file on my engine tier however havent been able to locate it. Am I supposed to copy this file from the Hadoop file system ???

Any input here will be very helpful .
Post Reply