Hi
We are trying to read an Avro file using file connector/webhdfs. I am just specifying the name node (host name) and the path to the .avro file, user name and password for the hdfs access
When i run the job, i get the message, file not found or you don't have permissions. I see the file and permissions are read/write for all. Has anyone faced this issue?
File Connector with Avro / WebHDFS issue
Moderators: chulett, rschirm, roy
First things first - has your site applied patch JR54938 to enable Avro support? Check the Version.xml file on the base install directory of the server if you are not sure.
http://www-01.ibm.com/support/docview.w ... wg24041535
http://www-01.ibm.com/support/docview.w ... wg24041535
Have you added the required Hadoop libraries to the CLASSPATH? The list is documented in the updated Guide to Accessing Files documentation.
The only way to get the new guide (i46defcn.pdf) that I know of is to download the patch from Fix Central. Its in the tar file with additional documentation on the patch.
There's also a list of Avro restrictions in a separate txt file with the patch.
The only way to get the new guide (i46defcn.pdf) that I know of is to download the patch from Fix Central. Its in the tar file with additional documentation on the patch.
There's also a list of Avro restrictions in a separate txt file with the patch.
Hi,
for the 3rd party jar files, should they be copied from the server(hadoop distribution) to the engine server? i see that the document specifies 3 jar files. i am assuming they will be on the server where hadoop distribution is installed and we should copy them manually to the engine server and place in some folder and have that folder in the CLASSPATH? is that the right way to do it? thank so much for your help
for the 3rd party jar files, should they be copied from the server(hadoop distribution) to the engine server? i see that the document specifies 3 jar files. i am assuming they will be on the server where hadoop distribution is installed and we should copy them manually to the engine server and place in some folder and have that folder in the CLASSPATH? is that the right way to do it? thank so much for your help