DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
This topic has been marked "Resolved."
Author Message
Vrisha



Group memberships:
Premium Members

Joined: 15 Jul 2017
Posts: 55
Location: Texas,USA
Points: 650

Post Posted: Thu Aug 10, 2017 9:26 am Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Windows
Additional info: Unable to get the data out of the URL
Scenario- Pull the data from url and load into sequential file

Job Design- WebServices Client---->Sequential File

steps
1) Got the WSDL file 'https://dart.service-now.com/incident.do?WSDL' and imported the table definition . Table definitions ---> WebServices ---> able to see the getRecords_IN, getRecords_MSGIN, getRecords_MSGOUT etc.

2) Now using Webservices Client stage --> Webservice operation ---> WebService Metadata Imported ---> gave the link of url 'https://dart.service-now.com/api/now/table/incident?sysparm_display_value=all' and saved the data to my local drive and opened from local drive.

Metadata structure - example- column name - Active
But in file - Example - Column name - Active have Display value and value.

I am unable to drag the data out of the website to 'Webservices Explorer' .

Imported the metadata structure but stuck with importing the data relevant to metadata.

Please let me know what I should do .Thanks.

_________________
Suja
Vrisha



Group memberships:
Premium Members

Joined: 15 Jul 2017
Posts: 55
Location: Texas,USA
Points: 650

Post Posted: Fri Aug 11, 2017 8:58 am Reply with quote    Back to top    

I have a quick question. When we are getting the WSDL file, it should have both the metadata structure and the data inside it. Am I correct?

Because when I checked for WSDL file example, it is mentioned it should have all the elements like definitions, type, message, porttype, Binding , ports and service.

At present, I am getting a wsdl file only with metadata structure and another url link which has only the data. Checking with you if my understanding is correct. Thanks.


WSDL file with metadata structure-


<?xml version="1.0" encoding="UTF-8"?>
<wsdl:definitions targetNamespace="http://www.service-now.com/incident" xmlns:wsdl="http://schemas.xmlsoap.org/wsdl/" xmlns:mime="http://schemas.xmlsoap.org/wsdl/mime/" xmlns:tns="http://www.service-now.com/incident" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:http="http://schemas.xmlsoap.org/wsdl/http/" xmlns:soap="http://schemas.xmlsoap.org/wsdl/soap/" xmlns:soapenc="http://schemas.xmlsoap.org/soap/encoding/">
<wsdl:types>
<xsd:schema elementFormDefault="unqualified" targetNamespace="http://www.service-now.com/incident">
<xsd:element name="getKeys">
<xsd:complexType>
<xsd:sequence>
<xsd:element maxOccurs="1" minOccurs="0" name="active" type="xsd:boolean"/>
<xsd:element maxOccurs="1" minOccurs="0" name="activity_due" type="xsd:string"/>
<xsd:element maxOccurs="1" minOccurs="0" name="additional_assignee_list" type="xsd:string"/>
<xsd:element maxOccurs="1" minOccurs="0" name="approval" type="xsd:string"/>
<xsd:element maxOccurs="1" minOccurs="0" name="approval_history" type="xsd:string"/>
<xsd:element maxOccurs="1" minOccurs="0" name="approval_set" [/u]

url with Data alone [/u]
{"result":[{"parent":"","made_sla":"true","caused_by":"","watch_list":"","upon_reject":"cancel","sys_updated_on":"2017-06-26 21:37:51","child_incidents":"0","approval_history":"","number":"INC0014775","resolved_by":{"link":"https://dart.service-now.com/api/now/table/sys_user/db876dc94fcce200902e3f828110c753","value":"db876dc94fcce200902e3f828110c753"},"sys_updated_by":"KMontee","opened_by":{"link":"https://dart.service-now.com/api/now/table/sys_user/db876dc94fcce200902e3f828110c753","value":"db876dc94fcce200902e3f828110c753"},"user_input":"","sys_created_on":"2016-07-29 21:16:00","sys_domain":{"link":"https://dart.service-now.com/api/now/table/sys_user_group/global","value":"global"},"state":"7","u_dartnet_wf_id":"","sys_created_by":"DBourinski","knowledge":"false","order":"","calendar_stc":"7885","closed_at":"2016-07-31 00:00:00",

_________________
Suja
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42273
Location: Denver, CO
Points: 217068

Post Posted: Fri Aug 11, 2017 10:01 am Reply with quote    Back to top    

Vrisha wrote:
I have a quick question. When we are getting the WSDL file, it should have both the metadata structure and the data inside it. Am I correct?

No, as you've found they are separate. The WSDL is the "xsd" and just the metadata. And the data is the data.

_________________
-craig

Watch out where the huskies go and don't you eat that yellow snow
Rate this response:  
Not yet rated
Vrisha



Group memberships:
Premium Members

Joined: 15 Jul 2017
Posts: 55
Location: Texas,USA
Points: 650

Post Posted: Fri Aug 11, 2017 10:29 am Reply with quote    Back to top    

Thanks for your prompt response, craig.

1) I have the metadata structure appearing in web services explorer and also in Table definition. Just I ran the job with metadata structure file, it ran fine without any error and it showed 1 processed row with all the fields populated with null values as we don't have data in that wsdl file (only metadata).

2)When I gave the Url link 'https://dart.service-now.com/api/now/table/incident?' in the metadata importer to access the data out and got it stored to my local drive and access using 'C:\Users\sujal\Documents\incident.json' in the address. Below the address bar, in left pane the data is displayed like this

{"result":[{"parent":"","made_sla":"true","caused_by":"","watch_list":"","upon_reject":"cancel","sys_updated_on":"2017-06-26 21:37:51","child_incidents":"0","approval_history":"","number":"INC0014775","resolved_by":{"link":"https://dart.service-now.com/api/now/table/sys_user/db876dc94fcce200902e3f828110c753","value":"db876dc94fcce200902e3f828110c753"},"sys_updated_by":"KMontee","opened_by":{"link"...etc

But nothing is showing in the web services explorer.

I don't know how to link the metadata structure with the data . What should I do? Where I am making a mistake? Please let me know.

_________________
Suja
Rate this response:  
Not yet rated
Vrisha



Group memberships:
Premium Members

Joined: 15 Jul 2017
Posts: 55
Location: Texas,USA
Points: 650

Post Posted: Fri Aug 11, 2017 1:53 pm Reply with quote    Back to top    

Since I am unable to figure out using WebServices client stage , now I changed to Hieararchical datastage.

I followed the steps in this url 'http://informationintegrationblog.blogspot.com/2014/08/how-to-invoke-rest-web-services-from.html'. But I am getting only zero rows.

When I tried to test using 'Test Assembly' feature in Assembly editor of Hiearchical stage, the error I am getting is

'java.lang.NoSuchMethodError: org/apache/http/conn/ssl/SSLSocketFactory.<init>(Ljava/lang/String;Ljava/security/KeyStore;Ljava/lang/String;Ljava/security/KeyStore;Ljava/security/SecureRandom;Lorg/apache/http/conn/ssl/TrustStrategy;Lorg/apache/http/conn/ssl/X509HostnameVerifier;)V
Test completed


Please let me know what I need to do. Thank you.

_________________
Suja
Rate this response:  
Not yet rated
Vrisha



Group memberships:
Premium Members

Joined: 15 Jul 2017
Posts: 55
Location: Texas,USA
Points: 650

Post Posted: Tue Aug 22, 2017 8:32 am Reply with quote    Back to top    

I resolved this problem using Hierarchical stage. Though the above java error is coming, I am able to pull the data from URL after I made changes in the 'Edit Assembly' option

1) Used the web services client stage--> web services option ---> download the datafile ( json) file to my desktop and created a metadata structure using the downloaded file in Schema library manager

2) In Hierarchical stage, Edit Assembly-->REST step -->'Security'tab-->changed the 'Authentication' to 'Basic'----> gave username & password

3)'Request' tab -->Changed the content type to 'application/json' to match with the 'Response' tab.

Now I am able to pull the data from the url

_________________
Suja
Rate this response:  
Not yet rated
eostic

Premium Poster



Group memberships:
Premium Members

Joined: 17 Oct 2005
Posts: 3724

Points: 29740

Post Posted: Wed Aug 23, 2017 5:47 am Reply with quote    Back to top    

Excellent. Glad you got it working. Most all vendors are moving away from SOAP --- nice and formal and structured, but far more complex than REST with JSON/XML. If you have an option to use SOA ...

_________________
Ernie Ostic

blogit!
Open IGC is Here!
Rate this response:  
Not yet rated
Vrisha



Group memberships:
Premium Members

Joined: 15 Jul 2017
Posts: 55
Location: Texas,USA
Points: 650

Post Posted: Wed Aug 23, 2017 6:38 am Reply with quote    Back to top    

Thank you, Ernie.

_________________
Suja
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours