Search found 145 matches
- Tue Oct 12, 2021 10:43 am
- Forum: General
- Topic: Job Logs for most recent execution (XMETA SQL)
- Replies: 2
- Views: 11848
Job Logs for most recent execution (XMETA SQL)
I am working on writing a query to pull the most recent job logs from any given job in a specific project, where that jobs completed status is anything other than OK (no warnings etc). Figured I might as well post here in case someone has already done this, otherwise I will post the code here once c...
- Tue Oct 12, 2021 10:38 am
- Forum: General
- Topic: Hierarchy stage not working with flash gone now
- Replies: 3
- Views: 13825
Re: Hierarchy stage not working with flash gone now
We ran into the same issue, thankfully jobs already built with the stage continue to function. I did reach out to IBM at one point about this and they indicated that they intend to implement that stage into the web interface but no roadmap on when to expect that. We are currently planning to rebuild...
- Tue Jul 07, 2020 6:25 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Dynamic Parameter
- Replies: 1
- Views: 12238
I don't believe this is possible directly within a parallel job. I do this using Sequence jobs and UserVariable Activity stages. From what I understand of your need, you'd want a parallel job that performs your database query and outputs the result to a file, then using a UserVariable Activity stage...
- Wed Jul 01, 2020 1:26 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Identify Trouble Column on Transform Error
- Replies: 0
- Views: 12554
Identify Trouble Column on Transform Error
Hi guys, I feel like I must be missing something here. I have some files that I am bringing in from a CSV, due to datastage's quirks we bring in all fields as VarChar initially then transform them in an TRANSFORM stage to what the intended data type should be. My biggest issue is when I have many fi...
- Thu Jul 18, 2019 10:15 am
- Forum: Cognos (IBM BI)
- Topic: Cognos 11.1.3 page load speed issue
- Replies: 0
- Views: 29037
Cognos 11.1.3 page load speed issue
Hi everyone, figured I would ask here in case someone has run into this. I do have an open ticket with IBM as well so if they find anything I will update this for everyone. Basically we have an issue with our Cognos after we upgraded to 11.1.3 from 11.0.9. This was an in-place over the top upgrade. ...
- Thu Jun 27, 2019 5:12 pm
- Forum: General
- Topic: Sequential(CSV) file structure validation?
- Replies: 5
- Views: 6168
Looks like CSV Lint might work. I was considering writing my own, may still do that but I will research some other tools that already exist first.
https://csvlint.io/
https://csvlint.io/
- Thu Jun 20, 2019 1:33 pm
- Forum: General
- Topic: Sequential(CSV) file structure validation?
- Replies: 5
- Views: 6168
Sequential(CSV) file structure validation?
Hi, I have a potential issue I am hoping to circumvent before it happens (matter of time). We have a few external sources that we have to bring in from sequential files. The issue is that a few of these have to be manually generated by that department. It is only a matter of time before someone inco...
- Tue Jun 18, 2019 11:23 am
- Forum: General
- Topic: Include = sign in Execute Command argument list?
- Replies: 3
- Views: 4147
- Mon Jun 17, 2019 6:31 pm
- Forum: General
- Topic: Include = sign in Execute Command argument list?
- Replies: 3
- Views: 4147
Include = sign in Execute Command argument list?
Good afternoon everyone, I am having an issue using an Execute Command stage in a sequence job. Scenario is that I have a bat file I need to call and pass a series of arguments to it. The problem child is the password that I have to pass as it contains an = sign. I'm just doing this as plain text fo...
- Tue Apr 30, 2019 10:36 pm
- Forum: General
- Topic: DataStage Job Reports 403
- Replies: 2
- Views: 3209
DataStage Job Reports 403
Hi Everyone, I am in the process of documenting our nightly processing jobs into a wiki and I wanted to include links to the DataStage generated reports for the jobs. I create the reports and I can view them just fine, but when I embed them into my wiki, those URLs no longer work, citing an HTTP 403...
- Tue Jan 29, 2019 7:17 am
- Forum: General
- Topic: DataQuality Notifications for invalid data
- Replies: 3
- Views: 3973
Thanks Ray! I have been looking into this for some time now. Part of an issue I have is that it appears our IA setup might have some issues. I am working with IBM on that but in the meantime I was hoping you could point me in the right direction for some good use examples/training how to use the exc...
- Fri Jan 18, 2019 12:01 pm
- Forum: General
- Topic: DataQuality Notifications for invalid data
- Replies: 3
- Views: 3973
DataQuality Notifications for invalid data
Hi Everyone! I wasn't sure where to put this so into General it goes. We are looking to implement some awareness of some kind in regards to Data Quality. One example of our issues: we have several jobs that build unique business keys by concatenating several fields together. An issue can arise when ...
- Wed Nov 28, 2018 2:34 pm
- Forum: General
- Topic: Job Sequence: Downgrade warning message to info?
- Replies: 8
- Views: 6390
Ok, I did some more research and ended up just creating a sequence that calls the DSSendMessage routine straight up. I have a couple of UserVariables Activity stages that are used to build the message and recipients. This seems to work fine and won't return a complete job warning if the mail relay r...
- Wed Nov 21, 2018 6:24 am
- Forum: General
- Topic: Job Sequence: Downgrade warning message to info?
- Replies: 8
- Views: 6390
Which that may have been our issue all along for that. Many of our jobs are OK to continue if they finish with warning, and I believe the biggest thing was running through sequence logic with the jobs it calls set to validate only, as a test measure. If I recall correctly, which its possible that I ...
- Tue Nov 20, 2018 7:24 am
- Forum: General
- Topic: Job Sequence: Downgrade warning message to info?
- Replies: 8
- Views: 6390
No problem at all, I appreciate the discussion! Any particular reason to use DSJS over the actual job codes? I only ask as we switched most of our links to use the actual job status code instead of RUNOK or RUNWARN. We did this due to datastage not correctly triggering on a RUNOK at times. When we s...