DSXchange

Now we are planning to read the binary file, read the header column and split the records based on record type and give cobol copybook based on record types for parsing. Problem 1 We are not able to read the file as it has different record types. Any suggestions for implementing a solution for this...

When it is populated should make no difference. Assign the list to the parameter that you want to use, and make sure it is in the right format. There is nothing that would change the evaluation based on when the list is generated (static vs dynamic).

Assuming that your production DB is different than your lower environment(?), have you isolated the problem to DataStage? [Do the queries run in the same amount of time on the DB directly in both places? Can you connect from a different tool using the same method and run the queries faster than DS?,...

Looks like you need to do some aggregation or remove duplicates as well (group by)

What do you need the 10 records for? If it is just a straight copy, use the Copy stage. I'm guessing it is more complex than that. If you need just part of the inbound record for each of the outbound, Copy is still a good choice. If you need to pivot the results or perform some sort of derivation to...

It depends on what the criteria are for your history. Type 1, type 2, etc. This will also be influenced by the type of reporting that will be needed from the archived data - and if there is going to be a need to be able to restore the data from your archive. CDC is commonly used. But if the needs do...

harish841913, Archiving can be a medium to very large scale project. In this case, it sounds like you are being asked to be the technical solution architect (or similar) role. Yet, you are asking for a free site, full of volunteers, to give you a plan for doing this? I hope, for your sake, that this...

Hi Prasant, With your code being one-way connections (A->E is not the same as E->A), and you doubling all of your connections, it makes sense that you are getting your paths in multiple - with each path duplicated in reverse (This is what is happening, correct?) The simplest solution I can think of ...

There will be a log directory in your system with the name 'ora.3317770.688603.3.log.bad' The location is dependent upon your system setup. Find this file and look at it. It is a text file, so you can use your favorite editor (or just use 'cat' or 'more' or 'less') to view the contents and find the ...

C-B-A | | D----E---F | | G---H Is this what you mean? And you want to be able to detect both cycles and divide it like this: E---F | | G---H and C-B-A | | D----E I hope you understand that this is a very difficult puzzle for DataStage to solve, simply because of how each stage gets to look at the d...

I would expect that you would handle that in a Transformer stage. Depending on what is easier, you could check for valid numbers or search for 'special characters'. I'm not sure what your definition of a special character is for this derivation. From the example, it looks like anything that is not a...

If you could check on that - I believe there are steps that the DBAs have to take to enable Unicode in the database. If they have not been done, then it doesn't matter what you do with DataStage (well almost - there are some not-worthwhile ways you can 'hide' Unicode but it would take some custome e...

An alternative would be to have a branch in your sequencer that it goes to if the file is not found. An execute command there does a sleep nnn to get you your 2 hours. Then you perform your check for the file again using ls and your file pattern. Abort if not found, merge the flow back in to the res...

Is Unicode enabled on the target table? Is Unicode setup on all intermediate links in the job(s) between the good source file and the database load? Can you confirm (maybe with a copy stage to a sequential file or dataset) if the data being pushed to the database has retained the special characters ...

Don't work FranklinE, Your secret is safe with me. But I will agree that COBOL has its own set of challenges and quirks. A standard is what is used barely enough such that the developers who come later can clearly see where it was not used. I'll offer a corollary to your statement: A standard is onl...