Automation In Informatica Code Migration
Author : Shivakumar Krishnagouda Patil
Description :
This
mini project has been taken up as an initiative , in the view of
eradicating the duplication effort involved in Informatica
Infrastructure Support projects and also to decrease the project costing
by reducing the number resources (Administrators) who are carrying out
the duplication effort. This reusable component reduces the half of time
involved in carrying out the specified activity compared to the
traditional manual effort so that we can deliver the work to the
business within a short span of time. This component confirms accurate
work of productivity. User wait time can be reduced as most of the user
waits when their work to be done.
Features of automated deployment groups
1.Automated migrations.
2.Reduction of admin resources.
3. Automated backup system.
4.Automated recovery.(In case of version control).
5.Faster code move.
6.Less effort investment.
7.No manual intervention.
8.Automated sanity checks.
9.Automated alerting in case of migration failures.
10.Time saving.
11.Bulk amount of objects can be migrated in a single shot. Which is a kind of reusable component
12.Migration logs can be captured for analysis.
13.The same deployment workflow, scripts can re-used in many environments for migrations.
1.Automated migrations.
2.Reduction of admin resources.
3. Automated backup system.
4.Automated recovery.(In case of version control).
5.Faster code move.
6.Less effort investment.
7.No manual intervention.
8.Automated sanity checks.
9.Automated alerting in case of migration failures.
10.Time saving.
11.Bulk amount of objects can be migrated in a single shot. Which is a kind of reusable component
12.Migration logs can be captured for analysis.
13.The same deployment workflow, scripts can re-used in many environments for migrations.
Automated deployment groups
Tech Stack Used :
Tool : Informatica 9.1 (Hot Fix 4)
Database : Oracle 11g (Repository Schema Versionised)
Operating System : Linux RedHat (x86_64-Bit OS)
Scripting Used :
Shell Scripting (ksh)
Structured Query Language (sql)
Testing Used :
Unit Testing :
Each of the scripts have been tested separately in order to verify the functionality of each of it.
Regression Testing:
Informatica workflows has been ran in different intervals of time to ensure whether the
scripts used in workflow would adversely affect Informatica Infrastructure.
Tech Stack Used :
Tool : Informatica 9.1 (Hot Fix 4)
Database : Oracle 11g (Repository Schema Versionised)
Operating System : Linux RedHat (x86_64-Bit OS)
Scripting Used :
Shell Scripting (ksh)
Structured Query Language (sql)
Testing Used :
Unit Testing :
Each of the scripts have been tested separately in order to verify the functionality of each of it.
Regression Testing:
Informatica workflows has been ran in different intervals of time to ensure whether the
scripts used in workflow would adversely affect Informatica Infrastructure.
Advantages of automated deployment groups
- User wait time can be reduced as most of the user waits when their code can be moved to target environment.
- Effective use of automated deployment groups add value to the project and reduces the cost .
- Ensures to business that accurate work of migrations.
- Admin resources can be reduced where multiple admins used to do the multiple migrations where as in automated deployment a single admin can handle multiple migrations. (In traditional system 5 admins used to do the migration a single admin resource can handle with the help of automated deployment group)
- Infa admin burden can be reduced – where in In traditional migration activity admin used to select the individual objects (check in /check out) and to migrate, which was very time consuming through a repository manager ,but with automated scripts it’s a piece of cake all the objects will be added in a single shot.
- XML backup of the objects will be taken automatically by the script and which will send as an email with an attachment.
- Automated deployment job can be scheduled to respective timings.
- Admins will not be having any confusion as compared to normal traditional migrations –
- which objects are missed and which objects needs to be validated everything will be taken care by scripts.
- Once the Objects are migrated , script will be sending the email with time-stamp of the objects migrated as a part of sanity check.
- Automated deployment groups reduces the un-necessary duplication works.
- In upgrade process huge amount of informatica folders can be migrated from one environment to other environment within a short span of time with the help of this automated deployment groups.
- In this automation poc only few scripts are developed and those are re-used based on the requirement by passing the parameters . For Ex : object_export.ksh script which is developed only once and can be called three times for exporting the different informatica objects Mappings, Sessions, Workflows.
- Scripts will take care of creating the deployment group, adding the objects to group and migrating the objects and once migration completes group will be automatically deleted.
Deployment groups overview :
Normally you know only
• Static deployment groups
• Dynamic deployment groups
But here is the automated deployment group:
Normally you know only
• Static deployment groups
• Dynamic deployment groups
But here is the automated deployment group:
Informatica Admin will be just responsible to
• Review the .csv spread sheet given by the user and
• Place the spread sheet to Informatica server source file path
• Schedule the deployment load
• Manage the deployment scripts
• High level sanity checks whether everything went smooth
• Review the .csv spread sheet given by the user and
• Place the spread sheet to Informatica server source file path
• Schedule the deployment load
• Manage the deployment scripts
• High level sanity checks whether everything went smooth
You provided the advantages., But can i get the solution please
ReplyDeleteThank you for excellent article.You made an article that is interesting.
DeleteTavera car for rent in chennai|Indica car for rent in chennai|innova car for rent in chennai|mini bus for rent in chennai|tempo traveller for rent in chennai
Keep on the good work and write more article like this...
Great work !!!!
The effectiveness of IEEE Project Domains depends very much on the situation in which they are applied. In order to further improve IEEE Final Year Project Domains practices we need to explicitly describe and utilise our knowledge about software domains of software engineering Final Year Project Domains for CSE technologies. This paper suggests a modelling formalism for supporting systematic reuse of software engineering technologies during planning of software projects and improvement programmes in Final Year Projects for CSE.
DeleteSoftware management seeks for decision support to identify technologies like JavaScript that meet best the goals and characteristics of a software project or improvement programme. JavaScript Training in Chennai Accessible experiences and repositories that effectively guide that technology selection are still lacking.
Aim of technology domain analysis is to describe the class of context situations (e.g., kinds of JavaScript software projects) in which a software engineering technology JavaScript Training in Chennai can be applied successfully
The Angular Training covers a wide range of topics including Components, Angular Directives, Angular Services, Pipes, security fundamentals, Routing, and Angular programmability. The new Angular TRaining will lay the foundation you need to specialise in Single Page Application developer. Angular Training
Yeah I will upload the scripts soon...
ReplyDeleteplease post the scripts asap
ReplyDeleteHi Haleem -
ReplyDeleteYeah Sure...
Many Thanks
Shivakumar
Hi ShivKumar,
ReplyDeleteWhen should we get those posts, Could you please let us know the time.
Thanks
Ratna -
ReplyDeletesoon will get it.
Many Thanks
Shivakumar
Using query, entire all objects can be exported,right. Why do we need to export mappings,sessions and workflows seperately?. What is automated deployment group?
ReplyDeleteDear Venkat-
ReplyDeleteFirst question comes here why you want to export all the objects ?
Here only the objects requested to be migrated needs to be exported not all the objects
Automated deployment group migrates the objects without any human intervention.
Please go through the article completely.
Many Thanks
Shivakumar
Hi Shiva, have you shared the script yet ? can you please share the same and also how to execute in order to test the functionality ?
ReplyDeleteHi Swarnalli -
ReplyDeleteSure ..will do that.I built the scripts and embedded in to informatica workflow which has been scheduled to run.
I did put this POC in to informatica portal idea section. I didn't hear back anything from them once I hear back I will upload here.
Many Thanks
Shivakumar
Thanks much Siva, this is really great to hear your response, will be waiting for your update. Can you please share your email ID , I've few ideas related to informatica automation, wanted to share and discuss with you. Also if you've any reading materials for Informatica 9 certification could you please share. I would like to take that certification program.
ReplyDeleteHey Siva,
ReplyDeleteYour POC will be really useful in my project. As of now we are doing all the migrations manually from one instance to other. If you can please e-mail this script to sm21474@gmail.com it would be really helpful.
Thanks
Siva,
ReplyDeleteWould also appreciate if you coud email the scripts to tienda123@gmail.ocm
hi ,
ReplyDeleteCan u email me the script waseem.siddiqui@aol.in
Siva,
ReplyDeleteCould you please send the script to hari1352@yahoo.com
Thanks
Hari Manne
Hi Siva,
ReplyDeleteWe are too migrating the code manually. Can you pls fwd me the scripts at bhaumikcrespo@yahoo.co.in
TIA
Bhaumik
Hi Siva,
ReplyDeleteCan you please send me the scripts to jpdadi@yahoo.com.
Thanks
Jay
gbsehge gun bd
ReplyDeleteWhere can i get the script
ReplyDeletePlease,send me also the scripts.
ReplyDeletecan you post the scripts ASAP
ReplyDeletecan you send us the scripts to my e-mail id: rk999e@gmail.com
ReplyDeleteReally helpful..
ReplyDeleteplease send the scripts to ashutoshkaushik86@gmail.com.
Hi Shiva,
ReplyDeletePlease send the scripts to msreddy85@gmail.com
Hi
ReplyDeleteCan you please send the scripts to bharath.rbr@gmail.com
Hi
ReplyDeleteCan you please send the scripts to venki81in@gmail.com
Can you please pass me the scripts to my email-id : northshields_uk@hotmail.co.uk
ReplyDeletemany Thanks in advance .... cheers mite ...
Can any one email me the script vjnimmagadda6@gmail.com.
ReplyDeleteHi,
ReplyDeleteCan you please mail the scripts to pratheeshvarnan@gmail.com
can you send me the scripts to venkat_tn@rediffmail.com
ReplyDeleteCan you send me the scripts to herryjwong@gmail.com
ReplyDeletecan you send me the scripts to balagj709@gmail.com
ReplyDeleteHi Siva, Request you to send me the scripts to mail.nithyaj@gmail.com
ReplyDeleteHi Siva, we are trying to explore informatica version control, can you please email me the script to vijayasundar03@gmail.com
ReplyDeleteNice... can you share scripts... akumar.klp@gmail.com
ReplyDeleteHi All,
ReplyDeleteHave you guys received the scripts?. if Yes, Could you please forward the scripts to the mentioned e-mail id : Mohiddin8@yahoo.com
Appreciate your help.
Regards,
Mohiddin.
Can you please also email the scripts to melbaswapna@gmail.com
ReplyDeleteHello i have not got any reply from this blog. Will anyone be able to help me out with the scripts. If anyone has it can you please email the automation scripts to melbaswapna@gmail.com. Thank you in advance, Melba
ReplyDeleteblog articles has been shifted to you can post your comments over there.
ReplyDeleteHi,
ReplyDeleteDoes anyone have the scripts, can you please email me malka.pavan@gmail.com
I am working on Deployment groups and wanted to automate it.
Thanks
Pavan
From Raju... Hi Shiva.. Very helpful. Could u plz send those latest scripts to my email v4chiru@gmail.com
ReplyDeleteThanks for your quick help here.
Shiva,.. Still I didn't get this script... can u send to v4chiru@gmail.com
DeleteHi,
ReplyDeleteDoes anyone have the scripts, can you please email me tejes.br@gmail.com
I am working on towards automation of informatica health check post deploymennt.
Thanks
Tejesh
Siva, can you upload the scripts for this POC now? they seem to be really useful.
ReplyDeleteShiva,
ReplyDeleteAre you using contol files to resolve to conflict issue while informatica migration, please can you share the scripts or upload the scipts to your blog. we are in the process of Deploy automation, it would be great if you can upload the scripts or you can send scripts to nanda_doc@yahoo.com
Thanks
Please some one can forward me these scripts e.pavankumar74@gmail.com
DeletePlease some one can forward me these scripts e.pavankumar74@gmail.com
DeleteShiva,
ReplyDeleteCould you please share the scripts to adusumallisr.dwh@gmail.com
If anyone has scripts pls share to the above mail id.
Thanks,
Subba
Hi Is this solution available with anyone?
ReplyDeleteShiva,
ReplyDeleteCan you share the automated scripts for deployment to sh.kamarajugadda@gmail.com
Thanks,
hi shiva,
ReplyDeletecould you please share the code migration automation scripts to my mail id mahesh0308.dwh@gmail.com
thanks
mahesh
Shiva,
ReplyDeleteCan you share the automated scripts for deployment to magunta@gmail.com
Hi Shiva,
ReplyDeleteCould you share the shell and sql scripts to schandru.info@gmail.com
Thanks!
Hi Kumar,
ReplyDeletePlease could you share the shell and sql scripts to ndasijulius@gmail.com
Thanks
Can you please send the script to ur.sourish@gmail.com
ReplyDeleteCan you please send the script to patilkajal11@gmail.com
ReplyDeletecan you please send me at tapas.sinha@yhaoo.co.in
ReplyDeletePlease send me at katta.sunil@gmail.com
ReplyDeleteGood post and great approach. I am pleased to visit and very useful articles here. I hope you keep doing more sharing the post to the readers.
ReplyDeleteLinux Course in Chennai
best linux training in chennai
Spark Training in Chennai
Oracle Training in Chennai
Pega Training in Chennai
Oracle DBA Training in Chennai
Power BI Training in Chennai
Corporate Training in Chennai
Tableau Training in Chennai
Linux Training in T Nagar
Linux Training in Velachery
Can you please give the script to swami2sai@gmail.com
ReplyDeleteCan you please informatica admin videos and may i know what is the future?
ReplyDeleteCan you please give the automatic deployment script to tapas.sinha@yahoo.co.in
ReplyDeleteShiva,
ReplyDeletePlease Can you please give the automatic deployment script to rkmpg@yahoo.com
Shiva,
ReplyDeletePlease can you send the automatic deployment script to rkmpg@yahoo.com.
Thank you..
Please some one can forward me these scripts e.pavankumar74@gmail.com
DeleteShiva,
ReplyDeletePlease can you send the automatic deployment script to rtclock12@yahoo.com.
Thank you.
Shiva,
ReplyDeletePlease can you send the automatic deployment script to rtclock12@gmail.com
Thank you.
Hi Shiva,
ReplyDeleteCould you please send me your automation deployment scripts to me at kkishore36@gmail.com.
It will help us to implement the automation process of code deployment.
THnak you.
Hi ,
ReplyDeleteCould any one please share the script to automate the migration at shivam253029@gmail.com
Hi,
ReplyDeleteDoes anyone have the scripts, I am working on Deployment groups and wanted to automate it.
Hi shiva,
ReplyDeletedo you have the scripts, have you uploaded anywhere in any other website.
Nice article it is very useful thank you for sharing. oracle training in chennai
ReplyDeleteCan you please share the scripts.
ReplyDeleteHi,
ReplyDeletedo you have the scripts ?
please send me the script jean.mango@gmail.com
ReplyDeleteAre you looking for Big Data training in Chennai with placement opportunities? Then we, Infycle Technologies are with you to make your dream into reality. Infycle Technologies is one of the best Big Data Training Institute in Chennai, which offers various programs along with Big Data such as Oracle, Java, AWS, Hadoop, etc., in complete hands-on practical training with trainers, those are specialists in the field. In addition to the training, the mock interviews will be arranged for the candidates, so that they can face the interviews with the best knowledge. Of all that, 100% placement assurance will be given here. To have the words above in the real world, call 7502633633 to Infycle Technologies and grab a free demo to know more.Big Data Training in Chennai | Infycle Technologies
ReplyDeleteLets have a look at a recent news item that is quite
ReplyDeleteentertainmentbee.com
themoviesbio.com
petrefine.com
It will be more fun, and you won't have to worry about
thepetsabout.com
happylifestyletrends.com
restaurantsnearme-opennow
Hi, kindly share the scripts at gnnsprapa@gmail.com... would be really thankful to you..thanka
ReplyDeleteFinish the Get Big Data Certification in Chennai from Infycle Technologies, the best software training institute in Chennai which is providing professional software courses such as Data Science, Artificial Intelligence, Java, Hadoop, Selenium, Android, and iOS Development, etc with 100% hands-on practical training. Dial 7502633633 to get more info and a free demo and to grab the certification for having a peak rise in your career.
ReplyDeleteGet the Digital Marketing Training in Chennai from Infycle Technologies, one of the best software training institute, and Placement center in Chennai which is providing professional software courses such as Data Science, Artificial Intelligence, Cyber Security, Big Data, Java, Hadoop, Selenium, Android, and iOS Development, DevOps, Oracle, etc with 200% hands-on practical training. Dial 7504633633 to get more info and a free demo and to grab the certification for having a peak rise in your career.Get Digital Marketing Course in Chennai | Infycle Technologies
ReplyDeleteExcellent article and with lots of information. I really learned a lot here. Do share more like this.
ReplyDeleteBlue Prism Training in Chennai
Blue Prism Online Training
Blue Prism Course in Chennai
Do you need an urgent loan of any kind? Loans to liquidate debts or need to loan to improve your business have you been rejected by any other banks and financial institutions? Do you need a loan or a mortgage? This is the place to look, we are here to solve all your financial problems. We borrow money for the public. Need financial help with a bad credit in need of money. To pay for a commercial investment at a reasonable rate of 3%, let me use this method to inform you that we are providing reliable and helpful assistance and we will be ready to lend you. Contact us today by email: daveloganloanfirm@gmail.com Call/Text: +1(501)800-0690 And whatsapp: +1 (501) 214‑1395
ReplyDeleteNEED A LOAN?
Ask Me.
Howdy! I could have sworn I’ve been to this site before but after browsing through some of the post I realized it’s new to me. I also fell on this
ReplyDeleteONE OF THE EASIEST WAY TO ACQUIRE REAL PASSPORTS ONLINE IN LESS THAN NO TIME Anyways, I’m definitely happy I found it and I’ll be bookmarking and
checking back frequently!