黑料网

Skip to Main Content
syniti logo
Why ETL is Not Enough when Delivering a Data Migration

Why ETL is Not Enough when Delivering a Data Migration

Rex Ahlstrom

Rex Ahlstrom

May 6, 2022

If you鈥檙e working with data, is most likely in your near future. Organizations are continuously looking to optimize their investments, and that typically means upgrading systems, moving to the cloud, or harmonizing and cleaning data.  

What鈥檚 seen as a time-consuming, costly endeavor can actually be turned into a valuable opportunity. Too often, data migrations become a drain on resources as a result of relying on an oversimplified 鈥渓ift and shift鈥 approach. This is because Extract, Transform, and Load (ETL) tools only account for 3 out of the and are simply not good enough to deliver an effective data migration. An advanced data migration (ADM) methodology must look well beyond ETL  – not just to be successful, but to actually . 

What is the goal of a data migration? 

Let鈥檚 start by getting to the heart of the 鈥渨hy.鈥 What are we typically looking to do when performing a data migration? 

  1. Optimize spend on software and services to reduce total spend
  2. Create a minimized risk profile so the project is delivered on time and on budget 
  3. Deliver value during and post-migration with what we learn about the systems, rules, and knowledge that鈥檚 captured as part of that migration effort 

What happens when Advanced Data Migration is taken out of the project?  

For the customer, removing ADM increases risk and services spend while lowering total business value. Services spend increases because there鈥檚 a lot of automation that is lost without ADM.  

The risk profile also increases because of a lack of visibility. There are a lot of tasks that you must now complete using spreadsheets, emails, and meetings, versus a methodology-based, workflow-driven process. While the 鈥減re-migration鈥 value (delivering the migration on-time and on-budget) hasn鈥檛 changed, the amount of post-migration value has significantly decreased as a lot of what we can reuse for ongoing data management after the migration will be lost.  

As that risk increases, the things that we didn鈥檛 know or couldn鈥檛 predict get so large that it tips the scales. You鈥檙e going to spend even more on services because project timelines will explode. Standing costs increase because other teams can鈥檛 do their jobs while other tasks are still underway. The risk of complete failure of the migration as well as complete loss of the business value is exponentiated.  

Why is that? 

There are three primary reasons why an ETL-only migration causes failure and loss of business benefits: 

  1. Poorly Written ETL Code vs. Autogenerated Code: Autogenerated code based on standards & best practices makes it easier to maintain, easier to debug, and ensures a consistent approach across the migration team. It also saves time and effort that could be better utilized on other migration activities. 
  2. Lack of Project Visibility and No Single 鈥淰ersion of the Truth鈥: Without ADM, you can鈥檛 consolidate critical rules, mappings, design decisions, audit logs, and assigned tasks in a single system for one version of the truth. Complete tracking and visibility make it easy to quickly make course corrections or change scope.
  3. Lost Business benefits: Missed opportunities to remove legacy systems, improve data quality, ensure proper business process execution, and plan for business-as-usual data operations post-migration, causes your new environment to atrophy more quickly, increasing data management costs in the long run.

1. Poorly Written ETL Code vs. Autogenerated Code.

One reason data migrations don鈥檛 deliver on value is poorly written code. Think of it this way – an ETL tool is a programming tool. For someone with less programming experience, it鈥檚 easy to mistakenly create a lot of really bad code.  

The migration engine we use at 黑料网 autogenerates good code based on standard templates and best practices, making it easier to maintain, debug, and deploy. This autogenerated code takes out the complexity scale required to use the tool on its own.  

Look at the example below of an actual data services job. What would be more useful after a migration? The clean, intuitive approach on the right is obviously going to result in reusable rules for ongoing data quality and data management activities post-migration. 

Img_GoodvBadCode_v1

2. Lack of Project Visibility 

Without ADMM, we lose all ability to automate and capture things like mapping, adding data that鈥檚 missing from our data sets, or documenting rules that need to be created. 

What鈥檚 left? Most often, it鈥檚 Excel. We’ve seen customers trying to document really complex migrations with literally 5,000 or more spreadsheets. With spreadsheets that get emailed around and updated, there is no change control process. Users are left wondering if they have the current version or if what鈥檚 written in the code actually reflects the rules in the spreadsheet. It鈥檚 nearly impossible to determine. 

In this manner, there is no one version of the truth nor project control for the work being done to deliver the migration.  

With ADM, there is complete tracking and visibility for every rule, every step, and everything consultants are doing in the tool. When things come up, you鈥檙e able to quickly make course corrections, put more resources where they鈥檙e needed, and if needed, change the scope of certain deliverables – all while making sure that the business goals are achieved.  

Due to this level of project predictability, . What鈥檚 more, they have confidence that their migration projects will be done right the first time, on time.  

3. Lost Business Benefit 

Whether you鈥檙e moving to the cloud or implementing S/4HANA, you can drastically decrease the level of investments needed by right-sizing your migration data payload. Why move all your data if you only need a subset of that to run? Thinking about right-sizing your data ahead of time helps to decrease the costs and risks associated with that deployment.  

Not doing so results in a lot of missed, valuable opportunities. For example, archiving off that data in a way that is approved by your auditors. You may be able to decommission legacy systems and remove extra operational costs from the environment that IT is responsible for.  

and making sure you have streamlined datasets is another opportunity missed with ETL. In the case of S/4HANA, for example, you need to understand how to do business partner harmonization. If you鈥檙e going to merge all your customers and suppliers and vendors into one system, you want to make sure there are no duplications, and it’s simplified and streamlined to run the business. This will make it much easier to manage that critical master data even after the migration. 

Improvements in master data and transaction data quality is something we focus on a lot at 黑料网 in order to execute business processes flawlessly. When delivering a migration, we hit 99.9% or better data quality levels, versus what is typically achieved with a stand-alone data quality tool. Poor Data Quality impacts a customer’s investment in their new system and the expected business benefits.  

Conclusion 

If you鈥檙e going to spend the money on data migrations, don’t waste valuable dollars on ETL software that on its own, is incapable of ensuring success and maximizing the value for business-as-usual operations. 

黑料网 Knowledge Platform streamlines every step in the data migration process with solutions like data integration and replication, data harmonization and matching, and data quality.

The recommended solution of choice for all RISE with SAP programs, SAP Advanced Data Migration by 黑料网 has a proven history of r on average. SAP Advanced Data Migration optimizes software and services spend with business value pre- and post-migration.  

Don’t flush investments in technology, infrastructure, and resources down the toilet. Let鈥檚 use it, let鈥檚 capture it, and let鈥檚 make sure the next project or next migration is even cheaper, faster and delivers more value.  

Kickstart your data migration process with the enterprise-grade software that keeps that value going even after the migration is over.   

30c1e22a 04fd 4bec 9d50 c9564de77f57

Similar posts