CASE STUDY

Automated ETL Testing that Eased Decision-Making

Our incredible success story of how we went from being hired to perform only manual testing to implementing truly effective Automated ETL testing that enabled the stakeholders to identify key problems and make educated decisions.

E – LEARNING

ABOUT CASE STUDY

The Aim to Go Paperless

It is no easy task to transition to a paperless process especially when the work is heavily reliant on paperwork. Being a trading and warehousing company, everything from how goods were transferred, stored, and moved was tracked by paper. So when they transitioned away from paper, they could not afford to have even the smallest of the issues in their digital alternative as it will deeply impact their business. So they needed a bankable QA company to support them along every step of the transition with every type of testing that was needed.

HIGHLIGHTS

500+

Tables Tested with Automation

50+

Databases tested

7+ Years Partnership
On-time every time in all Sprints.
Parallel Testing of old & new features with manual & automation.

Tools we Used

PROBLEM STATEMENT

Ensuring Data quality

Cengage, a US-based educational content, technology, and services company that operates in more than 20 countries across the world was in need of an offshore software testing team to perform manual ETL testing. Since they provided services such as online classes, assignments, exams, and so on, there were individual reports for every book, student, instructor, course, platform, etc. So our primary goal was to identify issues such as source duplication, null values, and target duplication that were impacting the quality of their data.

OUR SOLUTION

Comprehensive test automation

Introduced automation testing to save countless man-hours.
Set up a Robust Reporting framework using Lemon Cheesecake & Snowflake.
Achieved CI/CD Integration by using Jenkins.
Improved Data Quality by introducing Data Profiling with the help of Looker.
Followed Agile methodology & supported every release without any delay.

What we did?

Introducing Test Automation

CI/CD Integration in an Agile Environment

Our Reporting Pattern

Data Profiling with Looker

Introducing Test Automation

Initially tasked with manual testing, we saw an opportunity for automation to save time and costs. We developed automation scripts in the LemonCheesecake framework using Python and demoed them to our clients, who were impressed and engaged us for automation testing. As firm believers in continuous improvement, we continually enhanced our processes. Recognizing the potential of DBT, we successfully implemented it in our project, further optimizing our testing efficiency.

CI/CD Integration in an Agile Environment

Following Agile methodology, our client had a release every 2-week sprint. Over our 7-year partnership, we never missed a deadline, even when testing databases over 3 TB. We consistently met deliverables on time. Achieving CI/CD integration, we used tools like Jenkins and Apache Airflow, ensuring seamless and efficient project execution. Our commitment to punctuality and quality contributed to our successful long-term collaboration.

Our Reporting Pattern

Tracking the history of failures was crucial, so we integrated the Lemon Cheesecake tool with Snowflake. This allowed us to report the number of test cases passed and failed daily. Additionally, we ensured that the test results were directly ingested into the database for easy tracking. This seamless integration provided a robust solution for monitoring and managing test outcomes, significantly enhancing our ability to analyze and respond to test results efficiently.

Data Profiling with Looker

Data was flowing to their databases from different sources such as web, mobile, and so on. So with the implementation of data profiling, we were able to identify quality issues that would usually go undetected if we tested only the source and target databases. So we used Looker to create dedicated dashboards that would display the automation testing results for aspects such as level of ebook usage, number of subscriptions, activations, and so on.

Talk to our Experts

Amazing clients who
trust us