International Marketing Company – Data Transformation
Transforming foreign data for integration into a larger universe.
Service: Data Engineering
Industry: Technology/Software/SaaS
Tech Stack: Apache Hive, Apache Spark, AWS Lambda, AWS S3, Jupyter, Pyspark
Profile & Challenge
Our client - a major marketing company - sought to include Japan’s census data into its larger data universe but faced multiple integration challenges. The data set used non-Latin characters (in this case Kanji), and required contextual understanding of Japan’s administrative operations, in order to match them with the client's existing data tables. The client turned to GAP for help with this big data transformation project.
SOLUTION & OUTCOME
Existing translator programs were not effective in translating the data set, so GAP found a one-to-one translation service to perform the translation. The client was presented with a data set that could be readily used and integrated with their larger data universe. After translation, GAP enhanced and standardized the data to be used in modeling efforts for audience creation. Moving forward, the client also gained the ability to easily convert future census data from Japan and other non-Latin languages based on GAP’s solution. As an added bonus, GAP’s data engineering team created a tool that can be used to update all data models faster for the client, improving the process for regular data refresh.
ADDITIONAL PROJECTS
RELATED ARTICLES

October 23, 2024
How Can Data Management and Engineering Revolutionize Your CIO Role?
Chief Information Officer (CIO) roles continue to evolve as technology grows. Since the mainframe era, CIOs' major roles revolve around managing IT infrastructure and ensuring system stability within an organization. And now, in the 21st century, their job responsibilities lean strongly toward innovation and strategic decisions to lead digital transformation
Read More
February 20, 2024
Business Intelligence, Data Engineering, Data Pipelines
Challenges When Implementing Data Pipelines (and How to Fix Them!)
Data pipelines have quickly become critical infrastructure for businesses of all sizes. But the ever-changing world of data science makes it difficult for the average company to effectively implement a streamlined system for collecting, analyzing, and reporting information. In fact, the complexity involved in building the necessary infrastructure to facilitate
Read More