Data Integration Engineer
Job Description
About the Role
As a Data Integration Engineer , you will be using technical skills, analytical insights, and business perspective to ensure we have the most accurate and complete data from each client to feed our data science models. You will be responsible for helping new and existing customers ensure they are receiving the best performance possible and leading the charge on processing the data of the largest eCommerce merchants in the world.
What You'll Be Doing
In your first 60 days, you will be expected to complete a global and team-specific onboarding program to ground yourself in the knowledge, tools, processes, and people necessary to succeed on the job.
After onboarding, you will be expected to begin supporting data flows for merchant integrations and pilots. Typically, this includes, but is not limited to:
Perform due diligence on merchant websites, business models and data flows
Generate tailored data templates (JSON, CSV) to help guide merchant developers / data teams in building high-quality online (API) and offline (file transfer) integrations
Write queries and scripts (R, Python, SQL, Spark, Databricks) to:
Test, validate, and detect data issues in API calls in sandbox and production environments
Test, validate, transform, and upload large historical data files.
Combine technical, business and analytical objectives to come up with tailored solutions for onboarding merchants
Ad hoc data wrangling and sanitization
Monitor automated data alerts - prioritize, track, and communicate merchant data issues / irregularities with internal and external stakeholders
Work closely with analysts, research and data science teams to accommodate changes in industry data
Identify, research, and offer system-wide solutions for common data issues
Work closely with client-facing teams to engage customers regarding their data integrations
Support R&D, Product Management, Data Science, Integrations Engineering, Account Management, and Sales as a subject matter expert of product, technology and merchants
Contribute to advancing the teams tooling, processes, and documentation
Qualifications- 5+ years of experience in a data-centric industry role (Analytics, Data Engineering, ETL, DBA, Consulting, etc.)
- 3+ years with SQL or NoSQL databases
- 3+ years experience with data wrangling (R, Python for data processing)
- 3+ years optimizing technical processes
- Strong analytical skills and attention to detail
- Strong verbal and written communication skills