GCP Data Engineer
Experience.com Chennai Full-time
Come Join Us
Experience.com - We make every experience matter more
Position: Data EngineerExperience: 4+ Years
Job Location: Remote
Employment Type: Full Time
Responsibilities- Design, build, and maintain scalable and robust ETL/ELT pipelines using PySpark and SQL.
- Work on data extraction, transformation, and loading processes from multiple sources into data warehouses such as BigQuery.
- Leverage GCP data analytics tools (BigQuery, DataProc, Cloud Functions, etc.) to process and analyze data.
- Optimize data workflows for benchmarking, performance, and tuning to ensure efficiency and reliability.
- Collaborate with engineering and analytics teams to develop data integration solutions that meet business needs.
- Ensure the accuracy and quality of data by implementing strong in-memory applications and database designs.
- Implement monitoring and alerting for pipelines and workflows to ensure data consistency and issue resolution.
Skills and Qualifications
Must-Have:
- 4+ years of experience with PySpark and SQL for building scalable ETL pipelines.
- Strong proficiency in Python programming.
- Knowledge of GCP Data Analytics ecosystem (BigQuery, PySpark, SQL, etc.).
- Experience with Airflow/Composer for workflow orchestration.
- Experience with in-memory applications, database design, and data integration.
- Strong analytical thinking and problem-solving abilities.
Preferred:
- Familiarity with data pipeline mechanisms such as Kafka or Pub/Sub, Cloud Functions
- Hands-on experience with Elasticsearch, and MongoDB.
About Us
We believe that experience is everything. Experience.com has built the most impactful Experience Management Platform (XMP) available anywhere, with features to drive operational and behavioral change, in real-time, during the moments that matter.XMP delivers impactful business outcomes including increased customer satisfaction, brand loyalty, online reputation and visibility, as well as improved employee engagement, and compliance - making every experience matter more.
Founded in 2015 and originally founded as SocialSurvey, Experience.com is headquartered in San Ramon, Calif. and backed by SavantGrowth (fka Kennet Partners), Silicon Valley Data Capital, Tri-Valley Ventures, and Wilson Sonsini Goodrich & Rosati.
Indian Registered name: Buyers Road India Private LimitedURL: www.experience.com
Alphacom Systems and Solutions Priavte LimitedChennai
Job Description
Responsibilities:
• Ensure effective Design, Development, Validation and Support activities in line with client needs and architectural requirements.,
• Ensure continual knowledge management.,
• Adherence to the organizational...
GSSTech GroupChennai
We are seeking a highly skilled and motivated Informatica BDM Data Engineer to join our team at a leading UAE bank.
Education
Degree, Postgraduate in Computer Science or related field (or equivalent industry experience)
Experience
Minimum 4...
AccentureChennai
Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load...