Data Engineer || 2-5 YOE || Gaming Industry || Pune
Michael Page Pune
About Our Client
This company is a leading player in the mobile gaming and esports industry, offering a platform that enables users to enjoy a wide variety of skill-based games and compete in tournaments for real-world rewards. Known for its innovation and rapid growth, the company has attracted millions of users worldwide and continues to push the boundaries of interactive entertainment.
Job Description- Data Pipeline Development
- Design, implement, and maintain scalable ETL pipelines using Apache Spark, Apache Flink, Dataproc, and Confluent Kafka.
- Confluent Kafka Integration
- Architect and manage Confluent Kafka-based solutions for real-time data ingestion and distribution.
- Big Data Frameworks
- Develop distributed data processing solutions leveraging Spark and Flink for complex transformations, aggregations, and analysis.
- Google Cloud Platform Expertise
- Utilize BigQuery for efficient querying and analytics over large-scale datasets, particularly key-value structured data from gaming events.
- Programming and Scripting
- Write clean, efficient, and reusable code in Python for data processing and integration tasks.
- Collaboration and Stakeholder Management
- Work closely with the Head of Engineering, data scientists, analysts, and game developers to understand requirements and deliver actionable insights.
- Performance Optimization
- Optimization Monitor and tune performance for distributed systems to ensure low-latency and high-throughput data processing, critical for gaming event data.
- Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Programming: Proficiency in Python with experience in writing production-level
- Big Data Technologies: Hands-on experience with Apache Spark and Apache Flink for batch and streaming data processing.
- Kafka: Proven experience with Confluent Kafka for real-time data ingestion, topic design, partitioning, and stream processing.
- Cloud Platforms: Strong knowledge of Google Cloud Platform (G), including BigQuery,Dataproc and related services.
- SSkills: Expertise in writing complex SQLqueries and optimizing them for large
- Data Engineering Concepts: Solid understanding of distributed systems,,modeling partitioning, and schema design.
What's on Offer
Opportunity to work with industry leaders
Career growth opportunity
PibyThreePune
Job Description
Data Engineer (DBT, Snowflake)
As a Data Engineer at our organization, you will play a crucial role in our data management and analytics initiatives. Your primary responsibility will be to design, construct, and maintain efficient...
AccenturePune
Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load...
RochePune
at what we do, check out Roche code4life.
Here’s what we’re looking for:
• We’re looking for a motivated Data Engineer who will have a significant impact on our platform making data accessible.
• You will work with different data stakeholders to gain...