[ref. o04194418] Data Engineer II, WWGS Data & Analytics - Bangalore

Welcome to WWGS Data & Analytics, where we equip you with the tools and camaraderie you need to forge inventive pathways that are not just professionally fulfilling, but also incredibly enjoyable.

Our enthusiasm lies in constructing a remarkably scalable big data ecosystem that bolsters our analytics, machine learning, and data-driven applications.

• Architecture design and implementation of next generation data pipelines and BI solutions
• Manage AWS resources including EC2, RDS, Redshift, Kinesis, EMR, Lambda, Glue, Apache Airflow etc.
• Build and deliver high quality data architecture and pipelines to support business analyst, data scientists, and customer reporting needs.
• Interface with other technology teams to extract, transform, and load data from a wide variety of data sources
• Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers

A day in the life

You will play an active role in translating business requirements into concrete systems and prototyping concepts in partnership with Amazon, technology leaders within the team and across the business.

Along the way, we guarantee that you’ll learn a ton, have fun and make a positive impact on many people. Most importantly you’ll be contributing to our Higher Purpose of Nourishing People and the Planet!

About the team

• 3+ years of data engineering experience.
• Profound experience in designing, implementing, and overseeing data processing systems tailored for extensive datasets.
• Proficiency in at least one modern programming language, whether it's Java, Scala, or Python.
• Hands-on expertise and advanced comprehension of SQL.
• A firm grasp of data management fundamentals and principles underpinning data storage.
• Proficiency in the realm of distributed systems as they pertain to data storage and cloud computing.
• A proven track record of working with Open-Source Big Data tools, including Hadoop, Spark, Hive, and Presto, among others.- Demonstrated aptitude in independently managing and delivering end-to-end projects.
• Relevance in areas such as Data Engineering, Database Engineering, Business Intelligence, or Business Analytics.
• Practical familiarity with AWS Big Data Technologies, encompassing EMR, Athena, EC2, Redshift, and S3, to name a few.
• Prior engagement with Redshift, PostgreSQL, SQL Server, or MySQL.
• A documented history of successfully implementing robust big data solutions.
• Proficiency in navigating both Batch and Real-Time data processing systems.
• A proven knack for effective communication with users, technical counterparts, and senior management to gather requirements, elucidate data modelling decisions, and outline data engineering strategies.
• Proven experience in providing technical leadership and mentoring fellow engineers in data engineering best practices.
• Comprehensive comprehension of software coding practices throughout the development lifecycle, inclusive of agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations.