AWS Data Engineer
Job Description
Role:AWS Data Engineer & Sr. AWS Data Engineers
Experience: 5 to 10 Years (6+ years exp. will be considered for Seniors and 8+ will be considered for Lead roles)
Location:Pune, Gurgaon, Hyderabad, Bangalore (Hybrid)
Our Values: Passion, Continuous Learning, Adaptability, Teamwork, Customer Centricity, Reliability
Job Summary:
We are seeking a highly motivated and experienced AWS Engineer to join our MarTech team in the NFL. This position requires an individual with AWS cloud experience and ambition to continually keep up with best practices when it comes to cloud development.The successful candidate must be able to seek out requirements and create best-in-class cloud-native solutions. The engineer must always create solutions that are repeatable, scalable and well-governed. They will deploy and rigorously test solutions to ensure they are robust and secure.
The engineer will create and maintain diagrams associated with solutions deployed into production.
Must have:
- 4-6 years of experience with AWS tech stack(S3, Glue, Redshift, Athena, Lambda,CloudWatch, SQS, IAM roles, CloudTrail).
- 3-5 years ofSQL, Python & Pyspark programming experience.
- Experience working withETL Tools.
- Experience with CDC mechanisms for database sources.
- Experience building distributed architecture-based systems, especially handling large data volumes and real-time distribution.
- Initiative and problem-solving skills when working independently.
- Expertise in building high-performance, highly scalable, cloud-based applications.
- Experience with SQL and No-SQL databases.
- Good collaboration and communication skills, highly self-driven, and take ownership.
- Experience in Writing well-documented, Clean, and Effective codes is a must.
Good tohave:
- AWS Cloud Certifications.
- Knowledge and experience in designing and developing RESTful services.
- 1-3 years of experience inDBTwith Data Modeling, Airflow,MWAA,SQL,Jinja templating, and packages/macros to build robust, performant, and reliable data transformation and feature extraction pipelines.
- 1-2 years of experience in Airbyte building ingestion modules for streaming, batch.
- Good experience building Real-Time streaming data pipelines with Kafka, Kinesis etc.
- Familiarity with Big Data Design Patterns, modeling, and architecture.
- Working knowledge of DevOps methodologies, including designing CI/CD pipelines.
- Good understanding of Data warehousing & Data Lake solutions concepts.
Responsibilities:
- Create and maintain scalable, robust AWS architecture.
- Develop API-based, CDC, batch, and real-time data pipelines for structured and unstructured datasets.
- Enable integration with third-party systems as needed.
- Ensure solutions are repeatable and scalable across the organization.
- Work with client teams to gather requirements, develop solutions, and deploy them.
- Provide robust solution documentation for a wide audience.
- Collaborate with data professionals to bring applications to life, meeting business needs.
- Prioritize data protection and cloud security in all deliverables.
Education:
- BE/B.Tech/MS/M.Tech/ME from reputed institute.
Every individual comes with a different set of skills and qualities so even if you dont tick all the boxes for the role today, we urge you to apply as there might be a suitable/unique role for you tomorrow!
Role:Data Engineer
Industry Type:IT Services & Consulting
Department:Engineering - Software & QA
Employment Type:Full Time, Permanent
Role Category:Software Development
Education
UG:Any Graduate
PG:Any Postgraduate
Doctorate:Any Doctorate