Aws Data Engineer

Job Description

Years Of Experience: 5

Job Description :

We are seeking an AWS Data Engineer with a strong foundation in AWS services and data ingestion using APIs. This individual will be instrumental in architecting and building scalable data solutions, leveraging AWS technologies such as S3, Redshift, Glue, and EC2 to support our data infrastructure needs.

Key Responsibilities:

• Develop and maintain scalable and reliable data pipelines to ingest data from various APIs into the AWS ecosystem.
• Manage data storage solutions using S3 buckets, ensuring best practices in data organization and security.
• Utilize AWS Redshift for data warehousing tasks, optimizing data retrieval and query performance.
• Configure and use AWS Glue for ETL processes, ensuring data is clean, well-structured, and ready for analysis.
• Utilize EC2 instances for custom applications and services that require compute capacity.
• Implement data lake and warehousing strategies to support analytics and business intelligence initiatives.
• Collaborate with cross-functional teams to understand data needs and deliver solutions that align with business goals.
• Ensure compliance with data governance and security policies.

Skill :

• AWS DE profile S3, Spark framework, AWS Glue, DAGs, MWAA
• AWS Glue catalogue ad AWS Iceberg
• AWS Iceberg, EMR/HDFS, RedShift / Snowflake
• AWS security (IAM policies, tag-based configurations)
• Preference for candidates which have experience with:
• Banking/ Finance industry
• Ability to handle the transition from Project mode to BAU L2/L3
• Ab-Initio (at the least, development in graph IDEs)