[ref. s86582520] Senior Data Engineer

Job Description

Job title - Senior Data Engineer

Exp - 6 to 8 years

Job Location: Coimbatore / Hyderabad

Do you love building the infrastructure that fuels data-driven decision making Are you passionate about wrangling raw data into a usable format If so, then we want to hear from you!

We are searching for a Senior Data Engineer to join our growing team. In this role, you will play a key part in designing, developing, and maintaining our data pipelines. You will work closely with data scientists, analysts, and business stakeholders to ensure our data infrastructure meets the ever-evolving needs of the organization.

Responsibilities:

• Design, develop, and maintain scalable data pipelines using technologies like Python and SQL.
• Develop and implement data quality checks and monitoring processes to ensure data integrity.
• Build and automate data ingestion processes from various sources (databases, APIs, etc.) to Snowflake.
• Utilize cloud platforms (AWS, Azure, GCP) to build and manage data infrastructure.
• Leverage Infrastructure as Code (IaC) tools like Terraform to provision and manage cloud resources.
• Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions.
• Version control code using Git and collaborate with the team through code reviews.
• Document data pipelines and processes for future reference and knowledge sharing.

Qualifications:

• 5+ years of experience in data engineering or a related field.
• Proven experience in designing, developing, and deploying data pipelines.
• Hands on experience with Snowflake or Data Bricks, Python or Pyspark and SQL
• Should have experience working in Data Build Tool (DBT).
• Experience with data warehousing and data modeling concepts.
• Experience working with cloud platforms (AWS, Azure, GCP) is a plus.
• Working knowledge of Terraform and Infrastructure as Code (IaC) principles.
• Experience with Git for version control.
• Excellent communication and collaboration skills.
• Should have experience in leading the data team.
• Ability to work independently and as part of a team.
• Strong problem-solving and analytical skills.

Bonus Points:

• Experience with data orchestration tools (Airflow, Luigi, etc.).
• Experience with data visualization tools (Tableau, Power BI, etc.)