Snowflake Data Engineer - AWS | Chennai / Mumbai

apartmentValueMap Technologies placeChennai calendar_month 
Job Description
  • The client clarified that the role is primarily focused on development in SQL, Snowflake and L2 development.
  • Proficiency in optimizing SQL queries within Snowflake.
  • Level 2 (L2) development expertise with the ability to write, update, and refine SQL statements as needed.
  • Solid experience as a data engineer with knowledge of JavaScript, Python, and SQL stored procedures.
  • Familiarity with SQL fundamentals, such as GROUP BY operations with a background in development tools like SQL, PL SQL, and Python.

[UK Shift 2.00 pm IST onwards]

Ability to work as an Individual contributor while collaborating with Global team.
  • Strong experience with Data Warehousing- OLTP, OLAP, Dimension, Facts loading.
  • Expertise in Python building data application including reading, transforming & writing data sets.
  • Strong experience in using boto3, pandas, numpy, pyarrow, Requests, Fast API, Asyncio, Aiohttp, PyTest, OAuth 2.0, multithreading, multiprocessing, snowflake python connector & Snowpark.
  • Experience in Python building data APIs (Web/REST APIs)
  • Strong Experience with AWS tools such as S3, Athena, Glue, Lambda, SNS, SQS etc
  • Experience with application and libraries packaging and distribution like Wheel packages, Zipapp and Pyinstaller and Docker Containerization.
  • Experience with Snowflake including SQL, Pipes, Stream, Tasks, Time Travel, Data Sharing, Query Optimization
  • Experience with Scripting language in Snowflake including SQL Stored Procs, Java Script Stored Procedures & Python UDFs
  • Understanding of Snowflake Internals & experience in integration with Reporting & UI applications
  • Strong Experience with AWS tools such as S3, Athena, Glue, Lambda, SNS, SQS etc
  • Experience working in financial services preferably buy side firms.
Responsibilities
  • Building, Optimizing & supporting data pipelines utilizing Python, SQL & Java Script utilizing Snowflake & AWS
  • Building & maintaining frameworks using stored procedures & Python to simplify design patterns.
  • Building Data APIs (Web/REST APIs)
  • Working with DevOps team to standardize deploying python application.
  • Primary contact point for overnight batch issues (Level 2 support) & resolving overnight batch issues escalated by escalated L1 Team
  • Contribute to building frameworks using target tech stack working with Onsite developers
  • Contribute to conversion process of legacy (Informatica/ .NET) to target tech stack.
  • Simplify Orchestration for better maintainability.
  • Improve & maintain documentation & run books.
  • Perform Code review for other team members.
  • Monitor & run data completeness checks to uncover issues early.
  • Impact analysis & Testers for technical changes
  • Work with Onsite developers on minor enhancements.
starFeatured

Data Engineer

apartmentAmperaplaceChennai
Job Description Skills: python, sql, cloud, ETL, tableau, data engineer, Company Overview Ampera Diversity Pvt Ltd is formed with the sole purpose of providing holistic and customized DEI (Diversity, Equity and Inclusion) solutions...
local_fire_departmentUrgent

Data Engineer

apartmentNielsenIQplaceChennai
by Microsoft Azure. Our clients around the world rely on NielsenIQ's data and insights to innovate and grow. As a Data Engineer, you'll be part of a team of smart, highly skilled technologists who are passionate about learning and prototyping cutting-edge...
thumb_up_altRecommended

Gcp data engineer

apartmentRaah TechservicesplaceChennai
Job Description Skills: Gcp data, Python (Programming Language), Gcp data engineer, Google Cloud Platform (GCP), Cloud, Developer, Company Overview Welcome to Raah Tech Services! We provide innovative IT solutions. With a customer-centric...