Sr.BI Developer/Data Engineer(ETL+AWS+ Python+ SQL) with an IT Services Co. -Pune Baner

Job Description

Design, implement, and optimize ETL/ELT pipelines to ingest, transform, and load data into

AWS Redshift from various sources.

Write efficient and reusable Python scripts to automate data processing workflows.

Utilize AWS Lambda for serverless data processing and real-time data transformations.

Data Science and Analytics

Apply data science techniques to analyze large datasets, develop predictive models, and

deliver actionable insights.

Integrate machine learning models and statistical analysis into BI solutions.

Conduct A/B testing and advanced analytics to support strategic business decisions

Manage and monitor AWS S3 storage, ensuring data integrity, availability, and performance.

Data Warehousing and Database Management

Architect and maintain data warehouses and data marts to support reporting and analytical

needs.

Implement and enforce data modeling best practices to ensure scalability and performance.

Data Governance and Security

Establish and enforce data governance frameworks to ensure data quality, security, and

compliance with industry standards.

Collaborate with cross-functional teams to define data policies and implement robust access

controls for sensitive data.

Maintain data cataloging and documentation to ensure transparency and ease of access

across the organization.

Collaboration and Leadership

Lead BI development efforts, mentor junior team members, and share best practices.

Work closely with data engineers, data scientists, and business analysts to deliver end-toend solutions.

Stay updated with emerging trends in data warehousing, BI, and cloud technologies to

recommend innovative approaches.

__________________________________

Required Skills and Qualifications

7+ years of experience in BI development, data engineering, or a related field.

Strong expertise in Python/R scripting for data processing and automation.

Hands-on experience with AWS services: Lambda, S3, and Redshift.

Proven experience in data warehousing design, implementation, and management.

Proficiency in SQL for advanced query writing and optimization.

Deep understanding of data governance principles, including data quality, security, and

compliance.

Experience with data visualization tools such as Power BI or similar.

Solid understanding of data science methodologies and experience with machine learning

libraries (e.g., scikit-learn, pandas, NumPy).

Strong analytical and problem-solving skills with the ability to translate business

requirements into technical solutions.

Excellent communication, collaboration, and leadership abilities.

______________________________________

Preferred Qualifications

AWS certifications such as AWS Certified Data Analytics or AWS Solutions Architect.

Experience with big data tools like Apache Spark, EMR, or Athena.

Familiarity with CI/CD pipelines and version control systems like Git.

Knowledge of Agile development practices.

Exposure to data cataloging tools (e.g., AWS Glue Data Catalog, Alation, or Collibra).

Exposure to airline /air freight/ supply chain domain.