Senior Data Engineer - Capital Analytics
McKinsey & Company
Data Science
Gurugram, Haryana, India
Posted on Tuesday, August 27, 2024
Senior Data Engineer - Capital Analytics
Job ID: 89684
Who You'll Work With
You will be based in our Gurugram office and you will be a part of Capital Analytics, the digital products arm of the Capital Excellence service line of McKinsey’s Operations practice.
Capital Excellence assists our clients in solving complex challenges throughout the capital project life cycle. Blending strategic thinking with hands-on practicality, our teams of consultants and experts work to develop and implement project, portfolio, organization, and process best practices that solve our clients' most critical problems.
Capital Analytics supports Capital Excellence with analytics and data-driven insights delivered to our consultants in client engagements or directly to clients to sustain their transformation. We source data, build data and advanced analytics platforms, as well as we develop our own products, or we establish strategic alliances to leverage existing products with the ultimate goal of decarbonizing and renewing critical infrastructure globally.
McKinsey fosters innovation driven by analytics, design thinking, mobile and social media by developing new products/ services and integrating them into our client work. It is helping to shift our model toward digital asset-based consulting and is a foundation for our entrepreneurial culture.
What You'll Do
You will build and maintain a Lakehouse on Azure using Azure native data pipeline tooling (core technologies: Azure Data Lake Storage gen2, Databricks, Azure Data Factory, Delta lake table format). You will be responsible for developing ELT patterns, establishing DataOps processes and overall drive maturity of the solution. You will work on data pipeline optimization for performance and scalability.
You will be establishing data engineering best practices, documenting them and coaching your data engineering members. We are also expecting you to stay up to date with latest trends and technologies in data engineering.
You will be working in a small scrum team alongside 2 data engineers and receive functional guidance from a data architect. Our data strategy manager will provide guidance on data governance topics such as data quality and data mastering. You will be interfacing with a software engineering team which is building web applications integrated with the lakehouse. You will partner with cloud engineers to build relevant infrastructure following DevSecOps principles.
Qualifications
- 5+ years of experience in data engineering with hands-on experience in designing, developing, and maintaining robust data pipelines using Azure Data Factory, Azure Data Lake, and Databricks
- Write efficient and optimized code in Python and SQL for data manipulation, transformation, and analysis
- Develop and implement data models and database designs to support business requirements
- Lead data workstreams and projects, ensuring timely delivery and quality outcomes
- Utilize Azure ML and Azure Cognitive Services for advanced analytics and machine learning solutions
- Work with modern data warehousing tools such as Snowflake, dbt, and Airflow
- Implement and manage open table formats like Delta and Iceberg for efficient data storage and querying
- Develop and maintain APIs, with a preference for experience in GraphQL
- Ensure data quality and integrity through frameworks like Great Expectations and master data management practices
- Create insightful visualizations and reports using PowerBI or Tableau
- Communicate effectively and collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders
- Apply creative problem-solving and critical thinking skills to address complex data challenges
FOR U.S. APPLICANTS: McKinsey & Company is an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by applicable law.
FOR NON-U.S. APPLICANTS: McKinsey & Company is an Equal Opportunity employer. For additional details regarding our global EEO policy and diversity initiatives, please visit our McKinsey Careers and Diversity & Inclusion sites.
share this job
Job Skill Group - N/A
Job Skill Code - GCYA - Senior Data Engineer I
Function - Technology
Industry - Capital Projects & Infrastructure
Post to LinkedIn - Yes
Posted to LinkedIn Date - Thu Jul 04 00:00:00 GMT 2024
LinkedIn Posting City - Gurugram
LinkedIn Posting State/Province -
LinkedIn Posting Country - India
LinkedIn Job Title - Senior Data Engineer - Capital Analytics
LinkedIn Function - Consulting;Engineering
LinkedIn Industry - Computer Software;Information Technology and Services
LinkedIn Seniority Level - Mid-Senior level
Job Skill Code - GCYA - Senior Data Engineer I
Function - Technology
Industry - Capital Projects & Infrastructure
Post to LinkedIn - Yes
Posted to LinkedIn Date - Thu Jul 04 00:00:00 GMT 2024
LinkedIn Posting City - Gurugram
LinkedIn Posting State/Province -
LinkedIn Posting Country - India
LinkedIn Job Title - Senior Data Engineer - Capital Analytics
LinkedIn Function - Consulting;Engineering
LinkedIn Industry - Computer Software;Information Technology and Services
LinkedIn Seniority Level - Mid-Senior level