Fabric+Pyspark+SQL - Senior Associate

Industry/Sector

Specialism

Management Level

Job Description & Summary

At PwC - AC, as an Azure Senior Developer, the candidate will interact with Offshore Manager/ Onsite Business Analyst to understand the requirements and the candidate is responsible for end-to-end implementation of Cloud data engineering solutions.The candidate should have strong experience in Azure cloud using Storage services (Blob, ADLS,  PaaS SQL), Azure Data factory and Azure Synapse . Strong in planning and organization skills. Ability to work as cloud developer/lead on an agile team and provide automated cloud solutions. 

Years of Experience: Candidates with 4-8  years of hands on experience 

Position Requirements:  

Must Have: 

4+  years of experience working in Azure ADLS, Data Bricks, Data Flows, HDInsight,  Azure Analysis services 

Should be aware of Data Management concepts and Data Modelling 

Good knowledge of Big Data frameworks and related technologies - Experience in Hadoop and Spark is mandatory 

Should have expertise in extracting data from different source systems like flat files, XML sources, JSON, Parquet files, Big data appliances, RDBMS, etc. 

Good knowledge of Big Data frameworks and related technologies - Experience in Hadoop and Spark is mandatory  

Hands-on experience with Microsoft Fabric and its components 

Proficient in PySpark Notebooks for building scalable data processing pipelines 

Strong command over SQL databases and performance tuning for analytical workloads 

Solid experience with SparkSQL for complex data transformations and querying 

Should have clear understanding of DW lifecycle and contributed in preparing  

 Detail Level Design document 

 Unit Test plans 

 Code review reports 

Must have strong sql, understand joins, groups, functions & Stored procedures 

Must have experience  in Unit and Integration Test creation and verification 

Proficient in creating documentation related to Project Architecture, Project end User Manual and Operations Hand off guide 

Should have good understanding of Data Migration processes, methods and project lifecycle 

Good in Unix Shell Scripting skills 

Strong analytical skills and troubleshooting skills 

Should be well versed with quality processes and implementation 

Excellent communication skills 

Strong understanding of Cloud data migration processes, methods and project lifecycle  

Good knowledge of Application DevOps tools (Git, CI/CD Frameworks) - Experience in Jenkins or Gitlab with rich experience in source code management like Code Pipeline, Code Build and Code Commit 

Good to have skills: 

• Experience integrating Snowflake and Dremio with BI and visualization tools such as Tableau, Power BI, or Qlik 

• Knowledge of data integration tools like Informatica, DataStage, or Ab Initio. 

• Familiarity with data visualization tools such as Tableau or Qlik. 

• Experience with programming languages such as Python, Java, or PySpark. 

• Certifications related to cloud data warehousing or Snowflake. 

• Cloud - AWS, GCP,  Oracle-Cloud 

• Business Intelligence - MicroStrategy, Business Objects, Cognos 

• Data Appliance - Teradata, Netezza 

Additional Skills 

• Excellent communication skills, client presence, presentation skills 

• People skills, Leadership skills 

Professional and Educational Background: 

• BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBA  

The Opportunity

When you join PwC Acceleration Centers (ACs), you step into a pivotal role focused on actively supporting various Acceleration Center services, from Advisory to Assurance, Tax and Business Services. In our innovative hubs, you’ll engage in challenging projects and provide distinctive services to support client engagements through enhanced quality and innovation. You’ll also participate in dynamic and digitally enabled training that is designed to grow your technical and professional skills.

As part of the Data Engineering team you will design, build, and maintain productive data pipelines using PySpark and SQL. As a Senior Associate you will leverage your technical strengths to analyze complex concepts, guide and mentor others, and maintain professional standards while delivering top-quality data solutions. This position provides an exciting opportunity to work in Microsoft Azure environments and collaborate with stakeholders to support business intelligence and advanced analytics initiatives.

Responsibilities

- Design, build, and maintain streamlined data pipelines using PySpark and SQL

- Analyze complex concepts and deliver rigorous data solutions

- Guide and mentor team members in technical skills

- Collaborate with stakeholders to support business intelligence initiatives

- Uphold professional standards in engineering practices

- Leverage Microsoft Azure environments for data processing

- Identify opportunities for process improvements in data workflows

- Secure communication across cross-functional teams

What You Must Have

- Bachelor's Degree

- 4 years of experience in data engineering

- Oral and written proficiency in English required

What Sets You Apart

- Bachelor's or Master's Degree in Computer Science, Engineering, Information Systems, or related field

- Microsoft Certified: Azure Data Engineer Associate

- Microsoft Certified: Power BI Data Analyst Associate

- Developing reports and dashboards using Power BI

- Understanding DevOps practices in data projects

- Familiarity with Delta Lake or Lakehouse architecture

- Experience with Data Modeling and ETL orchestration

- Excelling in problem-solving and teamwork

Travel Requirements

Job Posting End Date