Purview Implementation: Set up and manage Microsoft Purview for data discovery, cataloging, classification, and sensitivity labeling.
Data Lineage & Governance: Integrate Purview with Azure data sources (Azure Data Factory, Data Lake, Synapse) to map and manage end-to-end data lineage.
Compliance & Security: Configure data policies, security standards, and automated governance workflows (Purview Workflow).
Data Integration: Build scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Python to move and transform data.
Monitoring & Optimization: Monitor Purview performance, troubleshoot issues, and optimize data governance initiatives.
Collaboration: Work with data architects and stakeholders to implement data quality initiatives and provide technical documentation.
Required Skills and Qualifications
Technical Expertise: Strong knowledge of Microsoft Purview and Azure data services (ADLS Gen2, Synapse, Databricks, SQL Database).
Data Governance: Experience with data classification, metadata management, and compliance frameworks.
Languages & Tools: Proficiency in Python, SQL, and data transformation techniques.
Experience: Usually requires 3-8 years in data engineering with a focus on governance.
Methodology: Familiarity with Agile development and CI/CD tools
Skills & Requirements
Technical Skills
PythonSqlAzure data factoryDatabricksMicrosoft purviewAzure data lake storage gen2Azure synapseEtl/elt pipelinesData governanceData engineering