Data Engineer
Required Technical Skills
- Proficiency in building out scalable and reliable ETL pipelines and processes to ingest data from variety of data sources including but not limited to SharePoint, REST API, Blob Storage.
- Proficiency in Azure PaaS offerings and data engineering target architecture, including but not limited to Azure SQL database, Azure Data Factory, Azure Synapse, Azure Databrick, Azure Functions, Data lake, Azure Log Analytics.
- Proficiency in large dataset transformation using Python
- Proficiency in relational databases and SQL, including but not limited to stored procedures, indexes, functions and triggers.
- Proficiency in Azure DevOps CI/CD and Git Repository.
- Deep understanding in data model design and relational database normalization
- Familiarity with Non SQL databases. E.g Cosmos DB