Avnish

I have overall 5 years of experience as an Azure data engineer and I'm looking for a Part-time or Contractual basis work opportunity for a Data Engineer role.

 Writing scripts and programs in Python/PySpark to do Data Analysis

 Extracting data from different data sources like NoSQL Cosmos DB, MS SQL Server, etc using Python and Spark code in Azure Databricks and then performing data transformations on it.

 Knowledge of working with real streaming time projects.

 ETL pipeline creation which fetches Data from Service Now portal and loads it to the SQL server.

 Designing and creation of Azure Data Factory Pipelines, Datasets and worked with Azure DevOps

 Creation of logic apps, Azure Functions to send alerts and files to storage accounts which are shared over email.

 Completion of all the assigned tasks on time.

Project:

Requirement: ETL pipeline creation which fetches Data from Service Now portal and loads it to the SQL server. The objective of this task was to get all the information related to incidents, change requests, etc in one place(SQL server) and then to use that to generate reports.

Requirement: Transaction Reporting