Khoda

I am a Senior Data Engineer with over 5 years of
experience in developing and optimizing data pipelines,
specializing in Azure services, Python development, and
cloud-based architectures. I have extensive experience
working with the medallion architecture in Azure
environments, where I focus on transforming data across
Bronze, Silver, and Gold layers using tools like
Databricks, Azure Data Factory (ADF), and Snowflake. In
addition to my expertise in data transformations, I excel
in orchestrating Azure Event Grid for event-driven
workflows, ensuring seamless integration and real-time
processing of data.
I have a strong background in improving data quality
through unit testing, reconciliation frameworks, and
automation processes. I implement Test-Driven
Development (TDD) in PySpark and maintain continuous
testing using tools like Jira and Zephyr to track issues
and manage test cases. I have successfully managed
complex ADF pipelines and integrated CI/CD practices to
streamline deployments. My experience spans domains
such as finance and software services, where I have led
migrations of legacy systems to modern cloud platforms,
ensuring scalable and efficient data solutions. As a
Python lead and Azure administrator, I am committed to
delivering high-performance data workflows and driving
continuous improvements in data engineering practices.