I am an azure data engineer with 3+ years of experience with strong coding skills in python, pyspark, SQL. i have experience in cloud technology in azure with various services.
Experience
accenture
Oct 2021 – Present
Mumbai
Data engineering analyst
Managed team of junior developers of 3 to help them delivering effectively and eliminating potential roadblocks.
Acted as a SME for pyspark to help developers in different projects.
Analysed existing infrastructure and code base to adapt it according to cloud infrastructure.
worked in agile methodology and used tools such as JIRA,Confluence etc.
Worked on different clients including FMCG , Healthcare and Finance
Built scalable Metadata databases capable of ETL processes using SQL and Spark.
Created ELT pipelines using Azure Data Factory to Extract,Load and Transform data from multiple sources like CSV,XLSX,SQL,API.
Worked on data lake architecture in bronze,silver,gold tiers and also worked on integration of delta lakes with Downstream consumer applications like Azure Synapse.
infosys limited
Jun 2019 – Oct 2021
pune
senior software engineer
• Worked with shipping solution giant client, Migrated RPA infrastructure from on-premises to Azure cloud.
• Assisted senior level data engineers in the design of ELT processes, also Created and maintained Azure SQL databases for various teams with proper scalability techniques.
• Worked on servicenow cloud based API's to extract data which helped in automating RPA processes smoothly.
• Translated a set of requirements and data into a usable database schema bycreating or recreating ad hoc queries,scripts and macros.
• Updated existing queries, creates new ones to manipulate data into a master databases.