Kastech Software Solutions

Data Engineer Responsibilities Create and maintain optimal data pipeline architecture Develop time series data pipelines Assemble large complex data sets that meet functional nonfunctional business requirements Identify design and implement internal process improvements automating manual processes optimizing data delivery Build the data pipelines required for optimal extraction transformation and loading of data from a wide variety of data sources using PySpark Build analytics tools that utilize