Remote Spark jobs

ETL Developer Any ETL tool knowledge will work Mulesoft Informatica Good RDBMS Concepts mySql TSQl PSQL any database Basic SP Functions and Triggers Knowledge Tune optimize and troubleshoot ETL batch jobs for performance and throughput in production QA and UAT Design develop and unit test data mappings and workflows using Informatica tools like PowerCenter Repository Manager Workflow Manager etc to extract transform and load data from various source systems SQL databases etc to different target

Basic Work experience with ETL Data Modeling and Data Architecture Experience with Big Data technologies such as HadoopHiveSpark Skilled in writing and optimizing SQL Experience operating very large data warehouses or data lakes Preferred Experience in designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark andor Azure Data bricks Show efficiency in handling data tracking data lineage ensuring data quality and improving discoverability of

Looking for Snowflake IQ Location Anywhere in USA Duration 9 12 Months Visa Any visa is fine Except CPTOPT RemoteWFH option 1 PLSQL 2 ETL 3 Snowflake Good to have 1 Python 2 Controlm 3 Experience in migration projects Roles Responsibilities Take ownership on assigned tasks Individual contributor Strong in analyzing the components and rewrite in optimize way

Skills requirements 2 years of experience with Python 1 years of experience as a Data Engineer Experience with Pandas Experience with SQL DB NoSQL Redis Mongo Elasticsearch BigQuery Familiarity with Amazon Web Services Knowledge of data algorithms and data structures is a MUST Working with high volume tables 10m Optional skills as a plus Experience with Spark pyspark Experience with Airflow Experience with Kafka Experience in statistics Knowledge of DS and Machine learning algorithms Key

Skills requirements 2 years of experience with Python 1 years of experience as a Data Engineer Experience with Pandas Experience with SQL DB NoSQL Redis Mongo Elasticsearch BigQuery Familiarity with Amazon Web Services Knowledge of data algorithms and data structures is a MUST Working with high volume tables 10m Optional skills as a plus Experience with Spark pyspark Experience with Airflow Experience with Kafka Experience in statistics Knowledge of DS and Machine learning algorithms Key

Required skills Strong written and verbal communication skills were remote 3 years of experience in data engineering creating or managing endtoend data pipelines on large complex datasets Experience in developing scalable software using big data technologies eg Hadoop Spark Hive Flink Samza Storm Elasticsearch Druid Cassandra etc Expertise in Scala Java or Python Fluency with at least one dialect of SQL Level of English UpperIntermediate Responsibilities Manage data quality and integrity Assist

Looking for a Data Engineer with Python experience to join the DataForest team We are developing datadriven solutions Skills requirements 2 years of experience with Python 1 years of experience as a Data Engineer Experience with Pandas Experience with SQL DB NoSQL Redis Mongo Elasticsearch BigQuery Familiarity with Amazon Web Services Knowledge of data algorithms and data structures is a MUST Working with high volume tables 10m Optional skills as a plus Experience with Spark pyspark Experience

Requirements 4 years of experience with SQL 4 years of experience developing data pipelines using modern Big Data ETL technologies like NiFi or StreamSets 4 years of experience with a modern programming language such as Python or Java 4 years of experience working in a big data and cloud environment Secret Clearance or higher

Job Purpose Senior Data Analyst will be responsible for key strategic data projects We are looking for a proactive individual that can help us to continually improve and enhance our business processes gathering requirements and feedback and designing best practice solutions The Senior Data Analyst will report to the Distribution Intelligence Managing Director working within the Distribution Intelligence team Duties and Responsibilities Consult and liaise with key stakeholders to gather and

RevenueAI combines Big Data and Artificial Intelligence to create a smart Digital Assistant capable of dramatically enhancing Revenue Growth Management initiatives in organizations of any size Presently our modules support organizations in the CPG Retail and Commodity Trading We believe that every industry can exploit the available data to respond realtime to their business challenges and we are focusing on making it happen for anyone Were currently looking for a Senior Data Engineer to join our

StaffRockIt is looking for a Data architect senior Skills Expert Azure SPARK No experience but interested Snowflake Azure DevOps Compensation USD2700 3200monthly certificaciones AWS Location Remote Languages required English Fully fluent Spanish Fully fluent Responsibilities We are seeking a Cloud Data Analytics Architect primarily focused on Microsoft Azure Smartbridge is a fullservice consulting firm that simplifies business transformation for enterprise businesses Disclaimer Please be advised

Title SrData Engineer Client Sutherland End Client Genesis Location Akron OH Beaverton OR Day1 Onsite Duration Fulltime JOB DESCRIPTION 5 years of related work experience in an AzureDatabricks and SQL Server environment Demonstrable working knowledge of database design and data movement in a cloudbased environment Handson experience with SQL Server Azure Databricks ADF and Power BI strongly preferred Working knowledge of modern programming languages such as C Python and Scala Ability to

5 years experience as a data warehouse engineerarchitect designing and deploying data systems in a startup environment Mastery of database and data warehouse methodologies and techniques from transactional databases to dimensional data modeling to wide deformalized data marts Deep understanding of SQLbased Big Data systems and experience with modern ETL tools Expertise in designing data warehouses using Google Big Query Experience developing data pipelines in Python Firm believer of data driven

WeAreCrowdStrike and our mission is to stop breaches As a global leader in cybersecurity our team changed the game Since our inception our market leading cloudnative platform has offered unparalleled protection against the most sophisticated cyberattacks Were looking for people with limitless passion a relentless focus on innovation and a fanatical commitment to the customer to join us in shaping the future of cybersecurity Consistently recognized as a top workplace CrowdStrike is committed to

Hi everyone StaffRockIt is looking for a Data architect senior Skills Expert Azure SPARK Compensation USD2700 3200monthly certificaciones AWS Location Remote Languages required English Fully fluent Spanish Fully fluent Applying through Torre is super simple using the following link httpstorrecoskjnFOfjiq8 Responsibilities and more Interact with customers and sponsors and delivery teams including partners focused on solving missioncritical business and technology problems and provide solutions

We are looking for a Senior Python Developer to join our team As a member of the engineering team you will work closely with data scientists and play a key role in designing and building stateoftheart data platforms supporting the companys predictive models of training and inferencing tasks The Data Engineer needs to be able to work with internal team members to clarify data requirements and work with software engineers on design and implementation details to achieve highquality data ingestion

For over 10 years Zscaler has been disrupting and transforming the security industry Our 100 purpose built cloud platform delivers the entire gateway security stack as a service through 150 global data centers to securely connect users to their applications regardless of device location or network in over 185 countries protecting over 4500 companies and 100 Million threats detected a day We work in a fast paced dynamic and make it happen culture Our people are some of the brightest and

Position Big Data Lead Location Jersey NJ Candidates should come to office every Tuesday Thursday Duration Full Time Description Position Purpose A technical expert in developing coding testing and debugging new software or making significant improvements to existing software Experience and expertise must be significant to support the software design phases Could be responsible for overall design development and team coordination on the business systemapplication Significant independent judgment

Job Description Qualifications At Ford Motor Company we believe freedom of movement drives human progress We also believe in providing you with the freedom to define and realize your dreams With our incredible plans for the future of mobility we have a wide variety of opportunities for you to accelerate your career potential as you help us define tomorrows transportation Ford Motor Company is proud to be an Emerald sponsor of the Grace Hopper Conference and we are excited to be a part of this

JOB DESCRIPTION REMOTE Opportunity Work with a team of experienced Developers who value innovative collaboration We are seeking a candidate who is excited about the opportunity to lead grow and provide creative solutions Day to day tasks include modifying application programs from detailed specifications in addition to completing codes tests debugs documents and the maintenance of programs Essential Functions Conducts and coordinates the analysis design and implementation of computer based

Required Big Data Trainer who is expert in following topics IT SKILLS Programming Languages SQL PLSQL Java Scala and UNIX Big Data Tools Hadoop Map Reduce Spark Airflow Nifi HBase Hive Pig Sqoop Kafka Oozie Databases Oracle 12c11g10g MY SQL SQL Server Teradata R15R14 NO SQLMongoDB Cassandra Hbase Cloud Platform AWS Microsoft Azure GCP AWS Cloud Management Amazon Web Services AWS EC2 EMR S3 Redshift EMR Lambda Athena ETLData warehouse Tools Informatica 9691 and Tableau Job Types Parttime

Required Big Data Trainer who is expert in following topics IT SKILLS Programming Languages SQL PLSQL Java Scala and UNIX Big Data Tools Hadoop Map Reduce Spark Airflow Nifi HBase Hive Pig Sqoop Kafka Oozie Databases Oracle 12c11g10g MY SQL SQL Server Teradata R15R14 NO SQLMongoDB Cassandra Hbase Cloud Platform AWS Microsoft Azure GCP AWS Cloud Management Amazon Web Services AWS EC2 EMR S3 Redshift EMR Lambda Athena ETLData warehouse Tools Informatica 9691 and Tableau Job Types Parttime

Our Data Engineering group builds and maintains the platform that delivers accessible data to power decisionmaking at Shopify for millions of merchants Were hiring highimpact developers across teams The Engine group organizes all merchant and Shopify data into our data lake in highlyoptimized formats for fast query processing and maintaining the security and quality of our datasets The Analytics group leverages the Engine primitives to build and deliver simple and useful products that power

Hello Immediate interview for Senior Quality Veeva Vault specialistAdministrator Remote Primary Responsibilities include Partner with core team to identify and map integration connections fieldsobjectsworkflows between systems Analyze and assess the compliance and operational impact and potential risks involved with configuration changes and existing workflows processes procedures and training materials Author newrevised documentation as assigned Solicit input from stakeholders to identify eQMS