Hiring - Data Engineer with Scala/pyspark - 100% Remote

Job Description

Job Position: Data Engineer with Scala/pyspark

Job Type: W2 Contract

Location: 100% Remote

Duration: Long term contract

Data Engineer Requirements:

- 3+ years of experience building scalable data pipelines with Scala and Spark

- Strong Scala programming skills and knowledge of functional programming

- Experience with Spark Scala, DataFrames, Datasets, and Hadoop Filesystem

- Knowledge of AWS services like EMR, S3, OpenSearch etc.

- Familiarity with CI/CD best practices and experience with Jenkins, Git, and Azure DevOps

- Ability to optimize Spark jobs for performance and cost efficiency

- Experience supporting production data pipelines and ETL processes

- Excellent communication skills and ability to quickly ramp up on our tech stack