Hiring - PySpark Developers - Mclean VA or Richmond, VA

Wed Aug 28 2024 16:22:10
apply   |   share

 

Capital One

Job Role: PySpark Developers 

Location: Mclean VA or Richmond, VA

Job Type: W2 Contract 

 

One round interviews

 

PySpark Developers working in AWS

5 years of experience ideal, but flexible

EMR in AWS, Hadoop

 

Large regulatory reporting application - supports 7 regulatory reporting use cases, for other banks this would have to be 7 different applications due to the scale

Pulls data from all systems across C1, do large transformations and prepare regulatory reporting and report to the Fed daily

Need good Data Engineers who can write good code in PySpark - full lifecycle of data pipelining & creating new PySpark pipelines

Test automation is important - need to be able to write their own unit test code - 99.5% test coverage for this application

Strong data engineering skills, not about writing SQL scripts, true PySpark pipelining with super strong code

Databricks nice to have

Application is most downstream app at C1

 

Posted by:
Rahul Yadav
Email: rahul@tigerbells.com

View all job posts.