Hiring - Big data lead - Multiple across US

Thu Aug 15 2024 15:09:54
apply   |   share

 

Position : Big Data Lead

Mode : Hybrid

Type : W2 contract

3 days onsite - Locations below.  

 Chandler, Arizona

Phoenix, Arizona

San Fran, California

Palo Alto, California

Minneapolis, Minnesota

Shoreview, Minnesota

Charlotte, North Carolina -

New York, New York - 42nd st & Hudson Yards locations

Summit, New Jersey

Philadelphia, PA

Addison, TX

Irving, TX

Westlake, TX

McLeans, VA

 Top Skills' Details

1) Experience building/standing up a big data on-prem solution (Hadoop, Cloudera, Hortonworks), data lake or data warehouse or similar solution.

2) All roles require 100% hands on experience and strong data foundations. These skills MUST be on prem NOT in the cloud, if you have both that’s fine but they need these skills from an on-prem big data environment.

3) Big Data Platform (data lake) and data warehouse engineering experience. Preferably with Hadoop stack: HDFS, Hive, SQL, Spark, Spark Streaming, Spark SQL, HBase, Kafka, Sqoop, Atlas, Flink, Kafka, Cloudera Manager, Airflow, Impala, Hive, HBase, Tez, Hue, and a variety of source data connectors. Solid hands-on software engineer who can design and code Big Data pipeline frameworks (as a software product - Cloudera ideally) – not just a “data engineer” implementing spark jobs, or a team lead for data engineers. Building self-service data pipelines that help automate the controls to help build the data pipeline and ingest data into the ecosystem (data lake) and transform it for different consumption to support GCP, Hadoop on Premise, bring in massive volumes of Cybersecurity data , validating data and data quality.

4. solid PySpark Developer – experience working with Spark Core, Spark Streaming, Spark Optimizations – know how to optimize the code, PySpark API. Experience writing PySpark code. PySpark with solid Hadoop data lake foundations

5. Airflow experience - just using it and developing workflows in Airflow.

Thanks & Regards

 

Kamran Kamal 

Technical Recruiter 

 

Tigerbells LLC

Suite 52, 1405 Chews Landing Rd.

Laurel Springs, NJ 08021

 Phone: +1 609 375 8893

E: kamran@tigerbells.com

W:www.tigerbells.com

 

 

Posted by:
Kamran Kalaml Ahmad
Email: kamran@tigerbells.com

View all job posts.