Hiring - Big data lead - Multiple across US
Position : Big Data Lead
Mode : Hybrid
Type : W2 contract
3 days onsite - Locations below.
Chandler, Arizona
Phoenix, Arizona
San Fran, California
Palo Alto, California
Minneapolis, Minnesota
Shoreview, Minnesota
Charlotte, North Carolina -
New York, New York - 42nd st & Hudson Yards locations
Summit, New Jersey
Philadelphia, PA
Addison, TX
Irving, TX
Westlake, TX
McLeans, VA
Top Skills' Details
1) Experience building/standing up a big data on-prem solution (Hadoop, Cloudera, Hortonworks), data lake or data warehouse or similar solution.
2) All roles require 100% hands on experience and strong data foundations. These skills MUST be on prem NOT in the cloud, if you have both that’s fine but they need these skills from an on-prem big data environment.
3) Big Data Platform (data lake) and data warehouse engineering experience. Preferably with Hadoop stack: HDFS, Hive, SQL, Spark, Spark Streaming, Spark SQL, HBase, Kafka, Sqoop, Atlas, Flink, Kafka, Cloudera Manager, Airflow, Impala, Hive, HBase, Tez, Hue, and a variety of source data connectors. Solid hands-on software engineer who can design and code Big Data pipeline frameworks (as a software product - Cloudera ideally) – not just a “data engineer” implementing spark jobs, or a team lead for data engineers. Building self-service data pipelines that help automate the controls to help build the data pipeline and ingest data into the ecosystem (data lake) and transform it for different consumption to support GCP, Hadoop on Premise, bring in massive volumes of Cybersecurity data , validating data and data quality.
4. solid PySpark Developer – experience working with Spark Core, Spark Streaming, Spark Optimizations – know how to optimize the code, PySpark API. Experience writing PySpark code. PySpark with solid Hadoop data lake foundations
5. Airflow experience - just using it and developing workflows in Airflow.
Thanks & Regards
Kamran Kamal
Technical Recruiter
Tigerbells LLC
Suite 52, 1405 Chews Landing Rd.
Laurel Springs, NJ 08021
Phone: +1 609 375 8893
E: kamran@tigerbells.com
Email: kamran@tigerbells.com