Job Description

We are looking for a Senior Hadoop Developer with strong experience in Big Data, Hadoop/Cloudera, Spark, Python, SQL, and ETL to design, develop, and support scalable data solutions in a production environment.

Roles and Requirements

4+ years of experience in Big Data and data warehousing.
Strong hands-on experience with Hadoop/Cloudera, HDFS, Hive, and Spark/PySpark.
Proficiency in Python, Scala, SQL, and Unix/Shell scripting.
Strong experience in ETL, data ingestion, transformation, and integration.
Experience with complex SQL query optimization and performance tuning.
Experience with AutoSys or similar enterprise scheduling tools.
Strong understanding of distributed systems and large-scale data processing.
Experience supporting production Big Data applications and troubleshooting critical issues.
Understanding of Agile methodologies and enterprise development/operational processes.
Strong analytical, problem-solving, communication, and collaboration skills.
Experience designing analytical/data warehouse environments and BI solutions.
Financial services/banking experience preferred.

Primary Responsibilities

Develop and maintain scalable Hadoop/Spark-based data pipelines.
Support data ingestion from multiple source systems.
Develop ETL and data transformation solutions using Hive, Spark, Python, and SQL.
Optimize SQL queries and Big Data jobs for performance.
Troubleshoot production issues and perform root-cause analysis.
Support scheduling, monitoring, and operational processes.
Collaborate with architects, developers, analysts, and business teams.
Evaluate and adopt emerging Big Data technologies where appropriate.

Job Tags

Full time

Similar Jobs

Sonsoft

Informatica,/DW Consultant @ (Any Where in USA) Job at Sonsoft

Company DescriptionSonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc... ...is a Fulltime job for youOnly US Citizen, Green Card Holder, TN Visa, GC-EAD, H4-EAD & L2-EAD can apply.No OPT-EAD & H1B Consultants please...

DAVID SUNG LEE CORPORATION

Web Developer or Front End Developer (HTML / CSS / Javascript) Job at DAVID SUNG LEE CORPORATION

...mid, or senior level web developers or front end engineers for a 6 month w2 contract.Convert designs in PSD and PDF formats into HTML/CSS pages or components.Resolve defects in existing code.Skills needed:Good communication skills - in person, written and presentation...

T-Mobile

Sr Designer, Instructional Job at T-Mobile

...coaches. Thats how were UNSTOPPABLE for our employees!Job OverviewThis role supports organizational learning by managing the instructional design process from project initiation through course evaluation. It involves planning, designing, and deploying training programs...

KA Recruiting Inc.

Blood Bank Specialist OR Medical Laboratory Scientist II at Top Hospital Job at KA Recruiting Inc.

Job Description A respected acute care hospital in Vermont is seeking an experienced Blood Bank Technologist II / Blood Bank Specialist to join its laboratory team.The MLS II/Blood Bank Technologist II functions as a generalist across all laboratory sections while ...

Zoom Tan

Beauty Consultant Job at Zoom Tan

Job description SALES ASSOCIATE Where better careers begin! Come glow with us at Zoom Tan. Salon Sales Associate Position for Zoom Tan: Do you love to help others look and feel their most confident selves? Then turn your passion into a rewarding role with...

Hadoop Developer Job at Neshent Technologies, Addison, TX