Hadoop Data Engineer Job at E-IT Professionals Corp, Scottsdale, AZ

ck80NVc3OVJVUDhyVHFpc0NER2E1NlRqVEE9PQ==
  • E-IT Professionals Corp
  • Scottsdale, AZ

Job Description

Role : Hadoop Data Engineer

Location : Scottsdale AZ (100%)

Hire Type : Contract

Key Responsibilities

Design develop and maintain scalable data processing applications using Java (8 or above) and Spring Boot.

Build and optimize big data pipelines using Spark and Scala for large-scale data processing.

Develop and consume RESTful web services for data integration and platform interoperability.

Implement and manage batch and streaming data pipelines using Spark Streaming and Kafka.

Write optimized Hive queries and SQL focusing on performance and scalability.

Work on distributed data platforms leveraging Hadoop ecosystem components.

Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.

Ensure code quality through reviews version control and CI/CD best practices.

Troubleshoot and resolve performance scalability and data reliability issues.

Required Skills & Qualifications

8 12 years of hands-on experience in Java (version 8 or above).

Strong expertise in Spring Boot framework.

Excellent proficiency in Apache Spark and Scala.

Strong experience with Hive SQL optimization Hadoop and Kafka.

Solid understanding of RESTful web services.

Experience with version control systems such as Git / GitLab.

Hands-on experience with build tools like Maven and/or Gradle.

Strong understanding of distributed systems and big data architecture.

Experience with streaming frameworks such as Spark Streaming and Kafka Streams.

Experience working in large-scale enterprise data platforms.

Exposure to performance tuning and capacity planning for big data systems.

Knowledge of DevOps or CI/CD pipelines is a plus.

Job Tags

Full time, Contract work

Similar Jobs

Insurance Administrative Solutions, L.L.C.

Claims Adjuster II Job at Insurance Administrative Solutions, L.L.C.

 ...Claims Adjuster II Insurance Administrative Solutions Clearwater, FL About Insurance Administrative Solutions Insurance Administrative...  ...Integrity Integrity is one of the nations leading independent distributors of life, health and wealth insurance products.... 

Mercy Health

Chaplain Job at Mercy Health

 ...dignity, integrity, service and stewardship to create an environment where associates want to work and help communities thrive. Chaplain St. Anne Hospital Job Summary Under the direction of the Director of Mission or Director of Spiritual Care, the Chaplain I... 

Ochsner Health

Phlebotomist Specimen Processor - OLGMC Lab - Full Time Job at Ochsner Health

 ...discover your future today! This job performs various laboratory functions to support the department in patient care. Conducts phlebotomy procedures; processes and receives specimens; accessions specimens; distributes specimens; and performs and results specific test... 

Dental Metrics Maven

Denture Technician Job at Dental Metrics Maven

 ...quality dentures from start to finish . Key Responsibilities: Complete full denture setups from start to finish. Perform waxing, setup, finishing, and adjustments. Maintain high aesthetic and functional standards. Work collaboratively with a small team... 

SGS Consulting

Healthcare Consultant I Job at SGS Consulting

 ...enrollers. Utilizes critical thinking and judgment to collaborate and inform the case management process, to facilitate appropriate healthcare outcomes for members by providing care coordination, support and education for members using care management tools and resources....