Hadoop Developer Job at Siri InfoSolutions Inc, Charlotte, NC

b1NiT3RmUVZEbkhuZTFKYzJFZFcwNjdk
  • Siri InfoSolutions Inc
  • Charlotte, NC

Job Description

Hadoop developer

Charlotte, NC | 10 - 15 years of experience

Duration: Full Time

Job Description

Must Have Technical/Functional Skills

Primary Skill: Spark, Java, Hive, SQL

Secondary: Unix, Kafka, Python

Experience: 10+ years

Roles & Responsibilities

We are seeking a highly experienced Hadoop Spark Developer with 10+ years of expertise in Big Data technologies, including Java, Spark, Hadoop Ecosystem and Hive. The ideal candidate will be responsible for designing, developing, optimizing, and maintaining large-scale data processing solutions. Experience with Microsoft Copilot for AI-assisted development and productivity enhancement is highly desirable. The developer should hold a bachelor's or master's degree.

The candidate should possess strong analytical skills, hands-on experience in distributed data processing, and the ability to work closely with business stakeholders, architects, and data engineering teams.

Design, develop, and maintain scalable Big Data solutions using Hadoop and Spark.

Build and optimize ETL/ELT pipelines using Java, Spark, Hive, and Python.

Process and analyze large datasets in distributed environments.

Develop high-performance Spark jobs and optimize existing workloads.

Create and manage Hive tables, partitions, views, and complex queries.

Implement data quality, data validation, and reconciliation frameworks.

Perform code reviews and ensure adherence to coding standards and best practices.

Utilize Microsoft Copilot to accelerate development, automate code generation, troubleshooting, documentation, and testing activities.

Strong experience building both batch and real-time streaming applications with Kafka.

Collaborate with Data Architects, Data Scientists, Business Analysts, and DevOps teams.

Troubleshoot production issues and perform root cause analysis.

Design data ingestion frameworks for structured, semi-structured, and unstructured data.

Participate in Agile ceremonies including sprint planning, estimation, and retrospectives.

Mentor junior developers and provide technical leadership.

Job Tags

Full time

Similar Jobs

FUJIFILM Biotechnologies

Warehouse Associate Job at FUJIFILM Biotechnologies

Position OverviewThe warehouse worker will report to the operations supervisor and be responsible for inbound processing, storing, picking, packaging and outbound shipping of Fujifilm products (including other product lines sold by Fujifilm).Company OverviewAt FUJIFILM ...

Ostlund - A Service Company

Tile/Facilities Technician (Day & Night Shifts) Job at Ostlund - A Service Company

 ...About the Role: Ostlund, a trusted name in facilities maintenance and specialized services, is seeking dedicated Tile/Facilities Technicians to join our growing team. Youll play a key role in maintaining, repairing, and installing tile and supporting overall facility... 

Bullock Protection LLC

Armed Security Officer Job at Bullock Protection LLC

 ...Job Posting: Armed Security Officer Bullock Protection LLC Job Description Bullock Protection LLC, a leader in private security services, is currently seeking to fill a role for a dedicated and vigilant Armed Security Officer. The chosen candidate will be part... 

The Park School

School Receptionist (Part-time) Job at The Park School

 ...Job Title: School Receptionist Reports to: Executive Assistant to School Leadership Compensation: Role-Based Employment Classification: 10 Month, Staff/Non-Exempt This position is a part-time role with responsibilities on Tuesdays, Thursdays, and... 

Figure

Mechanical Engineer Intern [Fall 2026] Job at Figure

 ...human level intelligence. Its robots are engineered to perform a variety of tasks in the...  ...San Jose, CA. We are looking for a Mechanical Engineering intern for Fall 2026 to design...  ...for our humanoid robot. This internship is designed for students in their final...