Lead Databricks Data Engineer Job at Techgene Solutions LLC, Remote

M3pFOVQ0bGpzYXM5UkJsbXFFWk84V2Y1VWc9PQ==
  • Techgene Solutions LLC
  • Remote

Job Description

Lead Databricks Data Engineer

Remote


We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical leader, you will leverage your expertise in cloud technologies and data engineering to ensure high performance and scalability of our data solutions. This position requires a passion for data, a commitment to innovation, and a focus on delivering efficient and effective solutions.


Key Responsibilities:


Lead a team of data engineers in the development and maintenance of scalable data pipelines for the platform.


Optimize data capture, ingestion, and processing workflows to enable advanced analytics, data science, and operational intelligence.


Collaborate with Data Platform Architects and ML Engineers to integrate feature stores, manage model deployment, and implement data preparation workflows.


Ensure data engineering processes are designed for high performance, scalability, and resource efficiency.


Provide technical leadership and mentorship to team members, fostering an environment of continuous improvement and innovation.


Design and maintain data pipelines for streaming data, batch processing, and real-time analytics.


Implement secure and scalable data capture and ingestion workflows.


Support data preparation, exploration, and visualization to facilitate data-driven decision-making.


Work closely with other engineering teams to ensure data pipelines are secure, efficient, and aligned with business requirements.


Qualifications:


Bachelor's degree in Computer Science, a technical field, or a related business discipline. Equivalent experience, certifications, or training will be considered. Master degree preferred


5+ years of experience in designing and delivering secure cloud solutions.


3+ years of experience with Databricks


2+ years of experience with Agile Methodology


Strong problem-solving, analytical, and communication skills.

Job Tags

Remote job,

Similar Jobs

U.S. Tsubaki Power Transmission, LLC

Mechanical Application Engineer Job at U.S. Tsubaki Power Transmission, LLC

 ...-art products available in the world and we strive to be the Best Value supplier in the industry. The Mechanical Application Engineer plays a critical role within the Engineering Chain Division and is responsible for providing the technical support necessary to correctly... 

komoot

Remote Senior iOS Developer Job at komoot

 ...Youll team up with six world class iOS engineers and take over full responsibility for...  ...easily accessible to our users. Youll develop diverse features for navigation, routing,...  ...outdoor experiences. ~ Weve been a remote-working company since 2017, meaning: We are... 

ExpertHiring

Social Worker - LMSW #ESF8316 Job at ExpertHiring

Job Type : Full Time Location : Penn Yan, New York Pay : Great Pay + Benefits! Job Description What you will be doing: Work with clients, either individually or in groups, to address mental health concerns. Apply knowledge and skill...

LoveBound Destinations

Remote Appointment Scheduler (Work From Home) Job at LoveBound Destinations

 ...Job Title: Remote Appointment Scheduler (Work From Home) Location: Remote Overview: LoveBound Destinations, a premier travel agency specializing in luxury and bespoke travel experiences, is seeking a Appointment Scheduler to join our dynamic team. As a Appointment... 

Midwest Logistic Systems

Midwest Logistics Systems Dedicated nighttime truck driver Job at Midwest Logistic Systems

 ...Route and detention pay. ~$5,000 sign-on bonus for experienced drivers. ~ Safety and performance bonuses of up to $600 per quarter....  ...per quarter. ~ Weekly paychecks. Qualifications Valid Class A Commercial Drivers License (CDL). Drivers on this account...