Infrastructure and Automation Engineer

DualbirdTel Aviv

Mid-levelHybridFull-timeDevOps & SRE

Apply on the employer’s site

Confirmed open at the employer 2 days ago · Posted 1 month ago

Listing published by its original source and linked back to it. The employer did not pay Jobsworm for this listing.

Requirements

qapythonpytestkubernetesawsemrs3ec2eksnetworkingci/cdobservabilitymonitoringlinux

Nice to have

sparkapache iceberg

Job description

Description

DualBird is building a next-generation data acceleration platform that brings hardware-level performance to cloud infrastructure with software-level simplicity.

We’re looking for an Infrastructure & Automation Engineer to build automated systems that validate our Spark acceleration layer at large scale.

The role

You will design and operate our CI/CD for our core framework. This is a SW role focused on building infrastructure and internal tools on AWS (EMR/EKS) to ensure data correctness, system stability, and performance parity.

What you’ll do

Framework Development: Build an automation frameworks to build, validate, orchestrate, and release out SW suites.
CI/CD Integration: Integrate automated tests into GitHub Actions CI pipelines, ensuring every release correctness and performance.
System and CI Monitoring: Implement observability (Prometheus/Grafana/CloudWatch) to monitor our SW health.
Cross-Team Collaboration: Work with low level system architechts to provide automated feedback loops for hardware-level optimizations.

Requirements

What you bring

4–7+ years of experience: Proven track record in SW development, QA automation or DevOps within cloud or distributed data environments.
Advanced Python: Ability to build complex, modular automation tools (Pytest, custom SDKs, Build tools, debug tools).
Cloud & K8s: Hands-on experiennce with AWS (EMR, S3, EC2) and EKS (Kubernetes) networking/orchestration.
CI/CD & Observability: Experience building automated release pipelines and monitoring distributed system as well as SW helath.
Advantage: Spark & Data Lakes: Technical knowledge of Apache Spark (shuffles, memory tuning, executors) and Apache Iceberg.
Linux/Systems: Strong CLI skills and comfort debugging failures across the OS and container layers.

Listing published by its original source and linked back to it. Jobsworm does not receive payment from employers.