Software Engineer
Back to Job Search

Software Engineer

Reference: AF-002
Location
Mountain View, CA, USA
Salary
Competitive
Contract Type
Permanent
Work Arrangement
In-Office (Full-Time)
Skill Requirements
  • Software Engineering
  • Machine Learning Engineer

US Citizens/Green Card only

Work on cutting-edge AI infrastructure, contributing to next-generation high-performance compute systems supporting enterprise-scale machine learning and scientific workloads.

Overview

Seeking a Runtime Engineer to build high-performance system software powering large-scale AI and ML workloads. This role focuses on developing low-level infrastructure that maximizes hardware efficiency and enables scalable, distributed compute across enterprise AI platforms.

 

Key Responsibilities

Core Engineering

  • Design and develop runtime stack features for high-performance ML training and inference
  • Build system-level software including drivers, kernel integrations, and OS interfaces
  • Develop high-performance user-space libraries for optimal hardware utilization

Distributed Systems & Performance

  • Enable scalable data processing across distributed environments
  • Optimize networking, communication, and workload orchestration across nodes
  • Improve system performance, reliability, and observability

Tooling & Ecosystem

  • Build user-facing tools for profiling, debugging, and system management
  • Support orchestration, monitoring, and error handling across compute systems
  • Collaborate cross-functionally with hardware, ML, compiler, and DevOps teams

Profile

  • 3–5 years of experience in systems or infrastructure engineering
  • Strong programming skills in C/C++ and Python
  • Experience with operating systems, kernel development, and user-space libraries
  • Background in distributed systems with focus on scalability and performance

Preferred Strengths

  • Familiarity with high-speed interconnects (e.g., PCIe, InfiniBand, RoCE)
  • Experience with low-latency networking (e.g., RDMA)
  • Strong debugging, optimization, and collaboration skills

Apply Now

Please fill in the form below to apply for this job.

Apply Now
Get in touch
Alex Ford image
Alex Ford
Similar Jobs
20th Apr 2026

Staff Software Engineer (Remote)

Remote WorkingSoftware Engineering
20th Apr 2026

Staff Software Engineer

Remote WorkingSoftware Engineering
13th Mar 2026

Flight Software Engineer

In-Office (Full-Time)Software Engineering

Get in touch.

oho connects the future to your hands. Let us know what we can do for you.