Note: The job is a remote job and is open to candidates in USA. Modular is a company focused on creating advanced machine learning technologies, and they are seeking a Senior AI Graph Compiler Engineer. This role involves extending and developing the graph compiler to enhance performance and usability across various hardware platforms, ensuring a seamless developer experience.

Responsibilities

• Design and develop compiler optimizations to improve inference efficiency across CPUs, GPUs, and ML accelerators, including kernel fusion, memory planning, and shape optimization
• Compile large-scale application workloads onto heterogeneous hardware: map hardware-agnostic graphs of computational operators onto hardware-specific graphs of devices and nodes
• Collaborate with the kernels, serving, and Mojo compiler teams to implement core technologies that deliver end-to-end performance across a variety of heterogeneous hardware platforms
• Write design documents for new features and drive for alignment on designs with cross-functional teams
• Collaborate with the customer success team and engage with customers to understand their performance requirements and use cases

Skills

• 5+ years of software engineering experience
• Proficiency in C++
• Experience working with compilers for machine learning frameworks
• Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others
• Knowledge of and experience working with MLIR and LLVM
• Experience with ML parallel / distributed programming, heterogeneous ML computation, and/or code generation
• Knowledge of basic ML implementation and modeling techniques and familiarity with ML frameworks like PyTorch, JAX, or TensorFlow

Benefits

• Premier insurance plans
• Up to 5% 401k matching
• Flexible paid time off
• Stock options
• Team Building Events. We organize regular team onsites and local meetups in Los Altos, CA as well as different cities. Traveling 2-4 times a year is expected for all roles.

Company Overview

Company H1B Sponsorship