You

Profile
Goals

Community

People

Pay & Market Info

Roles
Employers
Qualifications

Job Search

Jobs

Preferences

CurrencyUSD

Support

About
Feedback
Help

← Back to jobs

BranchFactor

You

Profile
Goals

Community

People

Pay & Market Info

Roles
Employers
Qualifications

Job Search

Jobs

Preferences

CurrencyUSD

Support

About
Feedback
Help

← Back to jobs

LLM Inference Engineer at Near AI — BranchFactor

← Back to jobs

Apply →

LLM Inference Engineer

Near AI · San Francisco

Posted 6 Jul 2026

Apply →

BranchFactor Summary

The original posting with the fluff stripped out

Management level: Individual contributor
Employment: Remote

Compensation

No salary listed for this role.

Role speciality

Inference OptimizationLLM inferenceLLM serving systems

Useful technologies

CUDACuTePyTorchSGLangTensorRTTritonvLLM

Original posting

Locations: San Francisco or Remote

About The Role

The NEAR AI team is building decentralized and confidential machine learning infrastructure to enable user-owned AI. Our mission is to build highly scalable and efficient infrastructure for open-source AI at a global scale.

More openings like this

LLM Inference Engineerd-Matrix Inc. (United States) · Santa ClaraUSD 195K–285K LLM Inference EngineerHippocratic AI · Menlo Park, CA LLM Inference EngineerLG AI Research · Gangseo-gu, Seoul, South Korea Member Of Technical StaffClera · San FranciscoUSD 130K–220K See all Software Engineering openings →

We are specifically seeking an expert in high-performance LLM serving systems and inference optimization. In this role, you will push the boundaries of how large language models are served.

What You'll Be Doing

Architect and maintain production high-traffic LLM serving systems.
Optimize throughput, latency, and cost for leading open-source LLMs.

What We're Looking For

Strong hands-on experience in LLM inference, with expertise debugging and optimizing major inference engines such as SGLang, vLLM, or TensorRT.
Deep knowledge of state-of-the-art GPU architectures, and effectively exploit them using PyTorch, Triton, CuTe, CUDA, etc.
Proven track record in designing and maintaining end-to-end high-traffic LLM serving systems.
Strong problem-solving skills and ability to communicate technical ideas clearly.

We'd Love If You Have

Experience with Trusted Execution Environments (TEE).
Active contributor to open-source LLM inference engines.

Please let us know if you require any special requirements for your interview and we'll do our best to accommodate.

More openings like this

Sourced from greenhouse · original listing