AI Infrastructure / Product Engineer

About the Role

As an AI Infrastructure / Product Engineer, you will work at the intersection of AI research and product, helping turn experiments into dependable tools for legal work. You will build evaluation systems, backend services, and product features that help measure and improve applied AI in production.

What You'll Do

• Build repeatable benchmarks and evaluation pipelines for model accuracy, hallucinations, retrieval quality, latency, and cost.
• Create dashboards that make system performance changes visible to the team.
• Develop production retrieval, drafting, document, and agent workflows from research prototypes.
• Build backend services, APIs, and internal tools to test and release improvements.
• Deploy and operate cloud infrastructure, including monitoring, databases, and delivery pipelines.
• Collaborate with AI research while staying connected to product and user needs.

What We're Looking For

• At least 3 years of experience as a software, infrastructure, or product engineer building and deploying production systems.
• Strong Python skills and hands-on experience deploying software to the cloud.
• Experience building evaluation pipelines, benchmarks, or assessment systems for machine learning or AI systems.
• Experience with APIs, databases, backend services, deployment pipelines, and systems that turn experimental code into maintainable products.
• Experience building dashboards or monitoring systems to visualize performance, and operating cloud deployments reliably.

Full-stack experience is a plus. Familiarity with FastAPI, Docker, React, Next.js, Postgres, vector databases, LLMs, retrieval-augmented generation, agents, AI benchmarks, or document automation is helpful.

Compensation & Benefits

Annual base salary is $180,000 to $260,000 USD, depending on relevant skills, experience, and role scope. Visa sponsorship is not available.

Location Remote within the United States.

Originally posted on Himalayas