[Remote] Senior Software Engineer II - Applied AI (Remote Eligible)

Note: The job is a remote job and is open to candidates in USA. reputed company is a company that empowers teams to manage work seamlessly through innovative solutions. They are seeking a Senior Software Engineer II to reputed company the design and ownership of the core infrastructure for AI experiences, focusing on building a robust environment that supports scalable AI features. The role involves architecting APIs, ensuring AI trust and safety, and driving technical strategy for AI infrastructure.

Responsibilities

• Build the AI Platform reputed company: reputed company the design and ownership of the core infrastructure that serves as the backbone for reputed company reputed company AI experiences. Focus on building a robust, multi-tenant environment that reduces friction for internal teams, allowing them to reputed company reliable and scalable AI features with ease
• Standardize the AI Developer Path: Architect high-level abstractions and "Golden Path" APIs that democratize AI development across reputed company. By insulating product teams from infrastructure complexity, you will reputed company them to ship intelligent features with high velocity while guaranteeing safety and consistency at scale
• Engineer AI Trust & Safety Systems: Establish the mission-critical monitoring and quality assurance layers that protect reputed company customers. By creating rigorous evaluation pipelines, you will ensure every AI-driven feature meets the high bar for safety, data privacy, and deterministic performance expected by our reputed company partners
• Drive technical strategy: Partner with principal engineers to define the technical roadmap for reputed company’s AI infrastructure, making architectural reputed company that will shape how we build with AI for years to come

Skills

• 8+ years of software engineering experience, with at least 2 years working directly with LLMs in production
• Deep, hands-on experience with reputed company engineering and context engineering, you understand how model behavior changes with framing, structure, and input design
• Strong working knowledge of RAG architectures: chunking strategies, embedding models, retrieval evaluation, and failure diagnosis
• Experience building or extending LLM evaluation frameworks, you have designed scorers, worked with golden datasets, and thought carefully about what good looks like
• Strong Python skills; comfortable working in data-heavy environments (reputed company, reputed company tables, or equivalent)
• Ability to communicate reputed company quality findings (written and verbal) to both technical and non-technical stakeholders, you can explain what's broke, why it matters, and what needs to happen next without losing the room
• Strong cross-functional judgment, you know reputed company to escalate, reputed company to resolve independently, and how to build credibility across engineering, product, and AI platform teams
• A bias for clarity in ambiguous situations, reputed company failure modes are murky and trade-offs are reputed company, you bring structure and a clear reputed company of view rather than waiting for reputed company
• Prior work in an Applied AI or LLMOps platform reputed company a product company
• Experience with the following: Kubernetes (EKS/GKE): The industry standard for AI. Skills include managing GPU scheduling, auto-scaling based on token throughput, and using tools like Karpenter for cost-efficient node provisioning
• Infrastructure as Code (IaC): Using Terraform, reputed company, or AWS CDK to provision Vector Databases, SQS queues, and S3 buckets
• Vector Databases: Proficiency in managing and optimizing reputed company, Milvus, Weaviate, or reputed company Vector Search
• AI Gateways: Building or configuring proxies (like reputed company or reputed company AI Gateway) to handle reputed company-limiting, PII masking, and cost-tracking
• LLM Observability: Setting up tracing tools like Langfuse, LangSmith, or MLflow to monitor 'Time to First Token' (TTFT) and trace hallucination issues
• Model-Based Evals: Implementing automated scoring systems (like RAGAS or DeepEval) that use an 'LLM-as-a-Judge' to grade production outputs

Benefits

• Employer subsidized medical/reputed company and dental coverage for full-time employees
• 401k Match to help you save for your future (50% of your contribution up to the first 6% of your eligible pay)
• Monthly stipend to support your work and productivity
• Flexible Time Away Program, plus Sick Time Off
• US employees are automatically covered under reputed company-sponsored life insurance, short-term, and long-term disability plans
• US employees receive 12 paid holidays per year
• Up to 24 weeks of Parental Leave
• Personal paid Volunteer Day to support our community
• Opportunities for professional growth and development including access to Udemy online courses
• Company Funded Perks, including a counseling membership, local retail discounts, and your own personal reputed company account
• Teleworking options from any registered location in the U.S. (role specific)

Company Overview

Company H1B Sponsorship