Algorithm & ML Staff Engineer

Key Responsibilities

• Architect, build and deploy LLM powered agent systems (chatbots, copilots, agents) that are safe, fast, and cost-efficient
• Own the whole product development life cycle: build → prototype → evaluate → harden → monitor
• Build retrieval-augmented generation (RAG) pipelines (indexing, chunking, embeddings, reranking, grounding)
• Apply context engineering (prompt design, tool calling, memory, compression, window strategy)
• Integrate tools through Model Context Protocol (MCP) and other agent frameworks
• Design and deploy production-grade chatbots with multi-turn conversation flows, escalation mechanisms, and integrated safety guardrails for seamless use across web, mobile, and internal platforms
• Implement risk controls (safety filters, jailbreak resistance, PII redaction, abuse detection, audit logs)
• Optimize performance (latency, efficiency, token/cost budgets, streaming, caching, model routing)
• Establish evaluation: golden sets, RAG/grounding scores, toxicity, A/B tests, latency & cost benchmarks
• Operate in production: tracing, prompt/version lineage, drift detection, incident response, SLOs
• Collaborate with cross-functional teams, including software, hardware, and data science, to ensure algorithms meet product requirements and are well-integrated into production systems
• Mentor junior AI engineers, set coding standards and documentation, and advocate for guidelines in LLM engineering including reproducibility, ensuring algorithm reliability and transparency