AI Principal Architect
MastercardPune, IndiaOn-Site
Needs a free Superjobs account. You'll finish on Mastercard's site.
Skill score
Summary
This Principal Architect defines the architecture, standards, and technical roadmap for an agentic Gen AI platform at Mastercard's B&MI group, covering tool calling, agent orchestration, memory, retrieval, and LLMOps. It suits a senior backend or distributed systems architect who has moved into LLM systems and stays hands-on with prototypes while leading design reviews and mentoring.
- Function
- Development
- Estimated salary
- Est. ₹20–30 LPA
- Estimated for a staff-level role, ~9 yrs experience (typical for the level), India. Not published by the employer.
- Work mode and location
- On-Site, Pune, India
- Employment type
- Full-time
Job description
Overview
AI Principal Architect
We're looking for a Principal Architect, Generative AI & ML Engineering, for the Operational Intelligence Program within B&MI. As a principal-level technical leader, you'll define the architecture vision and technical strategy for our agentic AI platform. On this platform, agents make extensive tool calls into enterprise services and APIs and must run securely, reliably, and at scale. You'll set the standards teams build on across tool calling, multi-agent orchestration, self-correcting agents, memory, retrieval, and LLMOps. You'll also make the key decisions on models, platforms, and trade-offs. Working closely with engineering, product, security, and business leaders, you'll shape the long-term direction of Gen AI across B&MI and mentor architects and senior engineers. You'll also stay hands-on with prototypes that de-risk big bets. The hardest problems in enterprise Gen AI are reliability, integration, security, and scale. If you've solved them as a backend or distributed systems architect and have started applying that experience to LLM systems, we'd love to hear from you.
Roles and responsibilities
- Own the architecture and technical roadmap for the Operational Intelligence Gen AI platform, defining reference architectures and standards that teams across the program can reuse and scale.
- Architect the enterprise tool-calling layer, setting standards for how internal services, data platforms, and external APIs are exposed to agents as tools. This covers schemas, contracts, versioning, access control, and resilient execution (parallel and chained calls, retries, timeouts, idempotency, circuit breakers, and fallbacks).
- Set the architecture for multi-agent and skills-based agent systems (e.g., LangGraph, CrewAI, AutoGen), including when to use agents versus deterministic workflows and how agents coordinate, delegate, and share context.
- Design self-correcting agent patterns: tool critics and verifiers that check tool selection, arguments, and results, plus reflection and plan-and-execute loops that catch errors before agents act or respond.
- Architect agent memory and state for long-running, multi-step sessions, including short- and long-term memory (e.g., Mem0, Zep, LangGraph memory), session persistence, and memory scoping and retention.
- Define retrieval architecture for grounded reasoning, including Self-RAG, Corrective RAG (CRAG), adaptive retrieval, and Graph-RAG, built on vector databases (e.g., Pinecone, pgvector, OpenSearch) and knowledge graphs (e.g., Neo4j, AWS Neptune).
- Design the inference and orchestration layer for high throughput, covering async processing, streaming, caching, rate limiting, and model routing across OpenAI, Anthropic, Gemini, and open-source models.
- Establish the LLMOps architecture on Databricks (AWS), including MLflow, CI/CD for prompts and agents, and model lineage. Set platform-wide evaluation and observability standards: end-to-end tracing of tool calls, tool-selection accuracy, task success rates, cost, and latency.
- Build security and Responsible AI into the architecture, including guardrails, prompt-injection defenses, hallucination mitigation, data privacy, and audit trails that meet Mastercard's data ethics and regulatory standards.
- Own key architecture decisions and trade-offs, such as build versus buy, model and vendor selection, and cost versus latency versus accuracy, documented through architecture decision records. Assess emerging models, frameworks, and standards such as MCP for production readiness.
- Lead design reviews and partner with engineering, product, security, and data teams to align on architecture and raise the engineering bar across the program.
- Stay hands-on, building prototypes and reference implementations that de-risk decisions and give teams a working starting point.
Skills required
Top skills
- Distributed systems architecture
- Microservices
- API design
- LLM agents
All skills (8)
- Tool calling
- Python
- SQL
- AWS
- Security and compliance
- Retrieval-augmented generation
- LangGraph
- Knowledge graphs
Qualifications
- Bachelor's or Master's degree in Computer Science, AI/ML, or Engineering, or equivalent practical experience.
- Significant experience architecting large-scale distributed systems in production, including microservices, event-driven systems, data platforms, and cloud-native infrastructure.
- Deep expertise in API design and systems integration, including contracts, security models, and reliability patterns for services consumed by many teams. You understand what changes when the consumer is an LLM.
- Hands-on experience designing and shipping LLM-powered systems in production, especially agents that use tool/function calling, memory, and retrieval, and a clear view of how they fail.
- Strong Python skills for hands-on prototyping (async programming, FastAPI or similar), plus SQL proficiency.
- Deep experience with at least one major cloud platform (AWS preferred; Azure or GCP welcome), including its AI services such as Bedrock, SageMaker, Azure OpenAI, or Vertex AI.
- A solid grounding in security, privacy, and compliance for enterprise systems, ideally in financial services or another regulated industry.
- The ability to influence without authority, aligning engineering, product, and leadership around a technical direction and explaining trade-offs in business terms.
Nice to have
- Nice to have: hands-on experience with tool critics, Self-RAG, CRAG, reflection loops, memory frameworks such as Mem0 or Zep, MCP tool servers, or agent evaluation frameworks.
- Nice to have: exposure to fine-tuning (LoRA, PEFT, RLHF), multimodal models, or knowledge graphs.
- Coming from backend or distributed systems architecture? The hardest problems in enterprise Gen AI are reliability, integration, security, and scale, and you've solved them before. If you've started applying that experience to LLM systems, we want to hear from you, even if you haven't used every tool listed here.
Company info
About Mastercard
Mastercard is a global payments company that provides payment transaction processing and related payment services, including credit, debit and prepaid card payments that let people, businesses and governments transact securely. Its products and services are used by consumers, merchants and card-issuing banks and credit unions worldwide.
Recent news
Mastercard Expands Crypto Card Program with New Partnerships
Mastercard Appoints Former PayPal Exec as New Chief Financial Officer
Mastercard Unveils New Sustainable Card Program