Skip to content

AI Software Engineer, Agent Harness

EnCharge AIIndiaOn-Site

Estimated salary, not published by the employer: Est. ₹16–24 LPA

Needs a free Superjobs account. You'll finish on EnCharge AI's Greenhouse page.

Skill score

Summary

This role builds and owns the agent harness that runs open-weight and bespoke models on EnCharge hardware, covering the agent loop, permissions, memory, tool use, outputs, and evaluation. It suits a senior engineer with 10+ years in backend or ML infrastructure who has shipped agent systems to production and enjoys defining the roadmap in an ambiguous setting.

Function
Development
Estimated salary
Est. ₹16–24 LPA
Estimated for a mid-level role, ~10 yrs experience, India. Not published by the employer.
Work mode and location
On-Site, India
Experience
10+ yrs

Job description

Overview

Location: Bengaluru, Karnataka (or throughout India remote-friendly with travel)

We serve open-weight models and our own bespoke checkpoints on EnCharge hardware. The models change often, and the harness around them needs to keep up. You own this layer that runs agents against files, tools, documents with permissions, memory, unattended execution, and real outputs. It will be assembled from a combination of open-source and bespoke code.

Roles and responsibilities

  • Own the harness architecture end to end — agent loop, safe execution, context management, knowledge base, memory, permissions, orchestration, outputs, interfaces, observability — one component per layer, with clear interfaces so layers can be swapped.
  • Build the pieces with no open-source equivalent e.g. session semantics, enforced permissions, memory in a human-editable file, orchestrator, and outputs.
  • Keep pace with the models: adapters, prompt formats, tool-call schemas, stop conditions, benchmarking and evaluation.
  • Make tool use reliable across models of uneven tool-calling quality — validation, repair, retries, fallbacks.
  • Develop agents, tools, and MCP servers for internal and customer use cases, and review them for security before they ship.
  • Build the evaluation harness: task suites, regression runs on every model or harness change, cost and latency per task alongside quality.
  • Define the interfaces: session API, CLI, GUI, and an endpoint existing tools can point at.

Skills required

Top skills

  • Python
  • Systems language (Go, Rust, C++)
  • Agent loop design
  • Tool use

All skills (8)

  • RAG
  • Context management
  • LLM memory
  • Sandboxing and isolation
  • Permission models
  • Open-weight model serving
  • Quantization
  • Agent benchmarks

Qualifications

  • 10+ years of software engineering experience in backend systems or ML infrastructure
  • Strong Python and at least one systems language (e.g., Go, Rust, C++)
  • Have shipped and operated an agent loop in production — tool use, multi-step workflows, unattended runs
  • Hands-on with RAG, context management, and memory for LLM applications
  • Experience with sandboxing, isolation, and permission models for automated systems
  • Have run open-weight models yourself and understand how quantization and serving choices change model behavior
  • Comfort in fast-moving, ambiguous environments where you define the roadmap; strong product instincts

Nice to have

  • Contributions to open-source agent harnesses or coding agents
  • Experience with agent benchmarks (e.g., SWE-bench, Terminal-Bench) and building internal task suites
  • MoE serving familiarity e.g. expert placement, tensor parallelism, quantization etc.
  • Observability for LLM systems
  • Document parsing and indexing pipelines
  • Desktop or GUI application experience

Company info

EnCharge AI is building the next generation AI platform. Our novel in-memory-computing architecture delivers a 10x step-function improvement in compute energy efficiency and performance for AI inference workloads. We are an experienced team of AI researchers, silicon & systems engineers, and architects backed by leading investors, poised to become the

More jobs at EnCharge AI