Infrastructure Security Lead
Together AI
Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.
Got this interview? Our apps help you get the job.
Skills named in this job
Read from the description itself, not inferred.
This role on the market
2,694 open infrastructure roles across 367 companies are on ApplySarthi right now, most of them in Bengaluru (143), Hyderabad (25), Delhi NCR (12).
- Data Center Infrastructure Engineer Intern, Summer 2027 - West CoastAmazon
- Senior Data Center Engineer - AI / HCP InfrastructureJobgether
- Software Development Engineer II — Regression Infrastructure, Trainium Manufacturing InfrastuctureAnnapurna Labs
- Principal/Senior Principal Engineer, Data Center Physical Infrastructure, Data Center EngineeringAmazon Web Services
- Infrastructure Engineer III - AWS Cloud Infrastructure & SecOps EngineerJPMorgan
What infrastructure roles keep asking for: Python (32%), AWS (30%), Observability (26%), Kubernetes (25%), System design (25%), Linux (19%), Terraform (19%), CI/CD (17%) — counted across their open postings here.
AWS jobs · Ansible jobs · GCP jobs · Linux jobs
Together AI has 80 open roles listed here.
- CX Ops Specialist
- Engineering Manager, Kubernetes Bare Metal Infrastructure
- Senior Web & Inbound Growth Manager
- Strategic Account Executive Inference India
- Sr. Field Marketing & Community Manager
Counted across 14 company job boards, updated as roles open and close.
Preparing for this interview
Interviews for infrastructure roles keep coming back to Python, AWS, Observability, Kubernetes. Practise those questions before you sit with Together AI.
Questions you are likely to be asked
- Why do you want to join Together AI?
- What is your experience with System design? Tell me one thing you learned the hard way.
- Walk me through how code gets from a commit to production where you work.
- Tell me about an outage you handled. What did you learn from it?
- How do you decide what to monitor, and what should wake someone up at night?
Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.
Practise the Infrastructure Security Lead at Together AI interview free →About Together AI
Together AI is a research-driven AI infrastructure company building the go-to platform for developers to run, fine-tune, and build on open models. We believe open and transparent AI systems drive innovation and create the best outcomes for society, and we're on a mission to dramatically lower the cost of modern AI systems. Our team has helped ship foundational open-source research like FlashAttention, FlexGen, and RedPajama — and we're building the next generation of AI infrastructure.
About the Role
We're looking for a hands-on security leader to own infrastructure security.
You'll be the technical owner of how we keep our systems secure, building internal security tooling, deepening our detection and telemetry, and hardening our global infrastructure against threats that range from opportunistic attackers to sophisticated nation-state actors.
You'll report directly to our SVP of Engineering and help define infrastructure security. Over time, you'll grow the team, set the standards, and increasingly shape how we secure the systems at the heart of modern AI: training clusters, GPU fleets, model artifacts, and inference.
Responsibilities
- Own infrastructure security for Together AI's globally distributed systems — hands-on, as the technical leader of the function.
- Build and lead the infrastructure security team, defining what great looks like and attracting engineers who want to build with you.
- Partner with engineering and infrastructure teams to harden global systems — shipping security as something that speeds engineering up, not slows it down.
- Develop and implement internal security tooling that addresses security challenges at scale.
- Deepen our security telemetry and detection — gathering system telemetry and improving detection of and response to potential security events.
- Identify and remediate vulnerabilities across our engineering systems, including authenticated vulnerability scanning of distributed systems.
- Grow into securing the AI-specific surface — training clusters, GPU fleets, model artifacts, and inference endpoints — as the threat landscape evolves.
Requirements
- Hands-on security leadership — you can lead a team and stay deep in the technical work. You lead by building, not just by delegating.
- Strong systems and cloud-native software engineering experience, with deep proficiency in Linux configuration, security, and administration.
- Fluency with automation and infrastructure-as-code (Terraform, Ansible, and/or Salt) to solve security problems at scale.
- A pragmatic security instinct — you treat security as an enabler, make sound risk calls, and help the team ship safely and fast rather than piling on friction.
- Experience with security telemetry and detection (e.g. OSQuery, Falco, SIEM) and with finding and fixing vulnerabilities in distributed systems.
- Curiosity about how AI changes the security landscape — you don't need to be an AI-security expert today, but you're the kind of engineer who becomes one.
- Bonus: Go or Rust development, cloud-native service experience (AWS, GCP), deep Linux/networking fundamentals, OCP familiarity (OpenBMC, Coreboot, Linuxboot), or a public security-practitioner footprint (talks, OSS, writing).
Compensation
We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $200k - 300k+ equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Please see our privacy policy at https://www.together.ai/privacy
Match this job to your CV
ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.
Check my match →Similar open roles
- Senior or Staff Software Engineer, Inference / Compute Infrastructure EngineeringTogether AI
- Senior Program Manager, Data Center DeliveryTogether AI
- Senior Software Engineer — Infra Agent Systems Remote IndiaTogether AI
- Technical Support Engineer (GPU Cluster), India Together AI · bengaluru
- Technical Support Engineer (Inference) - India WeekendsTogether AI · bengaluru
- Staff Engineer, Distributed Storage and HPC & AI InfrastructureTogether AI
- AI Infrastructure Systems EngineerTogether AI
- AI Infrastructure Systems EngineerTogether AI
Need answers during your interview? Try Live Sarthi.
Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.
- Hidden from supported screen sharingThe overlay stays out of supported Windows screen captures.
- Answers start in about 1.5 secondsResponse time varies with your connection and model.
- From your own CVYour projects and your experience, not a generic script.
- 30 minutes freeThen ₹149 for a 2-day pass with unlimited calls — you pay for the days you are interviewing, not a subscription.
A Windows app, from the same team as ApplySarthi.
Listed on greenhouse · posted 2025-02-11. ApplySarthi collects openings and links to application pages; the role is advertised by Together AI, not by us.