Architecture & Performance Modeling Engineer, AI Inference Silicon (Senior / Principal)
Jobgether
Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.
Got this interview? Our apps help you get the job.
Skills named in this job
Read from the description itself, not inferred.
This role on the market
510 open architecture roles across 125 companies are on ApplySarthi right now, most of them in Bengaluru (22), Hyderabad (16), Pune (8).
- Delivery Consultant - Cloud Application Architecture, AWS Professional Services, WWPS US Education and State & Local GovernmentAmazon Web Services
- Lead Data Engineer - Data Engineering, Databricks, Model Serving, ML Ops, Data Architecture and modelingJPMorgan · mumbai
- Architecture & System Requirements EngineerCarrier
- Assistant Design Manager / Project Manager - WSP ArchitectureWSP
- Intern, System ArchitecturePsiquantum
What architecture roles keep asking for: AWS (29%), Python (22%), Azure (16%), Stakeholder management (13%), LLMs (13%), GCP (12%) — counted across their open postings here.
C++ jobs · LLMs jobs · Python jobs · Rust jobs
Jobgether has 4,317 open roles listed here.
- Actimize Developer
- Adjunct Lecturer, Raising Capital
- Advogado Júnior - Recuperação Judicial Pró banco/Credores
- AI /ML Developer | SR
- AI Voice Evaluation Specialist
Counted across 14 company job boards, updated as roles open and close.
Preparing for this interview
Interviews for architecture roles keep coming back to AWS, Python, Azure, Stakeholder management. Practise those questions before you sit with Jobgether.
Questions you are likely to be asked
- Why do you want to join Jobgether?
- What is your experience with Rust? Tell me one thing you learned the hard way.
- Tell me about a time the data was messy or wrong. What did you do?
- How would you explain your model's result to someone who is not technical?
- What would you check first if a model's accuracy dropped after going live?
Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.
Practise the Architecture & Performance Modeling Engineer, AI Inference Silicon (Senior / Principal) at Jobgether interview free →Accountabilities:: Collaborate with chip architects to translate architectural questions into structured modeling studies, defining assumptions, alternatives, performance metrics, and recommendations. Conduct architectural trade-off analyses across compute engines, memory capacity and bandwidth, dataflow, DMA, command processing, on-chip interconnects, and chip-to-chip communication. Evaluate different hardware configurations and identify opportunities to improve performance while respecting power, area, system, and implementation constraints. Analyze representative AI inference workloads across prefill and decode phases, different batch sizes and context lengths, and dense and mixture-of-experts (MoE) models. Identify performance bottlenecks affecting latency, throughput, and hardware utilization, translating findings into practical architectural improvements. Develop and enhance analytical, transaction-level, and cycle-level performance models, selecting the appropriate level of detail to balance accuracy and development speed. Build, maintain, and extend reusable models within a native Rust simulation framework. Validate and correlate model predictions against RTL simulations, emulation results, and silicon measurements as they become available. Maintain regression coverage and clear documentation of modeling assumptions, limitations, discrepancies, and results. Communicate findings effectively to architecture and engineering teams, providing ongoing recommendations as workloads, specifications, and design decisions evolve. Take primary responsibility for modeling a next-generation chip while contributing to the continuous improvement of the team's modeling infrastructure. Requirements: At least 5 years of professional experience in computer architecture, microarchitecture, or performance modeling for accelerators, CPUs, GPUs, or similar hardware platforms. Proven experience using performance models to influence architectural decisions, identify bottlenecks, evaluate design alternatives, and support recommendations with quantitative analysis. Strong understanding of computer architecture fundamentals, including pipelines, queues, parallel execution, memory hierarchies, data movement, and interconnect architectures. Hands-on experience developing analytical, transaction-level, or cycle-level performance models, including first-order estimates to validate and interpret simulation results. Ability to work effectively with incomplete specifications, document assumptions, and balance modeling accuracy with rapid iteration. Strong programming skills in Rust, or expert-level C/C++ proficiency combined with a willingness to work extensively in Rust. Proficiency in Python for workload analysis, experimentation, data processing, and performance visualization. Ability to read and interpret SystemVerilog RTL and verification results, reconcile implementation details with architectural specifications, and calibrate models as hardware designs mature. Excellent analytical, problem-solving, and communication skills, with the ability to explain performance results, assess confidence levels, and recommend clear next steps. Ability to collaborate closely with multidisciplinary engineering teams and take ownership of complex technical projects. Experience with LLM inference is highly desirable, including attention mechanisms, KV caches, quantization, mixture-of-experts workloads, and multi-chip parallelism. Familiarity with the relationship between workload behavior, software execution strategies, and hardware performance is a strong advantage. Candidates with experience exceeding the stated requirements may be considered for Principal-level responsibilities, with scope and expectations adjusted according to seniority and expertise. Applicants must currently be authorized to work in the United States. New visa sponsorship is not available; however, H-1B transfers may be facilitated for eligible candidates. Benefits: Competitive base salary: Senior: $220,000–$270,000 per year. Principal: $270,000–$350,000 per year. Competitive equity opportunities as part of the overall compensation package. Flexibility to consider compensation above the stated ranges for candidates with exceptional expertise, experience, or specialized qualifications. Fully company-paid medical, dental, and vision insurance for employees and their dependents. Company-paid life and disability insurance, with additional voluntary coverage options. Access to supplemental hospital, critical illness, and accident insurance. Unlimited paid time off, with an emphasis on maintaining a healthy work-life balance and taking time to recharge. 13 paid company holidays annually. Remote-first working environment, offering flexibility to work from anywhere in the United States. Company-provided computer and home office setup. 401(k) retirement plan with company matching, available from the first day of employment. Opportunity to work on next-generation AI inference silicon and directly influence major architectural decisions before RTL implementation. Close collaboration with experienced engineers and architects working on advanced AI hardware systems. Opportunity to contribute to the development of hardware infrastructure designed to serve increasingly large and sophisticated AI models.
Match this job to your CV
ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.
Check my match →Similar open roles
- AI Trainers Network - MalteseJobgether
- AI Video EditorJobgether
- AI Trainers Network - GreekJobgether
- AI Architect / AI engineering leadJobgether
- AI Trainers Network - EnglishJobgether
- Artificial Intelligence (AI) TechnicianJobgether
- Analytical Chemistry Specialist - Freelance AI Trainer ProjectJobgether
- AI Trainers Network - ArabicJobgether
Need answers during your interview? Try Live Sarthi.
Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.
- Hidden from supported screen sharingThe overlay stays out of supported Windows screen captures.
- Answers start in about 1.5 secondsResponse time varies with your connection and model.
- From your own CVYour projects and your experience, not a generic script.
- 30 minutes freeThen ₹149 for a 2-day pass with unlimited calls — you pay for the days you are interviewing, not a subscription.
A Windows app, from the same team as ApplySarthi.
Listed on lever · posted 2026-11-16. ApplySarthi collects openings and links to application pages; the role is advertised by Jobgether, not by us.