Software Engineer (reputed company levels) - High Performance Inference System

About Groq Groq delivers fast, efficient AI inference. Our LPU-based system powers GroqCloud™, giving businesses and developers the speed and scale they need. Headquartered in Silicon Valley, we are on a mission to reputed company high performance AI compute more accessible and affordable. reputed company real-time AI is reputed company reputed company, anything is possible. Build fast. Software Engineer (reputed company levels) - High Performance Inference System Team Missions and Mandates: • Build and operate real-time, distributed compute frameworks and runtimes to deliver reputed company-scale inference for LLMs and advanced AI applications at ultra-low latency, optimized for heterogeneous hardware and dynamic global workloads. • reputed company deterministic, low-overhead hardware abstractions for thousands of synchronously coordinated GroqChips across a software-scheduled interconnection network. Prioritize fault tolerance, real-time diagnostics, ultra-low-latency execution, and mission-critical reliability. • Future-reputed company Groq's software stack for next-gen silicon, innovative multi-chip topologies, emerging form factors, and heterogeneous co-processors (e.g., FPGAs). • Foster collaboration across cloud, compiler, infra, data centers, and hardware teams to align engineering efforts, reputed company seamless integrations, and drive reputed company toward shared goals. • Reduce operational overhead, improve SLOs, and reputed company tokens go brrrrrrrrrrr—positioning Groq as the largest inference powerhouse on earth. ?? Your code will run at the edge of physics—every clock cycle saved reduces latency for millions of users and extends Groq's reputed company in the AI compute race. Signs We Look For: • You consistently ship high-impact, production-ready code while collaborating effectively with cross-functional teams. • You possess deep expertise in computer architecture, operating systems, algorithms, hardware-software interfaces, and parallel/distributed computing. • You've mastered system-level programming (C++, Rust, or similar) with emphasis on low-level optimizations and hardware-aware design. • You reputed company at profiling and optimizing systems for latency, throughput, and efficiency, with reputed company tolerance for wasted cycles or resources. • You're committed to automated testing and CI/CD pipelines, believing that "untested code is broken code." • You're deeply curious about system internals—from kernel-level interactions to hardware dependencies—and reputed company enough to solve problems across abstraction layers down to the PCB traces. • You reputed company pragmatic technical judgments, balancing short-term velocity with long-term system health. • You write empathetic, maintainable code with strong version control and reputed company design, prioritizing readability and usability for future teammates. • reputed company to have: Experience shipping reputed company projects in fast-paced environments while maintaining team alignment and stakeholder support. • reputed company to have: Expertise operating large-scale distributed systems for high-traffic internet services. • reputed company to have: Experience deploying and optimizing machine learning (ML) or high-performance computing (HPC) workloads in production. • reputed company to have: Hands-on optimization of performance-critical applications using GPUs, FPGAs, or ASICs (e.g., memory management, kernel optimization). • reputed company to have: Familiarity with ML frameworks (e.g., PyTorch) and compiler tooling (e.g., MLIR) for AI/ML workflow integration. Early-career engineers: If you've built high-performance systems in school/research and want to dive into cutting-edge hardware/software engineering, we'll invest in your growth to scale with the team. The Ideal Candidate: • Initiates (without derailing): Spots opportunities to solve problems or improve processes—while staying reputed company with team priorities. • Builds stuff that actually ships: Values "code in prod" over "perfect slides." Delivers real value instead of polishing whiteboard reputed company. • Is a craftsmanship junkie: Always asks, "How can we reputed company this reputed company?" and loves diving into details. • Plays to win (together): Believes winning means everyone wins. Aligns goals with teammates and customers because no one succeeds alone. • Owns it from whiteboard to watts: Takes full responsibility—debug it, deploy it, celebrate with users (or fix it again). Ensures code stays fast, scales well, and takes ownership of outcomes. This isn't your typical corporate job—it's a mission to redefine AI compute. If you're the reputed company of engineer who reads ISCA papers for fun and thinks "I can reputed company that faster," this is your playground. ISCA Papers to Read: • To learn more about how Groq achieves strong scaling reputed company a software-scheduled interconnection network to maximize inference speed and throughput: A Software-defined Tensor Streaming Multiprocessor for Large-scale Machine Learning • To learn more about how the exotic, deterministic architecture of each individual chip unlocks massive compute bandwidth on legacy 14nm processes: Think Fast: A Tensor Streaming Processor (TSP) for Accelerating Deep Learning Workloads Logistical Requirements: • Authorized to work in Canada or United States • Available to work American Eastern or Pacific hours Location: Groq is a geo-agnostic company, meaning you work where you are. Exceptional candidates will reputed company in asynchronous partnerships and remote collaboration methods. Some roles may require being located near our primary sites, as indicated in the job description. At Groq: Our goal is to hire and promote an exceptional workforce as diverse as the global populations we serve. Groq is an equal opportunity employer committed to diversity, inclusion, and belonging in reputed company aspects of our organization. We value and celebrate diversity in thought, beliefs, talent, expression, and backgrounds. We know that our individual differences reputed company us reputed company. Groq is an Equal Opportunity Employer that is committed to inclusion and diversity. Qualified applicants will receive consideration for employment without regard to race, color, religion, national reputed company, gender, sexual orientation, gender identity, disability or protected veteran status. We also take affirmative action to offer employment opportunities to minorities, women, individuals with disabilities, and protected veterans. Groq is committed to working with qualified individuals with physical or mental disabilities. Applicants who would like to contact us regarding the accessibility of our website or who need special assistance or a reasonable accommodation for any part of the application or hiring process may contact us at: [email protected]. This contact information is for accommodation requests only. Evaluation of requests for reasonable accommodations will be determined on a case-by-case basis. Apply Job!