Staff Machine Learning Engineer, AI Serving

ID: 9505

Type: Full-time

Category: Others

Company Name: Reddit

Location: United States

Salary: 355 - 355K yearly

Education Level: Senior (5-10 years)

Visit company vacancy

Job Description

Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 126 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit www.redditinc.com.

Who We Are:
The Machine Learning Platform team at Reddit is a high-impact team that owns the infrastructure that powers recommendations, content discovery, user and content quantification, while directly impacting other teams such as Growth, Ads, Feeds, and Core Machine Learning teams.

What You’ll Do:
As a Staff Machine Learning Engineer, you will lead the development of a large-scale ML Inference Platform at Reddit.

Lead the end-to-end design, implementation, and maintenance of a highly available, low-latency GPU-based model serving system for search, ranking, and LLMs supporting Millions of QPS.
Design and develop ML and Generative AI systems in cloud-based production environments on Kubernetes at scale.
Rapidly develop prototypes and develop a high-performance feature hydration and processing system as a part of the inference stack - including routing, caching, and batching.
Lead a unified GPU model export framework to support converting trained models into optimized GPU inference models.
Strong understanding of real-time ML observability to track feature/model performance.
Experience working with LLM serving online at scale.
Built an E2E inference performance benchmarking framework
Deep Understanding of multi-cluster compute environment and network topology that is specific to ML inference use cases.

Who You Might Be:

7+ years of experience in ML Engineering, AI Platform Engineering, or Cloud AI Deployment roles.
Have experience operating orchestration systems such as Kubernetes at scale
Deep experience with cloud-based technologies for supporting an ML platform, including tools like AWS, Google Cloud Storage, infrastructure-as-code (Terraform), and more
Proficiency with the common programming languages and frameworks of ML, such as Go, Python, etc.
Excellent communication skills with the ability to articulate technical AI concepts to non-technical stakeholders
Strong focus on scalability, reliability, performance, and ease of use. You are an undying advocate for platform users and have a deep intuition for the genAI product development lifecycle.
Strong knowledge of model serving, inference pipelines, monitoring, and observability for AI systems is a plus
Strong proficiency in Python and deep experience with modern AI/ML frameworks (Triton, Dynamo, vLLM, Pytorch)

Benefits:

Comprehensive Healthcare Benefits and Income Replacement Programs
401k with Employer Match
Global Benefit programs that fit your lifestyle, from workspace to professional development to caregiving support
Family Planning Support
Gender-Affirming Care
Mental Health & Coaching Benefits
Flexible Vacation & Paid Volunteer Time Off
Generous Paid Parental Leave

Pay Transparency:

This job posting may span more than one career level.

In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission. Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave. To learn more, please visit https://www.redditinc.com/careers/.

To provide greater transparency to candidates, we share base salary ranges for all US-based job postings regardless of state. We set standard base pay ranges for all roles based on function, level, and country location, benchmarked against similar stage growth companies. Final offer amounts are determined by multiple factors including, skills, depth of work experience and relevant licenses/credentials, and may vary from the amounts listed below.

The base salary range for this position is:

$253,300—$354,600 USD

In select roles and locations, the interviews will be recorded, transcribed and summarized by artificial intelligence (AI). You will have the opportunity to opt out of recording, transcription and summarization prior to any scheduled interviews.

During the interview, we will collect the following categories of personal information: Identifiers, Professional and Employment-Related Information, Sensory Information (audio/video recording), and any other categories of personal information you choose to share with us. We will use this information to evaluate your application for employment or an independent contractor role, as applicable. We will not sell your personal information or disclose it to any third party for their marketing purposes. We will delete any recording of your interview promptly after making a hiring decision. For more information about how we will handle your personal information, including our retention of it, please refer to our Candidate Privacy Policy for Potential Employees and Contractors.

Reddit is proud to be an equal opportunity employer, and is committed to building a workforce representative of the diverse communities we serve. Reddit is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If, due to a disability, you need an accommodation during the interview process, please let your recruiter know.

Company Information

Company Name: Reddit

Company Website: https://www.redditinc.com

Company Address: N/A

Reddit is a U.S.-based internet company that operates Reddit, a large, community-driven social platform where registered users create, curate, discuss and share content organized into topic-specific communities called “subreddits.” Founded in 2005 by Steve Huffman and Alexis Ohanian, Reddit has developed into a multi-faceted platform used for public conversation, news aggregation, niche interest communities, and real-time discussion events. The company describes its mission on official channels as “to bring community and belonging to everyone,” and it positions the Reddit platform as a place where communities self-organize around shared interests, information, humor, and civic participation. Company overview: Reddit provides an online service that enables registered and anonymous users to submit links, text posts, images, videos, and other media. Content is organized into subreddits, each of which is dedicated to a particular subject, interest, hobby, location, or topic. Community moderation—carried out by volunteer moderators for each subreddit—works alongside company policies and site-wide moderators to enforce rules and manage content. The platform’s core interaction model centers on voting (upvotes and downvotes) and threaded comments, which together determine the visibility and ranking of posts and discussions. Core business activities: Reddit’s principal business activity is operating and improving its social platform and related services. This includes developing and maintaining the Reddit website and official mobile applications for iOS and Android, providing developer-facing APIs, and investing in product features that support community interaction (for example, chat, live events, voice features, and video). Reddit also focuses on content moderation infrastructure, trust-and-safety programs, and policy development to address issues such as harassment, misinformation, intellectual property, and other content-related risks. Main products and services: The primary consumer product is the Reddit website (reddit.com) and its mobile applications, which provide the user experience for discovering and participating in subreddit communities. Key platform features include subreddit creation and moderation tools, voting and commenting systems, direct messaging, content discovery tools (such as algorithms and curated feeds), and community moderation dashboards. For monetization and business customers, Reddit offers an advertising platform that supports promoted posts, display and video ads, and enterprise advertising solutions designed to reach community audiences across topical communities. Reddit also sells a consumer subscription product—Reddit Premium—which provides an ad-free experience along with monthly credits (formerly known as Reddit Gold and related awards). Additionally, Reddit operates a system of virtual goods (Reddit Coins) that users can purchase to give awards to posts and comments as a form of appreciation and monetization for content creators. Developer and data services: Reddit provides a public API that allows third-party developers, researchers, and partners to build applications, moderation tools, analytics, and integrations. The company maintains documentation and developer support channels and offers programs and partnerships to enable media companies, brands, and research teams to better understand and engage with Reddit communities. Reddit also works with partners on content licensing, media partnerships, and data access agreements consistent with its terms of service and privacy policies. Community and content initiatives: Reddit hosts recurring formats and community-driven events, including Ask Me Anything (AMA) sessions, community-led fundraisers, and themed discussion weeks. The company provides resources for community moderators, such as moderator tools, best-practice guides, and support channels, recognizing moderators’ central role in shaping community norms and enforcing subreddit-specific rules. Reddit’s Trust & Safety and policy teams publish site-wide content policy and transparency reports that describe moderation approaches, enforcement actions, and policy updates. Business model and revenue streams: Reddit generates revenue primarily through advertising: brands and marketers sponsor content, purchase promoted posts, and run targeted display and video campaigns tailored to subreddit audiences. The company also derives revenue from consumer subscriptions (Reddit Premium), transactions for virtual goods (Coins and awards), and commercial partnerships that include branded content and programmatic advertising. Reddit continues to iterate on advertiser-facing tools—such as audience targeting by interest and community—to improve campaign measurement and ROI for marketers. Leadership and corporate structure: Reddit is led by a senior executive team responsible for product, engineering, marketing, community, and policy. Steve Huffman has been a central leadership figure as CEO. The company maintains corporate and investor-facing information on its official corporate site and in public communications. Policy, safety and legal compliance: Reddit publishes and updates site-wide policies, community guidelines, and transparency materials that address prohibited content, harassment, hate speech, illegal activity, and other forms of misuse. The company invests in moderation technology, human review teams, and partnerships with external researchers and civil-society organizations to address content risks and legal compliance requirements in jurisdictions where it operates. Global presence and access: While headquartered in the United States, Reddit supports globally accessible communities and provides localized experiences through community moderation and platform features. The platform is available via web and mobile applications and engages users, advertisers, and partners worldwide. Official channels: Reddit publishes corporate information, job postings, investor and press materials, and product announcements on its official corporate site and on Reddit itself. For consumers, reddit.com is the principal destination for accessing the platform; for corporate and press information, redditinc.com provides company-level resources and statements.

Visit company vacancy