Applied Scientist, Artificial General Intelligence

ID: 8655

Type: Full-time

Category: Others

Company Name: Amazon.com Services LLC

Location: USA, WA, BELLEVUE; USA, MA, Boston - Boston - United States

Salary: 136,000.00 - 184,000.00 USD annually

Job Description

The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems.

Key job responsibilities
As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services.

A day in the life
An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.

Basic Qualifications

- Master's degree in computer science, mathematics, statistics, machine learning or equivalent quantitative field
- Experience programming in Java, C++, Python or related language
- Experience with SQL and an RDBMS (e.g., Oracle) or Data Warehouse

Preferred Qualifications

- Experience implementing algorithms using both toolkits and self-developed code
- Have publications at top-tier peer-reviewed conferences or journals

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, MA, Boston - 136,000.00 - 184,000.00 USD annually
USA, WA, BELLEVUE - 136,000.00 - 184,000.00 USD annually

Company Information

Company Name: Amazon.com Services LLC

Company Website: https://www.amazon.com

Company Address: 410 Terry Ave N, Seattle, WA 98109, United States

Amazon.com Services LLC is an operating company in the Amazon corporate family that supports and delivers a broad set of technology-enabled retail and marketplace services. As part of the larger Amazon organization, it participates in the operation and management of Amazon’s online retail marketplace, third‑party seller programs, fulfillment and logistics solutions, and related customer-facing services. The company’s activities are oriented around applying software, systems engineering and logistical infrastructure to enable large-scale e-commerce, digital distribution and platform services for consumers and businesses. Overview and scope Amazon.com Services LLC functions as one of the entities through which Amazon delivers commerce and seller-related services. In practice, that includes enabling Amazon’s marketplace for third‑party sellers, operating fulfillment programs (including Fulfillment by Amazon—FBA), and supporting the web and mobile retail experiences that customers use to discover, buy and receive products. The company leverages Amazon’s broader investments in distributed computing, data analytics, inventory systems and automated fulfillment to provide both consumer-facing retail and business-to-business seller services. Core business activities The core activities associated with Amazon.com Services LLC revolve around online retail operations and the technology and logistics that underpin them. Key activities include: operating the Amazon.com consumer marketplace and associated storefronts; managing programs that onboard, list and transact for third‑party sellers; providing fulfillment, warehousing and shipping services for inventory enrolled in Amazon’s logistics networks; powering payments and order processing systems; and supporting customer service operations related to retail transactions. These activities are tightly integrated with Amazon’s global logistics network, delivery services, and software platforms that enable inventory management, pricing, content management and search/recommendation systems. Main products and services While Amazon.com Services LLC is one of several operating companies in the Amazon group, the practical products and services associated with its operations include marketplace hosting for third‑party sellers (seller accounts, tools and dashboards), fulfillment and warehousing services (including FBA), order processing and returns management, customer service support for retail transactions, and technology platforms that expose APIs and seller tools for listing, pricing and inventory control. These services enable merchants to sell through Amazon’s digital storefronts and to use Amazon’s fulfillment infrastructure for storage, packing and shipping. Relationship to broader Amazon offerings The operational scope of Amazon.com Services LLC overlaps and integrates with other Amazon businesses and technology platforms. For example, Amazon Web Services (AWS) provides the cloud infrastructure and many platform services that power Amazon’s retail site and seller services, while Amazon’s consumer-facing subscription services such as Amazon Prime (which bundles fast shipping, streaming and other benefits) influence demand and fulfillment priorities. Additionally, Amazon’s devices (Kindle, Echo/Alexa, Fire TV) and digital content offerings (Prime Video, Amazon Music, Audible) form adjacent product lines that operate within the same corporate ecosystem, increasing cross‑channel customer engagement with the retail marketplace. Technology and innovation focus Amazon.com Services LLC operates in an environment driven by software, systems engineering and logistics innovation. Amazon’s public communications emphasize technology investments in automation, robotics, machine learning, search and recommendation algorithms, and large-scale distributed systems to improve selection, convenience and price. The company’s approach to improving customer experience and seller services is built on continuous iteration in software, data science and operational research, as well as deployment of warehouse automation and transportation optimization technologies. Customers and users End customers are the millions of consumers who shop on Amazon’s retail websites and use related mobile apps. Another primary customer segment is the millions of third‑party sellers and professional merchants who use Amazon’s marketplace and seller services to reach consumers globally. Businesses and developers that integrate with Amazon’s seller APIs, fulfillment services, and advertising platforms also rely on the services and systems that Amazon.com Services LLC helps deliver. Official mission and corporate context Amazon’s public materials state a mission and guiding principle focused on customer centricity—commonly expressed by the company as striving “to be Earth’s most customer‑centric company.” That mission underpins the retail and marketplace operations and is reflected in investments in selection, convenience and low prices. Amazon operates across multiple industries including e-commerce, cloud computing, digital streaming, consumer electronics and logistics; Amazon.com Services LLC is a part of that broader corporate structure and concentrates on the commerce and seller-facing components of the business. Regulatory and corporate form Amazon.com Services LLC is a limited liability company within the Amazon corporate structure; like other operating subsidiaries, it is used to carry out specific aspects of Amazon’s commercial activities. Public filings and corporate disclosures identify multiple Amazon subsidiaries that collectively operate global retail, subscription, cloud and device businesses. Amazon’s public investor relations and corporate governance materials describe Amazon as a technology company with e-commerce and cloud computing core competencies, and Amazon.com Services LLC functions within that legal and operational framework. Summary In summary, Amazon.com Services LLC is a technology-enabled operating company in the Amazon family that provides and supports the marketplace, seller services, fulfillment and related retail operations that allow consumers to buy products and third‑party sellers to reach customers through Amazon’s digital storefronts. Its work is characterized by large-scale software systems, fulfillment and logistics networks, and continual investment in automation and data-driven tools to improve customer and seller experiences. The company’s activities align with Amazon’s stated customer-centric mission and the broader corporate focus on leveraging technology to scale commerce and distribution globally.

Visit company vacancy