Only AI Jobs


AI Engineer, Evaluation - 11319

ID: 9323

Type: Full-time

Category: Others

Company Name: Coupa

Location: India

Education Level: Mid-level (2-5 years)

Visit company vacancy
Job Description
Coupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data across a global network of 10M+ buyers and suppliers. We empower you with the ability to predict, prescribe, and automate smarter, more profitable business decisions to improve operating margins.

Why join Coupa?

🔹 Pioneering Technology: At Coupa, we're at the forefront of innovation, leveraging the latest technology to empower our customers with greater efficiency and visibility in their spend.
🔹 Collaborative Culture: We value collaboration and teamwork, and our culture is driven by transparency, openness, and a shared commitment to excellence.
🔹 Global Impact: Join a company where your work has a global, measurable impact on our clients, the business, and each other. 

Learn more on Life at Coupa blog and hear from our employees about their experiences working at Coupa. 

The Impact of a AI Engineer, Evaluation & Quality at Coupa: 
 
Coupa's AI platform serves thousands of enterprise customers, and model quality directly impacts business outcomes. The AI Engineer, Evaluation & Quality will build the evaluation infrastructure that ensures our AI models meet rigorous accuracy standards. You will design benchmarks, implement automated evaluation pipelines, and build dashboards that track model performance across iterations.

What You’ll Do
  • Build and maintain automated evaluation pipelines for AI model quality.
  • Implement task-specific benchmarks and test suites.
  • Design quality dashboards tracking accuracy, regression, and safety metrics.
  • Implement automated regression testing for every model iteration.
  • Build comparison frameworks for side-by-side evaluation of model variants.
  • Analyze evaluation results to identify failure modes and report to the ML team.
  • Maintain evaluation datasets: versioning, quality validation, coverage analysis.
  • Support A/B testing infrastructure for production model validation.

  • What You Will Bring to Coupa
  • 3+ years of software engineering 
  • Proficiency in Python .
  • Experience with statistical analysis and data visualization.
  • Understanding of ML model evaluation concepts (precision, recall, F1, human eval).
  • Experience building automated test frameworks and CI/CD pipelines.
  • Familiarity with dashboarding tools.
  • Strong analytical and problem-solving skills.
  • BS in Computer Science, Statistics, or equivalent experience.
  • Coupa complies with relevant laws and regulations regarding equal opportunity and offers a welcoming and inclusive work environment. Decisions related to hiring, compensation, training, or evaluating performance are made fairly, and we provide equal employment opportunities to all qualified candidates and employees. 

    Please be advised that inquiries or resumes from recruiters will not be accepted.

    By submitting your application, you acknowledge that you have read Coupa’s Privacy Policy and understand that Coupa receives/collects your application, including your personal data, for the purposes of managing Coupa's ongoing recruitment and placement activities, including for employment purposes in the event of a successful application and for notification of future job opportunities if you did not succeed the first time. You will find more details about how your application is processed, the purposes of processing, and how long we retain your application in our Privacy Policy.
    Company Information

    Company Name: Coupa

    Company Website: https://www.coupa.com

    Company Address: Mexico

    Coupa (Coupa Software Inc.) is a publicly traded, enterprise technology company that develops and operates a cloud-based Business Spend Management (BSM) platform designed to help organizations gain visibility into, control over, and optimization of how they spend money. Coupa’s platform consolidates procurement, invoicing, expenses, sourcing, supplier management, contract lifecycle management, and related analytics into a single, cloud-native suite. The company positions itself as a provider of enterprise software that enables finance, procurement, and supply chain teams to manage direct and indirect spend more efficiently and to realize measurable cost savings, compliance improvements, and operational efficiency. Coupa serves a broad set of industries and customers ranging from mid-market firms to large global enterprises. Core business activities Coupa’s core business activity is developing, delivering, and supporting subscription-based software-as-a-service (SaaS) solutions for business spend management. The company operates a multi-tenant cloud platform and sells seat- and subscription-based licenses, often combined with professional services, implementation support, and ongoing customer success services. Coupa maintains and extends the platform by building new product capabilities, integrating with enterprise resource planning (ERP) systems and other third-party enterprise software, expanding its partner ecosystem, and making targeted acquisitions to broaden functionality (for example, extending into supply chain design and analytics). As a publicly traded company, Coupa also provides investor relations materials and regulatory disclosures to shareholders and the public. Primary products and services Coupa’s product portfolio centers on the Coupa Business Spend Management Platform and a set of modular applications and capabilities that include: procurement (e-procurement catalogs, purchase requisitions and purchase orders), supplier management (supplier onboarding, qualification and risk monitoring), sourcing (strategic sourcing and competitive bidding), contract lifecycle management (CLM), invoicing and accounts payable automation (AP automation, electronic invoicing), expense management (employee expense reporting and card integrations), and inventory and order management where applicable. The platform includes analytics and reporting, driven by Coupa’s Community Intelligence and benchmarking features, which aggregate anonymized spend and pricing data across customers to provide market insights and identify saving opportunities. Coupa also provides modules and capabilities for supply chain design and planning—expanded through acquisitions—and supplier collaboration via the Coupa Open Business Network, which connects buyers and suppliers to exchange orders, invoices, and transaction data. Technology and approach Coupa’s technology is cloud-native and API-driven, focusing on integration with enterprise systems such as major ERPs and financial systems to ensure data flows and reconciliation. The company emphasizes user experience and consumer-grade usability for business users, workflow-driven approvals to enforce policy and compliance, real-time analytics and alerts for spend governance, and automation to reduce manual effort in procurement and invoicing cycles. Coupa leverages aggregated, anonymized customer data to provide benchmarking and intelligence (often called Community Intelligence) that helps customers identify cost saving opportunities and negotiate better supplier terms. In recent years, the platform has incorporated machine learning and analytics to improve supplier risk detection, invoice matching, and spend categorization. Business model and customers Coupa primarily sells subscription-based software licenses and cloud services, combined with implementation and professional services. Its customers include organizations across industries such as technology, manufacturing, retail, financial services, healthcare, and the public sector. The platform is used by procurement, finance, and supply chain teams to centralize purchasing, control off-contract spending, automate invoice processing, manage supplier relationships, and enforce contract terms. The company emphasizes measurable return on investment (ROI) for customers through reduced maverick spend, lower procurement and AP costs, faster cycle times, and greater compliance. Ecosystem, partnerships, and go-to-market Coupa maintains a partner ecosystem composed of systems integrators, consulting firms, implementation partners, and technology partners that support integration, deployment, and customization of the BSM platform. The Coupa Open Business Network enables electronic collaboration between buyers and suppliers at scale. Coupa’s go-to-market approach includes direct enterprise sales, channel partnerships, and a focus on customer success to drive adoption and expansion within existing accounts. Corporate and public-market presence Coupa is a publicly traded company listed on the NASDAQ stock exchange under the ticker symbol COUP. The company routinely publishes product updates, customer case studies, financial results, and regulatory filings. Coupa’s public materials and disclosures describe the company’s mission around transforming how organizations manage and optimize spend, emphasizing transparency, control, and community-driven intelligence. Leadership and operational information, including executive biographies and investor relations resources, are published on the company’s official website and regulatory filings. Strategic direction and value proposition Coupa’s stated strategic focus is to expand the scope of business spend management across procurement, finance, and supply chain functions, drive deeper automation and intelligence across spend processes, and grow the Coupa customer community to increase the value of its benchmarking and analytics. The company’s principal value proposition is unified visibility across spend, supplier connectivity through its business network, actionable benchmarking and analytics, and cloud-delivered automation that yields measurable cost savings and efficiency gains for enterprise customers.
    Visit company vacancy