- Full-time
- London, United Kingdom
AI Security Engineer
- Full-time
- Mountain View, United States
Menlo Security develops browser and AI-agent security products that protect organizations from threats across the web, documents, and email. The Data & AI / ML Evaluation Engineer will build and operate the data infrastructure, datasets, and evaluation systems that support the company’s AI security models.
Requirements
- Bring 2–4 years of experience in software engineering, data engineering, or automated QA/evaluation.
- Have strong Python programming skills; C++, SQL, and experience with model training and AI/ML algorithms are advantageous.
- Build and operate automated data collection, web-scraping, ingestion, processing, annotation, and dataset-curation pipelines for threat samples from surrogate traffic and web sources.
- Train and retrain models such as Prompt Injection SLMs, Shadow-AI detection models, Malicious Macro classifiers, and PII detection models.
- Capture false-positive samples from live user/DDR flows and feed them into model retraining and evaluation loops; incorporate live false-positive and false-negative feedback promptly.
- Develop automated, reproducible benchmarks and evaluation harnesses to assess detection quality, runtime performance, and accuracy against baseline models such as Vertex AI.
- Work with research and software engineering teams to turn detection telemetry into actionable model improvements.
- Maintain reliable, high-throughput data pipelines and threat datasets with strong coverage, diversity, and labeling accuracy; track model accuracy against benchmarks and historical versions.
- Be familiar with data structures, storage formats, and database configuration, and take a methodical approach to labeling, validation, bug logging, and metric tracking.
- Preferred: experience with ML evaluation frameworks, dataset curation or annotation tools; text extraction, NLP preprocessing or document parsing; cybersecurity concepts such as Prompt Injection, malicious macros, and DLP/PII; cloud or object storage and Docker; AWS, GCP, Terraform, Kubernetes, or Linux.
Additional information
Menlo describes its culture through proactive leadership, direct communication, shared impact, high standards, and customer focus. Qualified applicants are considered without discrimination on the stated protected grounds. Agencies must follow Menlo’s Ashby ATS process, have an executed services agreement, and be assigned to the requisition by the Talent team; unsolicited submissions do not qualify for a fee. Menlo invites applicants to follow it on LinkedIn.
Job seeker sign in
Please sign in to save this job.
By signing in, you agree to OnlyAIJobs’s Terms & Conditions and Privacy Policy in relation to your privacy information.
Don't have an account?
More jobs within the Development and Security and Safety categories
AI
- Full-time
- Petaling Jaya, Malaysia
- Full-time
- St Leonards, Australia
AI
- Full-time
- Full-time
- Hamburg, Germany
Companies hiring AI talent
From research labs to fast-growing startups, these employers are building with Artificial Intelligence and recruiting on OnlyAIJobs.