BioBasicsBench: 100-task benchmark for AI wet-lab skills
In brief
OpenAI released BioBasicsBench, a 100-task benchmark to evaluate how well AI agents interpret raw experimental data and perform everyday wet-lab science tasks.
How it works
The benchmark consists of 100 tasks that test an AI agent's ability to understand raw experimental data and execute common wet-lab procedures. Agents are evaluated on their accuracy in interpreting results and handling practical lab scenarios.
Researchers and developers building AI agents for biological laboratory work.
Availability
Sources
1 merged into this cardMore from OpenAI
OpenAI GPT-Live-1.1 voice model
OpenAI released GPT-Live-1.1 on its API, updating its live voice model with better pronunciation, accent consistency, and transcription across multilingual conversations.
OpenAI adds standby mode for GPT-Live WebRTC sessions
OpenAI now supports standby configuration for GPT-Live WebRTC sessions, pausing model inference during inactivity and resuming when someone speaks.
OpenAI Codex Security Plugin Demo
OpenAI released a video demonstration covering the setup, workflow, and result review process for the Codex Security Plugin.