OpenAI has released a new benchmark for testing AI systems in healthcare. Called HealthBench, it's designed to evaluate how well language models handle realistic medical conversations. According to OpenAI, its latest models outperform doctors on the test.

OpenAI has released a new benchmark for testing AI systems in healthcare. Called HealthBench, it’s designed to evaluate how well language models handle realistic medical conversations. According to OpenAI, its latest models outperform doctors on the test.

  • Bezier@suppo.fiEnglish
    0·
    3 months ago

    Tl;dr: OpenAI says OpenAI product performs well in a benchmark created by OpenAI.

    • Opinionhaver@feddit.ukEnglish
      0·
      3 months ago

      The bar exam isn’t created by OpenAI, yet the outdated GPT-4 model still ranked in the 90th percentile on it.