Large Language ModelsArtificial Intelligence Systems Learn How to Run In Geographic Space
The researchers developed a new benchmark to understand spatial relations of multi-mode language models and change spatial configurations under geomet
#Benchmark
19 articles · Posts with this tag
Large Language Models
Large Language ModelsOpenProblemBench is Prepared to Test Scientific Limits of Artificial Intelligence
The new benchmark published in ArXiv measures the ability to make real scientific research of machines by offering 82 undissolved problems of math and
Gaming & EntertainmentGameCommBench Brings a New Standard to Evaluate Game Reviews Created by Artificial Intelligence
The researchers introduced GameCommBench, a combined benchmark platform to measure AI-production comments in various areas from board games to sports
Large Language ModelsJusticeAxis: Establish the Balance of Legal Decisions with Artificial Intelligence
The new research suggests a comparison method for legal decision-making systems that balance between strict rule application and unfounded appreciatio
AI Agents & AutomationNAQD-Env: New Benchmar to Test Selective Decision Making Ability of Language Agents Tags
The researchers developed a synthetic environment called NAQD-Env, assessing which processes in the face of changing conditions of language agents wil
AI Agents & AutomationVAmoS Energy: Testing Voice AI Agents in Real World Conditions
The new benchmark evaluates voice agents in realistic scenarios such as customer immortality, background noise and multiple requests.
AI Agents & AutomationNew Protocol System Development to Scale Scientific Robotic Agents
SciHorizon-eLab offers a compiler that converts protocols into automated tasks to evaluate artificial intelligence agents that automate scientific exp
AI Agents & AutomationCan AI Agents Rebuild Machine Learning Articles? RECLAIM Benchmark Response
the RECLAIM project published in arXiv offers a new benchmarking set that measures artificial intelligence agents to reproduce and produce results in
Large Language ModelsPFArena: New Benchmar Restricting Language Model for Protein Change Tags
The researchers developed PFArena benchmark to compare the effectiveness of artificial intelligence models in protein modification.
Large Language ModelsThe main reason for Corporate GenAI Failure: Measurement Issue
Although Frontier language models produce professional quality output, most corporate GenAI project can not show measurable result; research explains
Gaming & EntertainmentGameASG-Bench: Measuring the Quality of Autonomous Software Production in Game Development
A new benchmark makes it possible to test whether the game codes created by AI meet and meet behavioral requirements.
Large Language ModelsCreate Private Benchmark Data Sets for Language Model with Expert Guide
The researchers provide high quality and scalable LLM benchmark data sets development method by combining the knowledge of field experts with artifici
AI Agents & AutomationImproved Data Extraction Performance in Audio Agents New Benchmark
the benchmark called .-Elicitation offers a 200-task system that accurately tests audio agents to accurately collect critical information such as name
AI Agents & AutomationNew Criteria developed to Measure Burns of Artificial Intelligence Agents in Law
LexAgentHallu is the first hierarchical benchmark designed to detect vehicle calls and handling of large language models working in law.
Large Language ModelsIdentity Loss Problem in Language Model Systems: Control Made Through HybridQA
Your research shows that the object selected in the basic language model applications is a serious problem that the reader cannot reach and this hando
AI Agents & Automationdünya2-Bench: Building of AI Agents in Real World Conditions
A new benchmark tests whether the software agents built with productive language models can perform real tasks from customer service to system managem
Large Language ModelsGPS-Bench: Validate Policy Simulations of Large Language Models
The new benchmark increases the applicability of artificial intelligence in public policy by comparing LLM based policy analysis with real world resul
Large Language ModelsKC-Bench With Artificial Intelligence Models Is Possible to Measure Knowledge Conflicts
The researchers introduced the dynamic benchmarking tool called KC-Bench, who tested how LLM agents stack user instructions, parametric information an
Large Language ModelsDocHop: Tests Complex Document Analysis Ability of Artificial Intelligence Models
A new benchmark measures the ability to make complex logical interests using text and visuals of multi-fashioned language models together