← HomeLarge Language Models

New Method Developed by Increasing The Secret Information of Artificial Intelligence Models

· Source

New Method Developed by Increasing The Secret Information of Artificial Intelligence Models
Photo: Amin Zabardast / Unsplash

How do we measure the main skills of large language models? The researchers have found a new answer to this question and showed that it goes beyond traditional tests to understand what models really know. Even if the models are able to respond wrong to a question, the right answer inside can be “wed”.

The main findings of the study can be summarized as follows:

  • Gizli Information Test (Concealed Information Test) called forensic method is tailored to language models; this test measures whether it shows a strong response by offering the correct detail between fake options
  • Models may deliberately perform low performance in competence assessments or act against internal information
  • By looking at model outputs, it is impossible to distinguish whether a answer is hidden or simply unknown Tags
  • The method aimed to reveal real knowledgeholder during interaction with models Tags

This finding is important for the transparency and reliability of artificial intelligence systems. In particular, in high-risk applications, it can be troubled up to “not say” a model. The new method is trying to close this hidden gap and expands the scope of AI control.