VercatusGrade CR-088Entities
Finding contradictory claims about the same entity
A 2024 survey of knowledge conflicts in LLMs reports that when retrieved texts contradict each other, models are sensitive to the order of the evidence, favour evidence that matches their training-time knowledge or is corroborated by more documents, and are susceptible to misinformation; such conflicts can significantly impact the trustworthiness and performance of LLM answers.
Sources
- 1
CGrade C: reputable industry data or observation. A grade describes the provenance of the sources above; it is not a probability that a change will work. The effect basis says how the size of the effect is known: measured by a study, taken from an industry report, only documented without a size, or not quantified.
Put this evidence to work
Related entries
More in Entities, or search the whole base.
All Entities entries