Models to evaluate the credibility of information

Various models exist in the literature on how the evaluate the credibility of information. As you work through these models, you will realise there is a common theme and even overlap. It basically comes down to, Can I trust the information in front of me?

These models can be used separately or in combination with one another. You can even use your own guidelines. But most importantly, it is imperative to use some check measure to ensure the information you retrieve is credible. (And yes, you can also apply this to any Large Language Model).

This post only highlights four popular models.

The CRAAP test

The acronym stands for Currency, Relevance, Authority, Accuracy, Purpose. It can be applied as follows:

Currency:The timeliness of information
    When was the information published/created/posted?
    Has the information been revised or updated?
    Does your topic require current information, or historic information?
    Are the links supplied still active?
Relevance:The importance of the information for your needs
    Does the information relate to your topic or answer your question?
    Who is the intended audience?
    Is the information at an appropriate level? (Scholarly vs popular)
    Have you look at a variety of other sources before determining this is the correct one?
    Would you be comfortable citing the source?
Authority:The source of the information
    Who is the author (person/organisation/institute)/creator/ publisher/sponsor?
    What are their educational background, credentials, expertise, affiliations?
    Is the author qualified to write on this topic?
    Is the contact information of author/publisher/sponsor available?
    Does the site/journal reveal anything about the author?
Accuracy:The reliability, trustfulness and correctness of the content
    Where does the information come from?
    Is the information supported by evidence?
    Has the information been reviewed or refereed?
    Can you verify any of the information in other sources?
    Does the language or tone seem unbiased and free of emotion?
    Are there spelling, grammar or typographic errors?
Purpose:The reason the information exists
    What is the purpose of the information?
    To inform, teach, sell, entertain or persuade?
    Do the authors make their intentions or purpose clear?
    Is the information fact, opinion or propaganda?
    Does the point of view appear objective or impartial?
    Are there political, ideological, cultural, religious, institutional or personal biases?

The ASPECT test

The acronym stands for Authority, Source, Purpose, Evenness, Coverage, Timeliness. It can be applied as follows:

Authority:
    Is there an author’s (person/organisation/institute) name?
    Can you locate the author’s credentials?
    Does the author have expertise in the subject?
    Has the author written similar works?
    Is anyone else recommending this author?
    What are the publisher’s credentials and reputation?
    Does the publisher produce similar works?
Sources:
    Is the information presented as fact? If so:
    Does the author provide documentation/sources? (Bibliography, Footnotes, etc.)
    If sources are included, as they credible sources?
Purpose:
    Is this source written to inform, educate, entertain, or sell?
    Does the source argue a perspective or specific opinion?
    Is the content aimed at a general audience, or is it written for readers with expertise in the subject?
    Is the source too basic, too technical, or too advanced for your needs?
    Is the source just right for your research needs?
Evenness:
    Does the author recognize other points of view?
    Is the information presented objective?
    If the source is biased, does the author acknowledge the bias?
Coverage:
    Is the information up to date?
    Does the source support what you have found in other sources?
    Is the source comprehensive or inclusive enough for your needs?
    Does this source provide information that is relevant to your needs?
Timeliness:
    When was the source published?
    Is the date appropriate for your topic?

The RAVEN test

The acronym stands for Reputation, Ability to observe, Vested interest, Expertise, Neutrality. It can be applied as follows:

Reputation:
    What is the reputation of the author (person/organisation/institute), the sources, and the publication?
    Do past actions or lies indicate the author, sources, or publication may not be reliable?
    Is the author, source, or publication in a position of authority?
Ability to observe:
    Is the author in a position that allows access to reliable evidence?
    If the article is about an event, did the author actually observe the event?
Vested interest:
    Does the author have a personal stake in the topic or event?
    Would the author gain anything by lying?
    Would the author gain anything by telling the truth?
Expertise:
    Does the author have specialized knowledge on the topic or event?
    Does the evidence come from a source that has expertise on the topic or event?
Neutrality:
    Is the author neutral about the issue or is bias evident?
    Is the source of the evidence neutral or biased?

The OPVL test

The acronym stands for Origin, Purpose, Value, Limitations. It can be applied as follows:

Origin:
    Where does the source come from?
    When was the information published, posted or created?
    Who is the author (person/organisation/institute), the source, the publisher or the sponsor?
    Are the author’s credentials or organisation affiliation given?
Purpose:
    What is the purpose of the information?
    What perspective is the author trying to convey?
    Is the purpose clear?
    Is the information: fact, opinion or propaganda?
    Does the point of view appear objective or impartial?
Value:
    How useful is the source?
    How can it be applied to my project?
    Has the information been reviewed or referreed?
    Can you verify the information in other sources?
Limitations:
    How reliable is the source?
    Is it objective or subjective?
    Are there political, institutional, religious, cultural, idealogical, or personal biases?

Should you have any questions relating to these models, please visit Info Central, North Block, GIBS campus or email us on ichelp@gibs.co.za

Leave a Reply