Library Guide Assessment Standards for Quality-Checked Review

Zoom Session Script

Introduction:

Hello, my name is [your name] and I'll be walking you through this user/learning experience test today. Before we begin, I want to thank you for taking the time to provide your feedback and ask you for permission to record this session.

Upon Permission: The goal of this session is to test the usability and design of a research guide, also known as a LibGuide, about identifying fake news. I will ask you to complete a few tasks and then get your overall impressions of the page. There are no right or wrong answers, we just want your honest reactions and suggestions. Please think aloud as you go through the tasks. As discussed, this session will be recorded; however, only members of the research team will view the recording.  Your responses will be anonymous when reported and no personal identifying information will be shared with outside entities.  Would you like to continue? Do you have any questions before we start?

First, I’m going to ask you some questions about yourself. 

DEMOGRAPHICS

What is your major? (If none, write undeclared)

What is your academic status? (Freshmen, Sophomore, Junior, Senior, Graduate, Doctoral)

Indicate your experience with UNF LibGuides using the following options:

• I don’t know.
• Never used.
• Rarely used (less than once a month)
• Occasionally used (once a month to once a week)
• Frequently used (multiple times a week)
• Everyday use

Now let’s move onto some of tasks. Please navigate naturally as if having to work through an assignment. You don’t have to worry about the speed. Just how you will naturally use it.

 NAVIGATION

1. Let's start with a simple navigation test. Please find the section that lists the 5 types of fake news. Tell me when you locate it.
2. Please find the section in the guide about how to evaluate information for fake news. Tell me when you locate it.
3. Locate the section that lists UNF books on the topic of fake news. Tell me when you find it.
4. Find where to schedule a research consultation appointment with a librarian.
5. Locate where you can play a Fake News educational game.
6. Point to where you can read articles about fake news.
7. Locate where you can access UNF library databases.
8. On a scale of 1 to 5, with 5 being very effective, how would you rate the overall navigability and findability of information in the guide?

CONTENT

Take 3 minutes to continue looking at the LibGuide. Based solely on what you have seen in this LibGuide, please use a scale of 1 to 5, with 5 indicating high confidence, rate your ability to perform the following tasks. 

1. Define fake news.
2. Identify fake news.
3. Read a book about fake news.
4. Check for your understanding about fake news.
5. Design your own assessment tool to critique information.
6. Use fact checking resources.
7. Explore UNF library resources regarding fake news.
8. Seek librarian support and research consultations.
9. Search an academic database for reliable information.
10. Develop an argument for researching using library databases to combat fake news.
11. Choose quality websites to learn about fake news.
12. Write an essay about fake news.
13. Compare three sources (books, news, articles, websites) and critique them for accuracy.
14. Compare three sources (books, news, articles, websites) and critique them for bias.
15. Rank the three sources based on usefulness for writing an academic college paper on a current event.

On a scale of 1 to 10, how likely are you to recommend this guide to someone who wants to learn about Fake News?

This the last portion of our session. Please tell us:

1. What is your favorite element of the guide?  Why?
2. What is your least favorite element of the guide? Why?
3. What would you add to the guide?
4. What would you take away from the guide?
5. Which guide do you prefer for a course reading assignment or classroom activity?
6. Which guide will your professor most likely choose to teach a course about fake news. Why?
7. Which guide would be most effective to embed in your Canvas online course about fake news? Why?

Reference

Moukhliss, S. & Trina, M. (2024). Using a proposed library guide assessment standards rubric and a peer review process to pedagogically improve library guides: A case study. [Manuscript in preparation].