2013
18
Dec

Giving Games the Old College Try

Rolling dice

“Life’s a Game” photo by Flickr user Señor Hans (CC BY-NC-ND 2.0)

In Brief: Based on evidence that games might help students get more engaged in my online class, I decided to overcome my skepticism and road-test two information literacy games. First I tried BiblioBouts, which uses the online citation management tool Zotero to integrate gaming into a research paper assignment that is already part of the course syllabus. Students have to set up Zotero accounts and log into the game’s online platform to play and see their scoreboard; the technology requirements were too much for my class and the experiment didn’t feel successful. The following year I tried a comparatively low-tech game that students probably experienced as a regular assignment with a dash of competition thrown in. Whether or not this activity is a real game, I have continued to use it because it encourages students to practice expert researcher skills. After reconsidering my assumptions about games in an environment where serious learning takes place, I still have questions about using them for information literacy instruction.

Giving Games the Old College Try

by

When it comes to educational gaming, I’ve always been skeptical. I’m not opposed to gaming on principle—resistance seems futile in the same way that campaigning against comic books and rock and roll once was. As a non-gamer, the idea of “gamifying” information literacy instruction just sounded like another bandwagon for librarians to jump on. Yet the potential for engaging and even fun instructional activities was too much for me to resist. I decided to give games a try.

With apologies to real game designers, I’ll define games as activities that are designed as games from the beginning (not retrofitted with “gamification” components), are played online, and create interactive user experiences. My reasons for this working definition are entirely selfish: I teach online information literacy courses so I’m always looking for activities that will engage students and meet my learning objectives.

In this article, I look at where games fit into the information literacy instruction literature, discuss my experience trying out two different games in a for-credit online information literacy course, and leave you with the questions I still have now that I’ve reconsidered my assumptions about games in an environment where serious learning takes place. I’m not sure whether I fully met my goals with the games that I tried, but I did shake off some of my skepticism along the way.

Information literacy games

It’s easy to find so-called information literacy games that turn out to be regular old research instruction activities with puns in their titles. As game designer Liz Danforth notes, “…game mechanics are being tacked on to practically everything these days, almost as an afterthought” (2011, p. 84). Margaret Robertson, another game designer, makes the point that adding progress markers like points and badges to an activity does not actually make the activity a game. By contrast, she writes, “Games give their players meaningful choices that meaningfully impact on the world of the game… Games offer fail conditions as well as win conditions… It’s crucial that we stop conflating points and games” (2010). Broussard (2012) provides a thorough overview of online library games that meet at least some of these criteria, along with best practices for their implementation, in her article “Digital games in academic libraries: A review of games and suggested best practices.”

Librarians have embraced game-based learning for some time. For example, in 2008 LOEX-of-the-West was about gaming in library instruction, while in 2010 the Canadian conference Workshop for Instruction in Library Use took “Design, Play, Learn” as its theme. The LOEX-of-the-West conference organizers wrote,

The parallels between good pedagogy and game design were striking and thought provoking. Both seek to engage and challenge players/students in active learning, problem solving, and experimentation using a variety of strategies from narrative learning to multimedia appeals to varying learning styles to rewards both intrinsic and extrinsic. (Finley, MacMillan, & Skarl, 2008)

Others propose even more specific connections between gaming and information literacy. Waelchli (2008) has done indicator-level mapping of the ACRL Information Literacy Competency Standards to fantasy sports, while Gumulak and Webber (2011) mapped game-playing to the SCONUL information literacy standards.

Further, there is good evidence that real learning takes place in video games. One authority, James Paul Gee (2003), describes 36 different learning principles found in good video games (and not necessarily found in school curricula). Along these lines, Nicholas Schiller (2008) provides an analysis of the video game “Portal” that includes takeaways for instruction librarians.

It is possible to find less optimistic opinions on the subject. For example, Kickmeier-Rust et al (2007) point out that games developed by educators are usually lackluster compared to the immersive experiences available commercially. Ian Bogost, a game designer and director of the Graduate Program in Digital Media at Georgia Institute of Technology, concurs: “There just aren’t enough high-quality games that also serve serious purposes effectively. Making games is hard. Making good games is even harder. Making good games that hope to serve some external purpose is even harder” (2011, p. 2). Librarians would be right to wonder whether we can possibly hope to succeed where well-funded corporations often fail.

Postmortem-style articles in the library literature reveal some of the problems librarians have had with games. One of the 2008 LOEX-of-the-West sessions described how outsourcing development to game designers resulted in a game that, from the librarians’ perspective, did not adequately address the learning objectives set out in the ACRL Standards (Hood, 2008). To take another example, a Welcome Week scavenger hunt game at UC Merced flopped when very few students participated (McMunn-Tetangco, 2013). Librarians don’t always like to share our failed experiments, but these case studies can be instructive.

Just because people learn while playing games, does it necessarily follow that we should therefore use games when the main goal is learning? Students are bound to notice when games have learning as a primary outcome, though they play along in order to humor us or get their grade. Librarian and blogger Bohyun Kim writes: “Games are played for fun, and the fun comes from actions not having real-world consequences. For this reason, when a goal other than fun is imposed, the game begins to lose its magical effect on our motivation and productivity” (Kim, 2012, 467-468). This suggests that games may fit best with orientation and outreach activities, where fun can be the primary goal.

Certainly no learner-centered librarian would advocate for dry, boring lessons. Undergraduates, in particular, may need an ice-breaker to help them overcome library anxiety. But real learning takes time and involves difficulty, and I think that we can admit this to students. Student comments after playing BiblioBouts (one of the online research games that I road-tested) reveal that we’re not really fooling them anyway: “BiblioBouts […] is a part of our grade so that’s why I saw it as an assignment. And like the game itself like finding sources, it was – it was helpful definitely but it was another assignment;” and, “You still had to go through and read the article. It still was a step-by-step process and that kind of gets boring like – not boring but it’s still something – like I saw [BiblioBouts] as an assignment, an assignment rather than a game” (Markey, Leeder, & Rieh, 2012, p. 25). Reading the article may not be fun, but it is, ultimately, what you have to do.

Further, librarians already have a problem getting our instructional content taken seriously, and we should be careful that we’re not compounding our image issues through gamification. For example, a student who played BiblioBouts said of the game:

I think it’s good because you’re not realizing at the time that you’re learning about research. Like you might not want to think, “Oh, I want to go learn about library research today.” You’re playing the game and you’re learning about it without doing that. (Markey et al, 2010)

This student seems to say that the purpose of games is to sneak in the part that’s good for you – the chocolate-covered broccoli approach to information literacy instruction.

The sneaky approach doesn’t sit well with my belief that students will benefit from librarians’ sharing the information science behind information literacy skills. One of my research interests is Meyer and Land’s threshold concepts, which encourage instructors to see students as novice practitioners rather than as outsiders to the discipline. From this perspective, librarians might look for activities that open the hood on database searching, or that contrast differing notions of authority in different contexts – that is, activities that will encourage students to view research through a new, librarian-like, lens (Townsend, Brunetti, & Hofer, 2011).

On the other hand, Waelchli and others point out that games don’t always equate with fast and easy solutions. Waelchli writes:

Video games create a unique popular culture experience where players can invest dozens of hours on one game, create characters to identify with, organize skill sets and plot points, collaborate with people around the world, and determine actions based on new and existing information. (2010, p. 381)

Players have the patience to spend this kind of time because they have achieved that enjoyable flow state. Waelchli seems to throw down the gauntlet in challenging librarians to come up with game activities that will make students take our content more seriously, not less. I think that there is enough evidence on the side of gaming that it’s worth investigating whether it is a strategy that can be adapted for real learning beyond the orientation session.

Game #1: BiblioBouts

BiblioBouts is an online game – scoreboard, points, badges, and all – designed to teach research and evaluation skills. It uses the online citation management tool Zotero to integrate gaming into a research paper assignment that is already part of the course syllabus. The BiblioBouts development team worked on the premise that interactive online gaming can help overcome the gaps in undergraduate information literacy skill development. (Leeder, Markey, & Rieh, 2010). With the support of an IMLS grant, the BiblioBouts team worked through several iterations of testing and assessment to develop the game (Markey, Leeder, & St. Jean, 2011). The game is no longer available now that the grant has ended, though the developers hope to find an organization to maintain it in the future (C. Leeder, personal communication, December 13, 2013).

At the time of my BiblioBouts experiment, I co-taught a 2-credit online information literacy elective called Basic Library Skills—LIB199 for short—with my Portland State University Library colleague Kerry Wu, Business and Economics Librarian. When I saw Chris Leeder present on BiblioBouts at the 2010 Library Research Seminar I could immediately see its potential for LIB199. The game seemed as if it might solve some of the problems that we were experiencing in our course: uninspired discussion board postings, little motivation to engage with classmates, and lack of community in the online classroom. We hoped that BiblioBouts would provide opportunities to practice skills learned in the course while shifting some of the interactivity away from the discussion boards.

BiblioBouts was designed for use in disciplinary courses, but we were able to adapt it for our information literacy course. Here is a detailed outline of how we used it in LIB199. Following the links below will also give you an idea of how the game works.

  • One week before the game started, we…
    • introduced the game along with links to BiblioBouts Home and setup instructions (links no longer available),
    • asked students to participate in a group discussion to decide on our research topic,
    • linked out to Georgia State’s Zotero guide and assigned a Zotero practice exercise.
  • The first and second weeks of play, we…
    • provided detailed instructions about how to get started and how we would grade the first two bouts,
    • linked to the BiblioBouts game instructions,
    • embedded the Donor bout demo (no longer available),
    • embedded the Closer bout demo (no longer available),
    • played the Donor and Closer bouts.
  • The third week, we…
    • provided instructions about the third bout and how we would grade it,
    • linked to the game instructions,
    • embedded the Rating & Tagging bout demo (no longer available),
    • played the Rating & Tagging bout.
  • The fourth week, we…
    • provided instructions about the third bout and how we would grade it,
    • linked to the game instructions,
    • embedded the Best Bibliography bout demo (no longer available),
    • played the Best Bibliography bout.

To clarify the scope of our goals, we didn’t think of the game as a teaching tool. In fact, we added instructional content to make sure that we were supporting all of the skills that students would be practicing with BiblioBouts. The new content included information on installing Firefox, a graded assignment on source evaluation, a database search practice worksheet, and a handout on subject databases, all of which we felt were needed in order to prepare students to play the game (and all of which were relevant to the overall goals of the course). Also, we had to make sure that that we covered the relevant concepts in time for them to be put to use in the game.

BiblioBouts in practice

Before we played BiblioBouts, some students showed enthusiasm for the idea of a research game while others went into a technology tailspin over Zotero’s Firefox requirement. The week before we planned to start playing, we set up the game by asking students to make a group decision on a course discussion board about a collective topic to research. This process ran smoothly and we settled on “teen drug use” before the end of the week. Those who suggested other topics (“alternative medicine” was a contender) were willing to go along with the majority decision in order to cooperatively play the game.

We began running into problems when we asked students to follow directions to set up their BiblioBouts and Zotero accounts. Starting the week before the game officially began, and continuing all the way to the end of the game, Kerry and I fielded panicked discussion board posts, emails, phone calls, and visits to the library for tech help. Almost half the class had trouble accepting their invitation to the game because they were logged into more than one email account (the game’s developers write that “Observing some players’ exasperation with the game’s initial registration process was a difficult pill for the R&D team to swallow because students’ interest, goodwill, and patience were sometimes lost before they even started playing the game” [Markey, Leeder, & Rieh, 2012]). Students were very confused by having to sync two different third-party platforms – Zotero and BiblioBouts – on top of using the learning management system to access the course. We often relied on the game developers for help when we couldn’t figure out how to fix problems ourselves.

For example, a student sent us the following email (anonymized, of course):

I got an invitation forwarded to my yahoo address, and I followed it to the bibliobouts page and logged in, but nothing happened.

I already have 2 zotero accounts and 2 bibliobouts accounts (one with yahoo address and one with gmail adress) I’ve tried 10 times to create a third with my school email address, but it won’t let me create one for some reason. Bibliobouts obviously has some bugs that need to be worked out.

Can I do something else for the next 2 bouts?

I can’t get it to work and I don’t have time to keep trying this anymore. Maybe I did it wrong initially, but I can’t get it to work!

I’ll do an MLA bibliography for the next two, but I’m done wrestling with that stupid website! so frustrated!

I’ll put it in what ever format you want with whatever sources you want, but I CAN’T GET BIBLIOBOUTS TO WORK.

please give me an alternative and let me know as soon as possible.

Our reply:

Yes, I agree that there are bugs with the BiblioBouts game and I am REALLY sorry that you are so frustrated. I hear you!

I am trying one more thing. I just sent an invite to your yahoo account. Please take a deep breath :) and accept that invite then register using that same yahoo address to create your account. Let me know what happens, OK?

Good luck,

Amy

The student’s response, which concluded the conversation:

Holy sh*# it worked!

thanks for your help, I guess I’m back on track.

Hopefully there won’t be any other issues.

Because we heard so much about the problems—our discussion board was filled with subject lines saying “help,” “still confused,” and “more trouble”—Kerry and I assumed that BiblioBouts was a complete flop. We were prepared to adjust our grading scheme if needed so that we wouldn’t penalize students for participating in our experiment. But when the time came to assign grades, it turned out that the class did incredibly well at meeting the expectations we had set. Almost everybody got the highest possible grade plus extra credit points for all four “bouts.” This was much better than they did on the individual quizzes and written assignments that we gave during the rest of the quarter. We were puzzled about how to connect the dots between the negative response to the game and the surprisingly good grades.

Did we realize our goals of providing skills practice and building online community? Maybe. I think that students did have a good opportunity to practice—perhaps better than they gave the game credit for. We hoped to address a student engagement problem unique to the online environment, yet the game proved too difficult to administer in an entirely online course. As one student posted on the discussion board, “This is the hardest online assignment, and I have had 10 other online classes.” We did not repeat BiblioBouts and resolved to henceforth and forevermore only use content that can be brought into the learning management system rather than asking students to navigate away to other platforms.

Game #2: Citation Sleuthing

Time passed, Kerry moved on to other projects and no longer co-taught LIB199, and I was ready to try another game in the course. This time I used a book as my starting point: Let the games begin! Engaging students with field-tested interactive information literacy instruction (McDevitt, 2011). I decided to adapt Jenna Kammer’s game called Database Diving (while I was at it, I changed the name as well). It appealed to me because it creates a context for students to practice expert research behavior. Professionals and academics don’t just read an article as a standalone piece—they read it in context and track down sources that catch their interest or relate to their own projects. At the same time, Kammer’s game provides an opportunity to scaffold writing a bibliography, which was part of the final project for my course.

The instructions and rubric for this assignment evolved over the three quarters that I used and refined it. Here is how I presented it the last time it was taught:

Assignment 2: Citation Sleuthing

This assignment has two goals: practice tracking down the sources of information mentioned in articles you read; and practice writing perfect citations in the style of your choice.

1. Read Dan Fisher’s article, Ready for the “Digital Natives”?, and write a perfect citation for it.

2. Track down at least 5 of the sources referenced in the post and write perfect citations for them (I counted 13 potential sources that you could cite for this article).

3. Keep going… If you see a reference list in one of the linked sources, track down and write perfect citations for those sources as well.

 4. Organize your perfect citations in a timeline, oldest to newest (note: usually bibliographies are organized alphabetically by the author’s last name, but for the purposes of this assignment please organize chronologically). In order to get full credit for this assignment, your timeline must include:

  • Citation for Fisher’s article;
  • Citation for at least one book;
  • Citation for at least one scholarly article;
  • Citation for at least one report from a private organization;
  • Citation for at least one website or webpage.

5. The group leader will upload the citation timeline to the specified group dropbox. Make sure that the names of participating group members are at the top of the document.

Note: Perfect citations don’t have any formatting mistakes. We care about punctuation, capitalization, italics, the order of the elements, etc. Visit the citation handout if you need a reminder of the resources available to you. The best you can do on this assignment is 5/10 if your citations are not perfect.

Extra Credit: You can compete for extra credit points for your group by finishing first, having the most correct citations, or finding the oldest citation in the class. On your mark, get set, go!

This activity was designed by Jenna Kammer and originally appeared in Let the games begin!: Engaging students with field-tested interactive information literacy instruction (Neal-Schuman, 2011).

 

Rubric for Assignment 2: Citation Sleuthing

Here is how we will evaluate Assignment 2. Please read the assignment instructions carefully before you begin!

2 pts 1 pt 0 pts
Cite Fisher’s article Perfect citation Has citation but it’s not perfect No citation
Cite at least one book Perfect citation Has citation but it’s not perfect No citation
Cite at least one scholarly article Perfect citation Has citation but it’s not perfect No citation
Cite at least at least one report from a private organization

Perfect citation Has citation but it’s not perfect No citation
Cite at least one website or webpage Perfect citation Has citation but it’s not perfect No citation

Extra Credit:

  • 1 EC point for all members of the group that hands in their assignment first
  • 1 EC point for all members of the group that submits the most correct citations
  • 1 EC point for all members of the group that tracks down the oldest citation

In trying out this new game I applied some of the lessons that I learned from the BiblioBouts experience. It didn’t require registration with a third-party platform and could be done entirely using the same technologies that were used for all assignments (discussion boards, Google docs, email). There was no signup process – students worked in assigned groups that stayed the same for the whole quarter. Compared to BiblioBouts, this game is decidedly low-tech.

In order to prepare students for the assignment, I had to make sure that we covered the following skills before we started: identifying formats, advanced web search, searching databases for articles, searching the catalog for books, finding a known article, and citation. The groups had two weeks to complete the assignment.

Citation Sleuthing in practice

Once again, the first time I tried the game my students did not have a good experience. They spent far longer than I intended on it. I assigned the Newsweek article recommended by Kammer, but its sources were in some cases vanishingly hard to track down, and students expended too much effort chasing after the extra credit points. I had a group get into a serious fight over whether they were allowed to include sources that did not meet the evaluation criteria we had practiced using in the previous assignment.

One student posted to the discussion board:

Is it just my group, or is everyone spending hours upon hours on this?

A classmate replied:

That is such a great question. I feel like I am doing the amount of work equivalent to that of my 4-credit classes.

Trying to calm the waters, I wrote back:

Sounds frustrating! Do you have 5+ citations on your timeline? If so, why don’t you check whether your group is willing to call it a day and hand in the assignment as is. That way you can move on to other things.

Hope this helps,

Amy

With the help of my TAs, Emporia State University MLS students Jaki King and Carolyne Begin, I refined the wording of the assignment over the next two quarters in order to clarify my expectations about the amount of work involved. I also changed the rubric to enable partial credit for incorrect citations. Since the goal is to track down and cite the sources, the points needed to be divided evenly between demonstrating those two skills.

Finding an article to replace the original one was tricky. For the purposes of the assignment, the article cannot already have a bibliography or links to its sources. It should lead out to the types of sources that students need to practice citing, such as journal articles and books. I also wanted it to relate to an information literacy or information technology concept in order to stay within the theme of the course. After trying to use a Harvard Business Review blog post that turned out to only permit limited viewing, I finally hit on the Fisher article referenced above.

Perhaps it’s unfair to compare this experience to the one I had with BiblioBouts, since I gave this game the benefit of repeated attempts and revised it each time I used it. Setting aside the technology problems that I eliminated by playing a game within the course, I was willing to stick with this game because the connection between my objectives and what the students actually practiced was more easily controlled. Given another opportunity to teach a for-credit IL course, I will use this assignment again.

So… Did gaming work for me?

One premise of educational gaming is that it leverages our intrinsic motivation for play. Given this, I was intrigued by the BiblioBouts team’s findings that the real motivator for students to play BiblioBouts is grades. Even cash prizes were not as effective at getting students to play as the promise of a half-point grade increase from the professor (Markey et al, 2009). This finding would appear to answer the question posed by the title of the team’s 2009 article, “Will undergraduate students play games to learn how to conduct library research?”—Yes, if it is required for a grade. This finding offers insight into how to increase game participation, but at the same time it casts doubt on the claim that playing educational games motivates students to learn.

Students took the competitive element of Citation Sleuthing very seriously. Even one extra credit point clearly motivated them to find the most citations, hand their assignment in first, etc. I don’t think that it’s a good idea to equate feeling competitive with feeling playful. Some of my students had an agonizing experience with the game. Yet adding competition to an activity is a fairly simple way to “gamify” it, and it seems to me that it is so hard to use games well that we might be better off sticking with simple ideas.

Setting the motivation issue aside, does educational gaming improve student learning outcomes? The BiblioBouts designers have collected data that provides subjective information about whether students were satisfied with their experience (Markey et al, 2010), which is not quite the same thing (Hofer & Hanson, 2010). One faculty member reported in an interview that he saw improvement in the quality of final papers: “The assignments, the essays came out really much, much, much better than I have ever seen them with this group of students … So the quality of their thinking has gone up, which is why I am very excited about using this game” (Markey, 2012, p. 11).

The game developers’ research suggests, however, that students may not always apply the skills that they practice while playing BiblioBouts when it comes time to write their papers. They game the system by focusing on scholarly sources while playing BiblioBouts, but their assignment bibliographies were not significantly different from those of classmates who did not play or did not complete the game. BiblioBouts is about finding sources, not necessarily understanding them, and so students may not have the reading skills or specialized disciplinary knowledge needed to actually interpret, evaluate, and deploy an academic article in their own work (Markey, Leeder, & Taylor, 2012).

In their publications (one of which I coauthored: Markey, Leeder, & Hofer, 2011), the BiblioBouts developers strike a balance between advocating for the product of their hard work – e.g. “BiblioBouts solves the problem of teaching students information literacy skills, concepts, and tools in a unique way” (Markey et al, 2010) – and calling for sensible pedagogy, such as “These findings demonstrate that information literacy games cannot stand on their own” (Markey et al, 2009). The premise of the game itself is compelling in that it provides a very flexible scaffold for students to practice research-related skills while requiring faculty to consider how to integrate and support the game in the context of the course and assignment.

However, playing the less immersive, more limited game worked better in my course. I was also able to set it up so that I could assess the effectiveness of the game itself, which I was not able to do with BiblioBouts. At the same time, I’m not sure that my students experienced Citation Sleuthing as a game. It was presented as an assignment and generated as much anxiety as an assignment. I ended up feeling that if I engaged students and met my learning objectives, if I encouraged students to see information just a little bit more the way that information professionals do, then it didn’t matter very much whether the activity was or was not a game.

After this much investment, I don’t think that I can qualify as a gaming skeptic anymore. However, I still think that the use of games, or gamification, should be very carefully considered. I’ll leave you with a few questions I’d like to discuss further – please comment!

  • What is the minimum threshold for an activity to be a game? Do we need a better way to differentiate between games, activities, and gamified activities?
  • Do librarians in particular need to think about games? Or should we mind our own business?
  • Have you tried a game that worked? Have you tried a game that didn’t work?
  • Do librarians need a widely usable game that’s developed by professionals?

Thank you to the readers of this article: Chris Leeder, Emily Ford, Kerry Wu, and Korey Brunetti. Special thanks to Lead Pipe editor Erin Dorney for her patience, persistence, and insight. 

References

Bogost, I. (2011). Persuasive Games: Exploitationware. Gamasutra: The art & business of making games. Available from www.gamasutra.com/view/feature/6366/persuasive_games_exploitationware.php?page=1

Broussard, M.J.S. (2012). Digital games in academic libraries: A review of games and suggested best practices. Reference Services Review, 40(1), 75-89. doi:10.1108/00907321211203649

Danforth, L. (2011). Gamification and Libraries. Library Journal, 136(3), 84.

Finley, P., MacMillan, M., & Skarl, S. (2008). LOEX-of-the-West 2008: Hitting the jackpot in Las Vegas. Reference Services Review, 36(4), 343-346. doi:10.1108/00907320810920315

Gee, J.P (2003). What video games have to teach us about learning and literacy. New York: Palgrave Macmillan.

Gumulak, S., & Webber, S. (2011). Playing video games: learning and information literacy. Aslib Proceedings, 63(2/3), 241-255. doi:10.1108/00012531111135682

Hofer, A.R., & Hanson, M. (2010). Upstairs-downstairs: Working with a campus assessment coordinator and other allies for effective information literacy assessment. In 2010 CARL Conference Proceedings. Available from http://carl-acrl.org/Archives/ConferencesArchive/Conference10/2010proceedings/Amy-Hofer.pdf

Hood, D. (2008, June 6). The library arcade. Paper presented at the LOEX-of-the-West conference, Las Vegas, NV. Slides available from http://www.slideshare.net/ebayworld/the-library-arcade 

Kickmeier-Rust, M.D., Peirce, N., Conlan, O., Schwarz, D., Verpoorten, D., & Albert, D. (2007). Immersive digital games: the interfaces for next-generation e-learning? In Proceedings of the 4th international conference on Universal access in human-computer interaction: Applications and services. Available from www.scss.tcd.ie/Owen.Conlan/publications/FUITEL_2007_conlan.pdf

Kim, B. (2012). Harnessing the power of game dynamics: Why, how to, and how not to gamify the library experience. College & Research Libraries News, 73(8), 465-469. Available from http://crln.acrl.org/content/73/8/465

Leeder, C., Markey, K., & Rieh, S.Y. (2010, October 8). College student perceptions of learning academic research skills through an online game. Paper presented at the Library Research Seminar-V, Hyattsville, MD. Available from http://www.lrsv.umd.edu/abstracts/Leeder_et_al.pdf

Markey, K. (2012). Building the games students want to play: BiblioBouts final performance review. Retrieved from University of Michigan website: http://deepblue.lib.umich.edu/bitstream/handle/2027.42/97036/bbFinalPerfReviewToIMLS.pdf?sequence=1

Markey, K., Leeder, C., & Hofer, A.R. (2011). BiblioBouts: What’s in the game? College & Research Libraries News, 72(11), 632-645. Available from http://crln.acrl.org/content/72/11/632.full.pdf+html

Markey, K., Leeder, C., & Rieh, S.Y. (2012). Through a game darkly: Student experiences with the technology of the library research process. Library Hi Tech, 30(1), 12-34. doi:10.1108/07378831211213193

Markey, K., Leeder, C., & St. Jean, B. (2011). Students’ behaviour playing an online information literacy game. Journal of Information Literacy, 5(2), 46-65. Available from https://ojs.lboro.ac.uk/ojs/index.php/JIL/article/view/PRA-V5-I2-2011-3/1819

Markey, K., Leeder, C., & Taylor, C.L. (2012). Playing games to improve the quality of the sources students cite in their papers. Reference & User Services Quarterly, 52(2), 123-135.

Markey, K., Swanson, F., Jenkins, A., Jennings, B., St. Jean, B., Rosenberg, V., Yao, X., & Frost, R. (2009). Will undergraduate students play games to learn how to conduct library research? The Journal of Academic Librarianship, 35(4), 303-313. doi:10.1016/j.acalib.2009.04.001

Markey, K., Swanson, F., Leeder, C., Peters, G.R., Jennings, B.J., St. Jean, B., Rosenberg, V., Rieh, S.Y., Carter, G.V., Packard, A., Frost, R.L., Mbabu, L., & Calvetti, A. (2010). The benefits of integrating an information literacy skills game into academic coursework: A preliminary evaluation. D-Lib Magazine, 16(7/8). Available from http://www.dlib.org/dlib/july10/markey/07markey.html

McDevitt, T.R. (Ed.). (2011). Let the games begin! Engaging students with field-tested interactive information literacy instruction. New York: Neal-Schuman Publishers, Inc.

McMunn-Tetangco, E. (2013). If you build it…? One campus’ firsthand account of gamification in the academic library. College & Research Libraries News, 74(4), 208-210. Available from http://crln.acrl.org/content/74/4/208.full

Robertson, M. (2010, October 6). Can’t play, won’t play [Web log post]. Hide & Seek: Inventing new kinds of play. Available from http://www.hideandseek.net/2010/10/06/cant-play-wont-play

Schiller, N. (2008). A portal to student learning: What instruction librarians can learn from video game design. Reference Services Review, 36(4), 351-365. doi:10.1108/00907320810920315

Townsend, L., Brunetti, K., & Hofer, A. R. (2011). Threshold concepts and information literacy. portal: Libraries And The Academy, 11(3), 853-869. Available from http://archives.pdx.edu/ds/psu/7417

Waelchli, P. (2008). Librarians’ sport of choice: Teaching information literacy through fantasy football. College & Research Libraries News, 69(1), 10-15. Available from http://crln.acrl.org/content/69/1/10.full

Waelchli, P. (2010). Playing with Process: Video Game Choice as a Model of Behavior. Public Services Quarterly, 6(4), 380-388. doi:10.1080/15228959.2010.521091

20 Responses

  1. What kind of field-testing did you do on the games before assigning them to students? Did you give them to other librarians to try out? Cooperative faculty? Student employees?

    I ask because any new assignment I invent ALWAYS runs into field-testing issues. Usually they’re my own fault; imprecision in assignment description is a favorite failing of mine, and sometimes an assignment that sounds great to me is pitched too high for my students. As I read your (excellent; thank you for writing it) article, my strong sense was that the problems you ran into were less with the concept of gaming than with the design/execution of the particular games.

    Since I teach graduate students, this is easier to navigate for me than for most instruction librarians — I’m up-front about experimental assignments, and students are generally willing to cut me slack about them and return me useful feedback. If I were teaching undergrads, though (and I will be again, starting next fall), I’d really want to do a little usability testing on assignments, even if I couldn’t approximate the target population right away.

  2. Thank you for this great discussion on the gamification of information literacy!
    I think that your first question regarding the threshold for games is very important and often overlooked by instructional game designers. I’m a big believer that games should first and foremost be fun to play. The player should be intrinsically motivated based on their enjoyment of gameplay. I’m in agreement with John Ferrara that games should be games first: http://uxmag.com/articles/messification-why-games-should-be-designed-to-be-games-first

    1. Amy Hofer

      Thanks for your comment and for the link to this article! I think that the most important word Ferrara uses is “exploitation.” We definitely don’t want students to feel exploited by our attempts to get them to play.

      I’m glad that you brought up the importance of fun. Do you think there’s hope that information literacy games can be fun, or are we bound for disappointment when students realize that they still have to read the article?

      1. Hi Amy. I see potential for a truly fun information literacy game. Gee points out that gamers are frequently required to read text, sometimes rather lengthy text, as part of gameplay. As long as the text is meaningful and usable in the context of the game (ie. helps the player solve a puzzle), reading this text is not cumbersome but an enjoyable part of gameplay. I think this is part of his “text principle.”
        I think that truly integrating any required reading or searching into gameplay would definitely be required for enjoyment. Requiring reading or searching in order to unlock a badge or earn points is not really gameplay, IMO; it’s more like an assessment for which you earn a badge or points rather than a grade.
        Some educational games seem to be wolves in sheep’s clothing; just tutorials with quizzes re-branded as “games” due to the inclusion of badges or a competitive element.
        (That said, I have no direct experience with either of the games you tried, so my comments are not directed at them.)

  3. Melanie Polutta

    I confess, in reading through the different types of assignments you did, that I wondered if they were really games, and not simply competition. There is a difference between the two things, although competition is an inherent part of games, usually.

    1. Amy Hofer

      Melanie, thanks for this comment! You’re raising a great point. I’m curious – where would you draw the line between games and regular activities? Do you think it’s worthwhile or do you think it’s problematic to take just a component of games (like competition) into an educational context?

  4. Paul

    I’ve used Lyoming College’s Goblin Threat (http://www.lycoming.edu/library/instruction/tutorials/plagiarismGame.aspx) plagiarism game with classes in the past, and the students reacted positively to it. I don’t know how much they appreciated it as a game per se, but they said it was an enjoyable learning activity. I also use the Keyword Challenges (http://21cif.com/tutorials/challenge/Q2Q/KeywordChallenge.html) from 21st Century Information Fluency as an activity to open a discussion about keywords and related terms. That may be more of a puzzle than a game, but most of the students find it worthwhile, and all of the faculty love it. The thing I like best about these is that they are quick and simple ten-minute activities that can tie into larger lessons. Many of the library instruction games I’ve read about are lengthy and involved, and sometimes how to play seems like a lesson in itself. For those of us who are limited to one-shot sessions, complicated games don’t offer much ROI.

    1. Amy Hofer

      Hi Paul, thanks for sharing your experiences! I hadn’t seen the Keyword Challenge game before – I just tried one of the challenges and flunked :) Looking over their instructions, it’s probably a matter of personal preference but I’m not sold on the language they use to describe searching: “power search,” “search problem,” “query,” “intermediate words” – I probably wouldn’t use this game myself just because I wouldn’t want to endorse that vocabulary by teaching it.

      I just gave the goblin game a second try and finally figured out how to get last goblin in the dorm room, so at least I’m not stuck at the very beginning anymore. How does the goblin game relate to plagiarism, though? Is the point supposed to be that it doesn’t relate? Do you feel that it’s successful because it makes taking a plagiarism quiz a teeny bit more entertaining? These are the honest questions of a non-gamer approaching library games!

      I also appreciate your point about our different instructional settings. Have you used either of these to encourage students to engage with each other in some way? In an online course, that is a big concern (though either of these could be assigned as individual homework for practice, of course).

      1. Paul

        As a non-gamer myself, I had a very negative reaction to the goblin game. It seemed contrived and hokey. But I asked a student to try it out and give me his impressions. He said, “It was kinda fun and I learned a few things about plagiarism along the way,” so I started using it with classes. I guess it works for the exact reason you say: it makes the content delivery a little more entertaining.
        I used both of these as in-class activities, as icebreakers to lead into discussion. In an online class, it would be much harder to get that discussion going.

  5. Great article, and you raise some excellent and thought-provoking questions. I’ve used smaller, one-session games in my instruction and have always been curious about what BiblioBouts is like in action — it was really interesting to read about your experiences.

    I think there is a place for games in library and information literacy instruction, both longer, more involved games like BiblioBouts as well as shorter games. Though the latter might sometimes be described as assignments with competition, I think they can help increase student engagement with the material which is definitely worthwhile. It might not be possible for us to ever create a library game that’s so enjoyable that students pick it up and play it on their own, but I think that’s okay (and not necessarily the fault of games — students’ motivations/preparation for going to college are so varied that I think engagement will always vary based on factors not under our control).

    Lately I’ve been thinking about information literacy games as a low-stakes, nonthreatening way to introduce students to the college library, the research process, etc. That is, we might not be hitting that flow state that comes from playing a game you find compelling for leisure reasons, but we might see other, more modest benefits from using games in our library instruction.

    1. Amy Hofer

      Thanks for this response Maura! The sensible middle ground :)

      I agree with you that for the reasons you’ve mentioned, games are a great fit for orientation sessions or introductory sessions. Personally I’d love to have more ice-breakers in my teaching toolkit.

  6. Pingback : Incorporating Play Into Instruction | mcnabbarchives