Librarians in universities, colleges, and community colleges can establish, assess, and link
academic library outcomes to institutional outcomes related to the following areas:
student enrollment, student retention and graduation rates, student success, student
achievement, student learning, student engagement, faculty research productivity,
faculty teaching, service, and overarching institutional quality.
Assessment management systems help higher education educators, including librarians, manage their outcomes, record and maintain data on each outcome, facilitate connections to
similar outcomes throughout an institution, and generate reports.
Assessment management systems are helpful for documenting progress toward
strategic/organizational goals, but their real strength lies in managing learning
to determine the impact of library interactions on users, libraries can collect data on how individual users engage with library resources and services.
increase library impact on student enrollment.
p. 13-14improved student retention and graduation rates. High -impact practices include: first -year seminars and experiences, common intellectual experiences, learning communities, writing – intensive courses, collaborative assignments and projects, undergraduate research, Value of Academic Libraries diversity/global learning, service learning/community -based learning, internships, capstone courses and projects
Libraries support students’ ability to do well in internships, secure job placements, earn salaries, gain acceptance to graduate/professional schools, and obtain marketable skills.
librarians can investigate correlations between student library interactions and their GPA well as conduct test item audits of major professional/educational tests to determine correlations between library services or resources and specific test items.
p. 15 Review course content, readings, reserves, and assignments.
Track and increase library contributions to faculty research productivity.
Continue to investigate library impact on faculty grant proposals and funding, a means of generating institutional income. Librarians contribute to faculty grant proposals in a number of ways.
Demonstrate and improve library support of faculty teaching.
p. 20 Internal Focus: ROI – lib value = perceived benefits / perceived costs
production of a commodity – value=quantity of commodity produced × price per unit of commodity
p. 21 External focus
a fourth definition of value focuses on library impact on users. It asks, “What is the library trying to achieve? How can librarians tell if they have made a difference?” In universities, colleges, and community colleges, libraries impact learning, teaching, research, and service. A main method for measuring impact is to “observe what the [users] are actually doing and what they are producing as a result”
A fifth definition of value is based on user perceptions of the library in relation to competing alternatives. A related definition is “desired value” or “what a [user] wants to have happen when interacting with a [library] and/or using a [library’s] product or service” (Flint, Woodruff and Fisher Gardial 2002) . Both “impact” and “competing alternatives” approaches to value require libraries to gain new understanding of their users’ goals as well as the results of their interactions with academic libraries.
p. 23 Increasingly, academic library value is linked to service, rather than products. Because information products are generally produced outside of libraries, library value is increasingly invested in service aspects and librarian expertise.
service delivery supported by librarian expertise is an important library value.
p. 25 methodology based only on literature? weak!
p. 26 review and analysis of the literature: language and literature are old (e.g. educational administrators vs ed leaders).
G government often sees higher education as unresponsive to these economic demands. Other stakeholder groups —students, pa rents, communities, employers, and graduate/professional schools —expect higher education to make impacts in ways that are not primarily financial.
Because institutional missions vary (Keeling, et al. 2008, 86; Fraser, McClure and
Leahy 2002, 512), the methods by which academic libraries contribute value vary as
well. Consequently, each academic library must determine the unique ways in which they contribute to the mission of their institution and use that information to guide planning and decision making (Hernon and Altman, Assessing Service Quality 1998, 31) . For example, the University of Minnesota Libraries has rewritten their mission and vision to increase alignment with their overarching institution’s goals and emphasis on strategic engagement (Lougee 2009, allow institutional missions to guide library assessment
Assessment vs. Research
In community colleges, colleges, and universities, assessment is about defining the
purpose of higher education and determining the nature of quality (Astin 1987)
Academic libraries serve a number of purposes, often to the point of being
Assessment “strives to know…what is” and then uses that information to change the
status quo (Keeling, et al. 2008, 28); in contrast, research is designed to test
hypotheses. Assessment focuses on observations of change; research is concerned with the degree of correlation or causation among variables (Keeling, et al. 2008, 35) . Assessment “virtually always occurs in a political context ,” while research attempts to be apolitical” (Upcraft and Schuh 2002, 19) .
p. 31 Assessment seeks to document observations, but research seeks to prove or disprove ideas. Assessors have to complete assessment projects, even when there are significant design flaws (e.g., resource limitations, time limitations, organizational contexts, design limitations, or political contexts); whereas researchers can start over (Upcraft and Schuh 2002, 19) . Assessors cannot always attain “perfect” studies, but must make do with “good enough” (Upcraft and Schuh 2002, 18) . Of course, assessments should be well planned, be based on clear outcomes (Gorman 2009, 9- 10) , and use appropriate methods (Keeling, et al. 2008, 39) ; but they “must be comfortable with saying ‘after’ as well as ‘as a result of’…experiences” (Ke eling, et al. 2008, 35) .
Two multiple measure approaches are most significant for library assessment: 1) triangulation “where multiple methods are used to find areas of convergence of data from different methods with an aim of overcoming the biases or limitations of data gathered from any one particular method” (Keeling, et al. 2008, 53) and 2) complementary mixed methods , which “seek to use data from multiple methods to build upon each other by clarifying, enhancing, or illuminating findings between or among methods” (Keeling, et al. 2008, 53) .
p. 34 Academic libraries can help higher education institutions retain and graduate students, a keystone part of institutional missions (Mezick 2007, 561) , but the challenge lies in determining how libraries can contribute and then document their contribution
p. 35. Student Engagement: In recent years, academic libraries have been transformed to provide “technology and content ubiquity” as well as individualized support My Note: I read the “technology and content ubiquity” as digital literacy / metaliteracies, where basic technology instructional sessions (everything that IMS offers for years) is included, but this library still clenches to information literacy only.
In the past, academic libraries functioned primarily as information repositories; now they are becoming learning enterprises (Bennett 2009, 194) . This shift requires academic librarians to embed library services and resources in the teaching and learning activities of their institutions (Lewis 2007) . In the new paradigm, librarians focus on information skills, not information access (Bundy 2004, 3); they think like educators, not service providers (Bennett 2009, 194) .
p. 38. For librarians, the main content area of student learning is information literacy; however, they are not alone in their interest in student inform ation literacy skills (Oakleaf, Are They Learning? 2011). My note: Yep. it was. 20 years ago. Metaliteracies is now.
p. 41 surrogates for student learning in Table 3.
p. 42 strategic planning for learning:
According to Kantor, the university library “exists to benefit the students of the educational institution as individuals ” (Library as an Information Utility 1976 , 101) . In contrast, academic libraries tend to assess learning outcomes using groups of students
p. 45 Assessment Management Systems
Each assessment management system has a slightly different set of capabilities. Some guide outcomes creation, some develop rubrics, some score student work, or support student portfolios. All manage, maintain, and report assessment data
p. 46 faculty teaching
However, as online collections grow and discovery tools evolve, that role has become less critical (Schonfeld and Housewright 2010; Housewright and Schonfeld, Ithaka’s 2006 Studies of Key Stakeholders 2008, 256) . Now, libraries serve as research consultants, project managers, technical support professionals, purchasers , and archivists (Housewright, Themes of Change 2009, 256; Case 2008) .
Librarians can count citations of faculty publications (Dominguez 2005)
Tenopir, C. (2012). Beyond usage: measuring library outcomes and value. Library Management, 33(1/2), 5-13.
methods that can be used to measure the value of library products and services. (Oakleaf, 2010; Tenopir and King, 2007): three main categories
Implicit value. Measuring usage through downloads or usage logs provide an implicit measure of value. It is assumed that because libraries are used, they are of value to the users. Usage of e-resources is relatively easy to measure on an ongoing basis and is especially useful in collection development decisions and comparison of specific journal titles or use across subject disciplines.
do not show purpose, satisfaction, or outcomes of use (or whether what is downloaded is actually read).
Explicit methods of measuring value include qualitative interview techniques that ask faculty members, students, or others specifically about the value or outcomes attributed to their use of the library collections or services and surveys or interviews that focus on a specific (critical) incident of use.
Derived values, such as Return on Investment (ROI), use multiple types of data collected on both the returns (benefits) and the library and user costs (investment) to explain value in monetary terms.
in my role as director of my college’s teaching center, I hosted a faculty discussion of Jay R. Howard’s excellent book Discussion in the College Classroom, which recommends that we build structural methods of participation into our courses, rather than just relying on the vocal students to carry the conversation.
Autonomy. The literature on helping students take a deep approach toward their learning — as opposed to a more surface or strategic orientation — suggests they learn best when they feel a sense of autonomy in class. Another approach to the problem of digital distraction, then, would be to invite students into the process of setting the policies that will operate in the classroom.
Cathy Davidson has argued very effectively for what she calls a “class constitution” — an agreement that the class has reached together about certain aspects of how the course will operate.
With an emerging Millennial workforce, organizations are struggling with an influx of new business requirements being defined by consumer based solutions. Expecting engaging content through social and fun applications, organizations that cling to traditional methods of communication, learning, networking and certification will find themselves challenged in their ability to attract and retain top talent.
Join this webinar to discover best practices on how to develop engaging content, including:
Key trends in learning engagement
Effective design of course material
Tips and trick on making content interesting
Time 11:00am ET
Presenter(s): Jeff Salin, Senior Instructional Designer and Team Lead, Creative Services Department, D2L
Using Creative Course Design to Increase Student Engagement
Keeping your learners engaged is a key to success in online learning. This webinar focuses on the tools and strategies that can be used to create an engaging learner experience and increase student success. We’ll share the components of course design that will help you to improve your courses and provide examples of what an engaging course looks like. Conestoga College will be joining us to share their recent experience using the Creative Services team at D2L to improve their online courses, and the benefits that they’ve seen.
Time 2:00pm ET
Presenter(s): Sandra Memmolo eLearning Developer, Kim Regehr Course Instructor, Christa Johnston Instructional Designer, Courseware Development
Here are some questions that will assist in determining if engagement is leading to actual learning:
• Is the technology being integrated in a purposeful way, grounded in sound pedagogy?
• What are the learning objectives or outcomes?
• Are students demonstrating the construction of new knowledge? Are they creating a learning product or artifact?
• How are students applying essential skills they have acquired to demonstrate conceptual mastery?
• What assessments (formative or summative) are being used to determine standard attainment?
• How are students being provided feedback about their progress toward the specific learning objectives or outcomes?
• Is there alignment to current observation or evaluation tools?
Join us next Tuesday, November 10th from 12:00 PM to 1:00 PM, for a special SIG Series webinar: Tales from the National Forum on Active Learning Classrooms
The WSU Learning Spaces Team attended the National Forum on Active Learning Classrooms at the University of Minnesota – Twin Cities this summer and learned a lot. With topics ranging from picking whiteboards to better integrating classroom design into your campus strategic planning efforts, the conference was a treasure trove of good practices, pictures of cool new classrooms, links to useful information, and pro tips. Join us as we share what we learned at this amazing gathering. If you didn’t get a chance to go, this session will be a great opportunity to zoom in on the highlights. If you went, we would love to compare notes!
Ken Graetz, Tom Hill, Stephanie Stango, Dave Burman, and Eric Wright are all part of the Winona State University Learning Spaces Team and members of the Teaching, Learning, and Technology Services unit of Information Technology Services. They attended the National Forum as a team this summer and were able to cover almost all of the sessions. Each brings a unique perspective to the discussion, from under-the-hood classroom systems design and configuration to instructional design and pedagogical strategies.
McGill Principles for Designing of Teaching and Learning Spaces has rubric
most useful technology in an ALC appears to be the whiteboard.
Whiteboards are also very glitchy. Projecting my tablet or laptop is just as effective–with less glitches
evidence that students are reluctant to engage in active learning.
the U has done work, but the “Canadians have the process”
the support faculty gets from technicians: two week in the beginning of the semester in a new classroom.
what is the most important goal of your college education and therefore of this course: a. inquiring information b. learning how to sue information and knowledge in anew situation c. developing skills to continue learning after college
GPA cutoff above 3.0
problem solving skills
written communication skills
GigaPan.com instructor will have students use in classes to identify problems engaging in a virtual field trip. student engagement
wikispaces as GOogle docs, MS Word 16, work collaboratively
not group, but team. team work very important
take what we learned in ALCs to traditional large lecture halls
blending the formal with the informal (including outdoors)
the heart of the student engagement myth: that adding or changing classroom elements, doing a new project, or exposing a student to a new technology or method of instruction will magically transform apathy into a white-hot fire of curiosity.
True engagement comes when a teacher knows a student’s strengths and interests beyond the classroom and uses that knowledge to deepen relationships. If we go into our rooms each day to teach but not connect, we can’t expect students to care beyond a test score, if that.
Can you answer these questions about your students? If you can, how do you apply that knowledge to connect with them?
*What home issues are affecting their work?
*Do they have a non-academic passion?
*What are their favorite shows, games, songs, or books?
*Do they have a preferred learning style?
*What is their hidden talent?
*What goals do they have for themselves in the future?
My note: easily said then done; if the instructor is overloaded with 4 classes 100 students per class, the suggestion above is rendered useless.
The take-home message for instructors is that, to maximize student engagement, they should work with instructional designers and video producers to break up their lectures into small, bite-sized pieces.