August 2024 - AACRAO's first Green Paper for the LEARN Commission, Learner Perceptions of Educational Quality, and How Learners and Faculty Perceive the Effect of AI on Academic Integrity

Dr. Wendy Kilgore |
August 27, 2024
  • Research
  • AACRAO Research Insights
  • AACRAO Research Resources
  • AI
  • artificial intelligence
  • employability
  • free college
  • Learning Mobility
  • online education
  • student debt
  • Student Experience
  • student loan debt
  • Transcript Withholding
  • value of degree

 

August, 2024 Eye on Research

 

Commentary

The AACRAO and SOVA partnership on the LEARN Commission is opening new avenues for AACRAO to contribute to the higher-education dialogue on credit mobility. Our role as SOVA’s partner involves crafting four green papers to inform the Commission's work, each tackling a crucial aspect of this complex issue.

We have released our first paper, which delves into transforming traditional credit evaluation. In September, our second paper will offer the Commission fresh perspectives on credit for prior learning. The third paper will explore the intricate landscape of dual-enrollment credits. This topic is pertinent because 20% of all community-college learners are still in high school. Interestingly, some institutions of higher education (IHEs) still maintain credit-acceptance policies that do not recognize college credits earned during high-school years. Our fourth, and final, paper will examine how technology (with a focus on AI) can support and enhance credit mobility.

As I immerse myself in research from diverse fields to shape these green papers, my thoughts often drift back to my time as a doctoral student. It's fascinating to see how that experience has guided me to where I am today. I feel privileged to serve in this role and sincerely hope my work proves valuable in your own endeavors. I'm always eager to hear your thoughts. If there's a particular topic you believe AACRAO Research should explore in 2025, please reach out to me at wendyk@aacrao.org.

AACRAO Research Update

Our research initiatives continue to make strides. Our first green paper for the LEARN Commission marks a significant milestone in our ongoing work.

We recently finalized the 2024 Registrar Career Profile survey, gathering insights from 695 individuals across U.S. institutions. Many respondents generously offered to share their career-journey stories, which will add a rich, personal dimension to the report. Watch for this comprehensive analysis, set to be released in late fall.

Looking ahead to early September, our primary contacts can expect to receive the dual-enrollment survey. Data from this survey will help shape our upcoming green paper on the topic. We're collaborating with NACEP and CCRC to ensure our survey content is comprehensive and reflects the latest developments in the field.

In other news, Ithaka S+R and AACRAO have just concluded a series of enlightening roundtable discussions with member volunteers. These conversations centered on the new federal regulation concerning transcript holds. Building on these discussions, we are now crafting a white paper that will provide valuable insights into this important issue.

Additionally, we're making progress on Part 2 of our report examining the anticipated impact of the transcript-hold regulation on institutions and learners. Part 1 focused on data from states without similar existing regulations. Part 2 will focus on states that already have comparable measures in place. This dual perspective promises to offer a nuanced understanding of the regulation's potential effects across different contexts.

AACRAO Resource Spotlight

We're excited to introduce a new semiregular feature in our monthly Eye on Research blog: the "AACRAO Resource Spotlight." This section will highlight the wealth of resources available to our members, many of which you might not be aware of or have forgotten over time.

In light of the frequent policy-related inquiries we see on the AACRAO Exchange, our inaugural spotlight falls on the Higher Ed Policy Database, made available to AACRAO members through the generous support of CollegeSource. This valuable resource contains policies from over 1,000 institutions, covering catalogs from 2018 to the present, with annual updates to ensure currency.

Access to this resource is a benefit of AACRAO membership. If you are not yet a member and are interested in accessing this and other valuable resources, we offer various membership options to suit your needs.

Stay tuned for future spotlights as we continue to showcase the diverse array of tools and resources AACRAO provides to support your professional development and institutional needs.

image2-eor8-28
 
 

    Current Higher-Education Research and Related Topics

    NACUBO Report Outlines Blueprint for Learner-Centered Strategic Finance
    A new report from the National Association of College and University Business Officers (NACUBO) presents a model for integrating learner-success initiatives with institution-wide finance plans. Charting the Future: NACUBO's Blueprint for Student-Centered Strategic Finance offers a flexible framework to help chief business officers (CBOs) improve learner outcomes through strategic financial practices. Core elements of the model include the following.

    • The model emphasizes six "Strategic Impacts" 

    • Three focus areas are identified: data infrastructure and analytics, financial-resource optimization and learner-centered planning and budgeting.

    • The framework is adaptable to each institution's unique needs; customizable toolkits are available through the NACUBO Student Success Hub.

    • The model promotes interdisciplinary collaboration and data-informed decision making to align resource allocation with improved learner outcomes, particularly for underserved populations.

     

    Study Finds Institutions Should Focus More on Personal Reasons for Stop-Outs 
    A new report from CAEL examines some of the challenges faced by adult learners in postsecondary education, highlighting the high rates of stopping out and longer completion times compared to traditional learners. It determined these issues are primarily due to personal circumstances rather than academic difficulties, suggesting institutions need to adapt to better accommodate adult learners' needs. Key points include:

    • nearly 50% of respondents report taking a break during their current enrollment

    • the most common reasons for stopping out include work commitments, emotional stress/mental-health issues and healthcare concerns

    • financial constraints and unexpected expenses were prevalent factors in stopping out 

    • academic issues were least cited as reasons for stopping out

    • demographic factors, such as gender and parental status, influence the likelihood of stopping out; men and parents were more likely to take breaks 

    Learner Perceptions of Educational Quality Examined in Student Voice Survey
    A new report on the Student Voice Survey data focuses on learners' perceptions of educational quality in higher education, highlighting variations based on institution type, region and learner characteristics. While the majority of learners rate their education positively, there are notable differences among various demographic and institutional factors. The full interactive survey report is available here. Key features of the report include:

    • private, nonprofit institution learners are more likely to rate their education as excellent 

    • regional differences exist; New England learners rate their education quality as highest and far West learners rate it as lowest

    • family income correlates with higher ratings of educational quality; wealthier learners rate their education as excellent

    • older learners (25+) rate their educational quality higher than younger learners

    • course modality impacts perceptions; in-person classes receive higher quality ratings than online classes

    Data from the Student Voice Survey Focuses on Affordability
    This article from Inside Higher Ed discusses the findings of the Student Voice survey relating to college affordability. Data reveals college affordability is a significant concern for learners across various demographic groups and income levels. The study highlights the widespread impact of tuition costs on academic success and explores the complexities of college affordability beyond sticker prices and average net prices. Key points include the following.

    • The majority of learners, regardless of income level, identified making tuition more affordable as the primary action institutions could take to promote their academic success.

    • Net prices for public and private institutions have increased, with affordability being particularly acute for lower- and middle-income learners.

    • Learners across income levels report financial stress related to college costs, though the severity varies along a continuum.

    • The lack of transparency in higher-education costs complicates learners' decision-making processes and has implications for public policy.

    • Experts suggest institutions streamline financial-aid processes, offer loan counseling and provide clear information about college costs and available resources.

    • Policy recommendations include increasing funding for financial-aid programs and adopting equitable free-college initiatives to improve overall college affordability.

    Learner-Success Initiatives Examined Over a 3-Year Period
    A new report (full report requires login) from Civitas Learning analyzes the effectiveness of learner-success initiatives at partner institutions. It examines long-term trends since summer 2021 and recent trends from 2023. See Figure 1. The report emphasizes the importance of data-driven decision making in designing, implementing and maintaining successful learner-support programs to enhance persistence and institutional success. Key points include:

    • highlights the "Student Impact Gap" concept

    • focuses on the necessity of institutions analyzing their own data to address unique learner-population needs

    • emphasizes the importance of regular program assessment to determine effective support methodologies to plan future initiatives, allocate resources and align efforts across institutional departments

    • suggests a focused, sustained approach to analyzing initiative effectiveness can lead to long-term positive outcomes in learner-success interventions

    • Figure 1:10 Most Successful Types of Student Success Interventions During this Three-year Period (“PP” is percentage points)

    image1-eor-aug28

    Source: “Student Success Impact Report.” Civitas Learning, 2024. Civitas Learning Report

    Report Examines Changing Global Landscape of Employability Skills 
    Key findings from Coursera’s Global Skills Report 2024 (login required) highlight trends in skills development and learning across various regions. The report emphasizes the growing importance of AI literacy, the persistence of digital-skills gaps and the evolving landscape of cybersecurity and microcredentials in the global workforce. Key points include the following.

    • There is a global surge in AI literacy; regional variations occur in the depth of AI-skill development.

    • A persistent digital AI-skills gap exists, despite increasing demand in most jobs.

    • Cybersecurity skills remain crucial, but enrollment growth should also focus on other high-growth areas, such as cloud computing and data science.

    • Microcredentials are increasingly popular as rapid pathways for learners to prepare for in-demand jobs.

    • The gender gap in online learning is narrowing, though regional disparities persist.

    How Learners and Faculty Perceive the Effect of AI on Academic Integrity
    New research from Wiley (login and download required) focuses on the challenges faced by educators in maintaining academic integrity amidst the rise of AI tools, hybrid learning models and increased learner cheating. The report details a survey conducted to explore the perspectives of instructors and learners on these issues, particularly focusing on the impact of AI on education and academic integrity. See Figure 2. 

    The study surveyed 850 instructors and 2,067 students on academic-integrity challenges. Research aimed to understand learner and instructor attitudes toward AI in education and whether AI enhances learning or negatively impacts academic integrity. The study examined factors contributing to rising rates of cheating, including time constraints and performance pressures. It also investigated the adoption of AI tools by instructors in their teaching practices.

    Figure 2: Key Findings from the Study
    image3-eor8-28

    Source: “The Latest Insights into Academic Integrity: Instructor & student experiences, attitudes, and the impact of AI,” 2024. Academic Integrity Report.

    Report on Graduate Employability Highlights Practical Skills and Generative AI
    The 2024 Graduate Employability Report from Cengage discusses the misalignment between higher education and workforce needs, highlighting challenges faced by employers in finding suitable talent and the underutilization of graduates' skills in their jobs. The report also highlights the shift in perceptions of recent graduates regarding the value of education. See Figure 3. It emphasizes the need for education systems to adapt to changing workforce demands, particularly through the integration of practical skills and emerging technologies, such as generative AI (GenAI). Key points include the following.

    • There is a significant mismatch between graduate skills and job-market demands, with 52% of new graduates working in jobs that do not use their degrees.

    • Federal, state and educational institutions are making significant efforts to align education with workforce needs.

    • The value proposition of higher education is shifting toward practical, job-ready skills alongside traditional academic credentials.

    • There is an increasing focus on experiential learning and the incorporation of GenAI into curricula.

    • Community-college enrollment across the United States has surged, indicating a growing interest in career and technical education.

    • Collaboration between educational institutions and industry partners is needed to prepare graduates for the GenAI-driven workforce.

    Figure 3: Recent Graduates Perception of the Value of Their Education
    image4-aug28Source: “CG-2024-Employability-Survey-Report.pdf,” n.d. CenGage Report.  

    Generative AI Appears Less Useful as a Tutoring Tool than Predicted
    An article published by Axios examines the impact of using generative AI (GenAI) tools on the academic performance of high-school learners preparing for math exams. Findings suggest GenAI “tutors” can improve learners' performances on practice problems, but learners tend to use the tools as a crutch. This can lead to significantly worse performance on actual exams when learners cannot rely on AI. Cautious, guided deployment of GenAI in educational settings to ensure learners continue developing critical skills is essential. Other key points include the following.

    • Learners often use GenAI to copy and paste answers, which leads to less engagement with the material.

    • Experts recommend deploying GenAI cautiously and guiding learners on how to use tools effectively; even small changes to prompts can improve learner interactions.

    • GenAI tutors could be beneficial in areas with teacher shortages.

    • Motivating learners to engage with the material remains a challenge.

    • Finding ways to balance the democratizing potential of GenAI with the need to maintain learner learning and skill development is important.

    Report Examines Academic Freedom in the Current Political Climate
    A report from ITHAKA S+R presents findings from a national survey of U.S. instructors at 4-year colleges and universities, focusing on academic freedom and censorship concerns in higher education. The study was conducted amidst the backdrop of protests related to the war in Gaza and the political and legislative actions that affected academic institutions. It seeks to understand instructors' experiences and attitudes toward discussing controversial topics in the classroom. Key points include the following.

    • The majority of instructors do not report feeling unsafe or uncomfortable discussing sensitive topics, though some variations were noted, based on institutional type, discipline and demographics.

    • A small percent of instructors avoid teaching or discussing controversial topics, with Middle East conflicts and abortion/contraception being the most-avoided subjects.

    • Nearly 33% of instructors report no academic-freedom challenges.

    • Instructors seeking support desire frameworks for engaging students on sensitive issues or understanding institutional responses to new policies.

    • Instructors are more likely to turn to peers for support rather than their institution.

    • Opinions are mixed regarding an institution's ability to foster constructive conversations on sensitive issues.

    Learner Choice in Attendance and Assessments May Lead to Improved Performance
    This research article published in Science Adviser and supported by Carnegie Mellon University, presents findings from two studies exploring the impact of autonomy-supportive policies on learner performance and engagement in higher education. Research demonstrates that providing learners with choices in attendance requirements and assessment options can lead to improved outcomes in classroom attendance and subject mastery. Key points include the following.

    • Studies address a gap in empirically tested interventions for promoting learner autonomy in higher education.

    • A randomized controlled field study showed that allowing students to choose whether to make attendance mandatory increased their likelihood of attending class.

    • A multiyear cohort study revealed giving learners the option to opt out of a challenging assessment stream resulted in greater effort investment and improved proficiency.

    • Increased autonomy may enhance learner motivation and achievement.

    • Choice architecture principles can be applied more broadly to improve learning, motivation and well-being in higher education settings.

    Study Explores the Effects of Incorporating Inclusive Practices in Syllabi 
    A new study published in Nature’s Humanities and Social Sciences Communications journal examines the use of inclusive practices in course syllabi at a STEM institution. The study investigated the extent to which syllabi list instructors' pronouns, use readings and materials authored by women and gender-minority scholars, and contain inclusivity statements. The research combines an analysis of 163 syllabi and an undergraduate-learner survey to understand the relationship between learner expectations and actual syllabi content.

    Key points of the study include:

    • explores the importance of inclusive syllabi design, particularly for marginalized learners in STEM courses

    • analysis of syllabi and learner-survey data reveals significant differences between learners' expectations and the actual content of syllabi

    • learners desire more inclusive practices in course development, regardless of subject; faculty implementation of these practices lags behind these desires

    • provides suggestions for incorporating inclusive practices into syllabi design and proposes further questions for exploration

    • the need for greater alignment between learner needs and faculty practices in creating inclusive learning environments is highlighted

    Survey Examines How to Attract, Engage, and Retain Learners
    A new study presents the findings of a survey conducted by Modern Campus and Higher Ed Dive, which gathered insights from over 700 institutions and undergraduates across North America. The survey report discusses the pressing challenge faced by higher-education leaders in attracting, engaging and retaining learners, particularly in the face of declining undergraduate-enrollment trends. Key points include the following.

    • Undergraduate enrollment has declined more than 12% since its peak in 2010, leading institutions to sharpen their recruiting and retention strategies.

    • Traditional-age college learners now share many priorities with adult learners, especially concerning degree planning and career pathways.

    • Institutions can improve their communication and personalization of the prospective learner's online experience.

    • Institutions need to support learners after they have enrolled to keep up with changing learner demographics and needs.

    • Three practical steps higher-education leaders can take to maintain the viability of their institutions in a highly competitive environment are highlighted.

    • An institution must understand and adapt to the evolving needs and preferences of the learner population.

    Report on Latest Changing Landscape of Online Education Released
    This report is the ninth installment of the Changing Landscape of Online Education (CHLOE) series from Quality Matters™. It provides an overview of the current state, and future development, of online learning in higher education. Based on a survey of chief online officers at 2-year and 4-year U.S. colleges and universities, the report highlights trends and challenges in the online learning landscape. Key findings include the following.

    • Institutions are prioritizing the development of online versions of on-campus courses and degree programs to meet growing learner demand.

    • Most institutions charge the same tuition for online and traditional face-to-face learning, with many public 4-year institutions generating net revenue from online programs.

    • Institutions are taking varied approaches to addressing the presence and potential use of AI in higher education; about 33% have AI-related policies in place.

    • The adoption of third-party service providers, such as Online Program Management (OPM) is increasing, despite uncertainty around new federal regulations targeting these partnerships.

    • The majority of institutions have, or are considering, Regular and Substantive Interaction  (RSI) policies and guidelines.

    • Public institutions are more likely to have RSI policies and guidelines in place than private institutions.

    • Institutions provide varying levels of faculty support to meet RSI requirements.

    • A significant number of institutions do not evaluate courses to determine if RSI standards have been met.

    • The ongoing evolution and challenges of the online learning landscape in higher education are highlighted.

    Study Examines the Implementation and Impact of “Free College” Programs
    This study investigates the impact of two similar community-college tuition-guarantee programs in Pennsylvania on college-attending outcomes. Using learner-level data, the research explores how these "free college" initiatives affect college attendance, degree attainment and student trajectories.

    The Morgan Success Scholarship program has significant positive impacts on community college attendance and associate-degree completion. The program temporarily diverts students from 4-year college enrollment, though this effect diminishes over time. In contrast, the Community College of Philadelphia's 50th Anniversary Scholars program shows little evidence of any impact on college-attendance behavior.

    Key findings of the study include:

    • the design and implementation details of "free college" programs can play a crucial role in determining their effectiveness

    • insights and suggestions for policymakers and practitioners in designing and evaluating the impact of similar college-affordability initiatives are offered

    • research highlights the importance of rigorous, learner-level data analysis in understanding the nuanced effects of "free college" programs on college access, enrollment and completion

    • findings underscore the need for careful program design and evaluation to ensure "free college" initiatives achieve their intended goals of improving college access and success