As institutions face the demographic cliff coupled with other unexpected enrollment challenges, student success takes a larger role in helping institutions retain the students they have. A VP of enrollment management I used to work with always told me, “It’s cheaper to keep a student than to buy a new one.” In this week’s issue, we look at the recent results of a survey of student success administrators before closing with three Sparks on international students, college applicants, and a bipartisan bill for students with disabilities.
A Lack of People
From Student Success Is the Priority. Capacity Is the Challenge. | Inside Higher Ed
According to Inside Higher Ed’s third annual Survey of College and University Student Success Administrators, most administrators believe in their institution’s commitment to student success, but many are struggling to analyze and meaningfully take action on their data.
Our Thoughts
Oh, I love the results from a good survey. The response rate of this survey isn’t the best (4 percent), but I still think it can provide some useful insights into the world of student success efforts, specifically around Evisions’s specialty—data. We have results from three years, which gives us some good points for comparison. Happily, the share who say their institution is highly effective at making student success a priority has climbed from 59 percent to 64 percent, so yay! We’ve also increased the share of institutions that say they are highly effective at collecting student success data, rising from 44 percent to 48 percent. However, we’ve slipped from 40 percent to 37 percent of institutions that believe they are highly effective at analyzing that data. That’s not great. The survey results would indicate that institutions believe student success matters more, and we’re gathering more data, but our capacity to make sense of that either hasn’t grown or maybe has even decreased. A mountain of unanalyzed data is just a pile of facts not informing decisions or actions.
The survey did ask what limits a team’s ability to innovate, and unsurprisingly, the answers kept returning to money and people, with funding in about half the responses and staffing/capacity in about a third. The full report also states the data numbers have barely budged “despite new capabilities with the deployment of artificial intelligence.” Last week, I wrote about AI and campus staff work, and so I was perhaps a little surprised that AI hadn’t impacted those numbers. People are using it, but I suppose it’s still just a tool. It might speed up the process, but it doesn’t change the root of the skills and abilities someone needs to be an analyst. You still have to prompt the AI with the right questions to get insight into your data.
Personally, as I experiment with AI (not to write this human-written blog post), I see the challenges. First, AI requires clean data. It won’t scrunch up its nose or raise an eyebrow (mainly because it doesn’t have any) like the analyst in your IR office does when a report shows 100 percent of students have no reported gender because a column is off or coded incorrectly. Second, even when the data is clean, AI can still be confidently incorrect. A person could ask the AI to analyze a dataset to determine what factor is most predictive of retaining a student. The AI crunches the numbers and reports back the strongest correlation is being an athlete, so clearly all of our students need to learn to play a sport, when what’s really helping is the additional academic support of being on a team. Using AI is like using a speed-me-up tool. It helps an analyst go more quickly through an analysis, but it doesn’t help someone become an analyst. For example, I love that I can ask the AI to format columns in a CSV or show me different slices of the data way faster than I could do the same actions in Excel, Google Sheets, or R. Oh, the limits of human typing. However, not everyone starts their AI session by asking the AI to show the shape of the data, so they can better understand the data they have before diving in with questions.
So, I guess the moral of the story is: before your institution buys another tool or AI add-on, think about who can best make use of these tools and how you might train your campus users to use them effectively. Although AI can do a lot of things, I have yet to see a model that can make the human user more curious about their data or ask the right questions to get at the real answers they need. Until you get there on your campus, I predict we’ll continue to see the gap between data collection and analysis grow.
Sparks
- International Student Interest in U.S. Surges After Midterms (Inside Higher Ed) - According to Studyportals, the number of page views for U.S. academic programs jumped 40 percent between Nov. 1 and Nov. 8. Page views are a long way from applications and even further from deposits, but that rapid increase is promising for next fall.
- The College Applicants Who Won’t Share Their Race (The Chronicle of Higher Education) - Students are increasingly choosing not to report their race during the admissions process. Although they’re still a minority, the increase is concerning as it relates to data quality and understanding the complete picture of your student body.
- Bill Supporting College Students With Disabilities Passes Senate (Inside Higher Ed) - The Senate passed the bipartisan RISE Act, which would let students use their IEPs or 504 plans from high school as proof of disability when requesting college accommodations. Although it still has to pass the House (where it has support) before the end of the year, this is a positive step for students who need accommodations.

0 Comments