Perfect homework, blank stares: Why colleges are turning to oral exams to combat AI

[Coventina]

The assignment involves no laptop, no chatbot and no technology of any kind. In fact, there’s no pen or paper, either.

Instead, students in Chris Schaffer’s biomedical engineering class at Cornell University are required to speak directly to an instructor in what he calls an “oral defense.”

It’s a testing method as old as Socrates and making a comeback in the AI age. A growing number of college professors say they are turning to oral exams, and combining a variety of old-fashioned and cutting-edge techniques, to help address a crisis in higher education.

“You won’t be able to AI your way through an oral exam,” says Schaffer, who introduced the oral defense last semester.

Educators are no longer naively wondering if students will use generative AI to do their homework for them. A big question now is how to determine what students are actually learning.

College instructors across the U.S. are noticing troubling new trends as generative artificial intelligence becomes more sophisticated. Take-home essays and other written assignments are coming back perfect. But when students are asked to explain their work, they can’t. The long-term impact of AI use on critical thinking remains to be seen, but educators worry students increasingly see the hard work of thinking as optional.

https://triblive.com/news/world/perfect-homework-blank-stares-why-colleges-are-turning-to-oral-exams-to-combat-ai/

******************************************************************************************************************

I'm doing this currently in one of my courses.
I might expand it to all the others.

[SheltieLover]

1. Excellent!

[PeaceWave]

2. Sounds good until you consider the issue of anonymity...

Anonymity in grading is important. Professors are people. They have prejudices, biases and hold grudges just like anyone else.

[Coventina]

3. How is that any different from grading written assignments?

I know who all my students are.

[PeaceWave]

6. At all the colleges I attended, finals/midterms were submitted with randomly assigned numbers - not names...

The professor or TA grading the tests had no idea which student's test they were looking at.

[Coventina]

7. I have never encountered such a system in all my years of being a student or professor. n/t

[PeaceWave]

11. That's how it was (and, I am sure, still is) done throughout the entire University of California system.

[Coventina]

12. I'll take your word for it in regards to UC, but I'm pretty confident that's not the norm.

No writing assignments?

No in-class quizzes?

No research projects?

Seems pretty strange that all UC does is anonymous testing for their degrees.

I've been at TA and professor at both the community college and university level here in AZ and we've never had anonymous testing.

[PeaceWave]

15. This is the direct quote from U.C. Berkeley Law's academic guidelines...

"Exam grading is anonymous. A paper or other work that requires substantial interaction between instructors and students need not be submitted anonymously."

https://www.law.berkeley.edu/academics/registrar/academic-rules/

So, yes, there are exceptions. But, since the vast majority of the student's grade derives from their midterm and final exams, for all intents and purposes, they are assessed anonymously.

The same rule is mirrored at all UC campuses, law school and undergrad alike.

[Coventina]

16. OK, so that's law school. And only testing, not other forms of assignments.

Overall, a pretty small segment of academia in general.

[PeaceWave]

17. I literally just wrote..."The same rule is mirrored at all UC campuses, law school and undergrad alike."

[Coventina]

18. Please provide the link that says this applies to all undergrad programs. n/t

[PeaceWave]

20. Google each campus and "anonymous grading" and you'll find your link...

Anonymous grading also applies at all California State colleges. That's 770,000 combined students between the UC System and the State College system in California who enjoy the benefits of anonymous grading. I'm actually surprised that anyone would even question this. Anonymous grading is considered a basic tenet of Public California colleges.

[Coventina]

21. I just did so and according to Google (which you recommended) it only applies to law schools

and a few other courses.

[PeaceWave]

23. I'm not going through all 30+ campuses. But, this should suffice since, for whatever reason, you don't believe me...

AI Overview...

Anonymous grading at UC Berkeley is a best practice recommended for GSIs and faculty to reduce bias, where instructors avoid looking at names on exams or papers until grading is finished. While not universal, instructors may use anonymous grading via (Canvas) or by requesting students use student IDs rather than names, according to the GSI Teaching & Resource Center.

UC Santa Barbara (UCSB) utilizes blind grading to reduce subjective bias, allowing instructors to hide student identities in Canvas for assignments. Techniques include using blind grading numbers,, hiding names on blue books, and using cover sheets for essays. Anonymous grading is not always feasible for performance-based or interactive courses.

UC Irvine (UCI) uses anonymous grading primarily in the School of Law for exams, where students use assigned identification numbers instead of names. For general undergraduate courses, instructors may use digital tools like Gradescope to facilitate anonymous, fairer grading, particularly for STEM, although it is not universally mandated for all assignments.

UC San Diego does not have a campus-wide policy mandating anonymous grading for all undergraduate work, but it is supported through tools like Gradescope. Instructors often use tools to grade exams and assignments individually and anonymously to avoid bias, and sometimes use 3-digit codes to post results anonymously, says University of California San Diego.

[Coventina]

25. So, it is used sporadically and is not mandatory. n/t

[PeaceWave]

29. Believe whatever you choose. But, having attended UCs for both undergraduate and graduate school...

The only material I ever recall not being graded anonymously was homework - which never accounted for more than 10% of a grade. There was literally no reason to break the anonymity. Which raises the underlying question here. Why would you want to judge a student non-anonymously when it runs the risk of all sorts of biases entering into the equation? If you want to challenge a student during the semester by utilizing the Socratic Method, great. Do so. I applaud that. However, applying a grade based on the interaction between the student and professor is rife for potential abuse. That is the rationale for anonymous grading.

[Coventina]

31. All I can say is that your experience has been nothing like mine, either as a student or professor.

And nobody I know has had that experience either.

And why are you so accusatory that professors are out to unfairly judge students?

I love my discipline and my students. I want them all to get As, but they have to earn them fairly, not by cheating.

[PeaceWave]

37. Anonymous grading probably sprung out of the politics at UC campuses...

We're talking about universities like Berkeley where you had Socialist and Communist movements prior to the Red Scare. A student's professor was entirely likely to share a differing political view as that of his or her student. Hence the need for anonymity. That's not my view. That's simply the view of whomever designed the accepted grading policies withing the UC and Cal State systems.

[Coventina]

39. Well, your assertions about what is "policy" is being disputed here by more posters

than just me.

[PeaceWave]

41. I'm entirely confident in what I personally witnessed in the UC System...

And, I might add, I'm proud of how the UC System is run and wouldn't want it any other way. The system is egalitarian and free of bias and prejudice. It has often been referred to as the crown jewel of accomplishments in California.

[Coventina]

43. Ummmmm Okay.

[obamanut2012]

33. You didn't go through all teh campuses because most don't do this, and there aren't 30+

There are TEN UC campuses.

[PeaceWave]

38. There are 30+ UC and Cal State schools.

[obamanut2012]

32. Because they are incorrect

UCLA and a couple others do it, I know UCSB professors CAN do it if they want, but other UCs do not do it.

Feel free to DM me about questions about it, I don't feel comfortable answering more on the open forum.

[Coventina]

36. Thanks! A more informed voice is much appreciated here. nt

[PufPuf23]

28. That is not correct about the University of California system. nt

[obamanut2012]

34. Yup, it is not accurate

[Ms. Toad]

56. The vast majority of the grade for every university course I taught was anonymous.

It was law school. Anonymizing was done via the the administrative offices - each student was assigned an exam number, which they used for all of their classes. Once the papers were all graded, the administrative offices provided the key to convert the exam numbers to the faculty. At one point, faculty was not even proctoring their own exams in order to provide even further anonymity.

Assignments short of the midterm or final exam weren't anonymous - but most faculty didn't give any. I did, because iterative feedback was crucial. Those grades counted for around 25% of the semester grade.

I'm in undergrad at the same university now - no anonymizing, but I don't know if that is because it is in an area which is hard to anonymize because of the substantial time spent in class working on the projects.

I'm surprised you haven't encountered it. You might want to try it. I've been very surprised at some of the scores on anonymized papers. I don't think I would have scored them differently had I known the names - but I've had top students score at the bottom, and bottom students score at the top.

[PeaceWave]

72. This is exactly as I recall, except that it was this way in both undergrad and grad school...

The funny thing is that if you ever contested a score, the whole veil of anonymity collapsed - since you had to sit down with your Professor or TA and go over the exam in person. That was rare though. The only time I had to do that was when the person grading the exam clearly missed a couple of pages worth of answers, which drastically altered my score. Fun times.

[progressoid]

24. No such thing in the performing or fine arts.

[obamanut2012]

30. Not one of mine did that -- either as a student ro instructor

[Happy Hoosier]

44. My wife has been a college professor for 30 years...

… she had never given an anonymous exam.

And she just caught an AI cheater by interviewing them.

[OC375]

13. Seems odd

It's been 3 decades, but back then anonymity wasn't even a consideration. In fact, no name = no grade.

[Torchlight]

19. Any objective research into how large your asserted problem is nationwide?

Seems more than relevant to me.

[Trueblue Texan]

51. I think a better approach would be a written exam, in class, with the questions delivered orally.

Why are they giving them take home exams anyway?

[OC375]

61. Isn't a "take home exam" just fancy talk for "homework"?

I'd have absolutely killed it in school if I could have taken my tests at home. Wow.

[PeaceWave]

64. Take home exams were miserable. You ended up working all night on them. Better to get it done in 3 hours.

[OC375]

71. LOL. To each their own. :)

I'm a perfectionist and I'd have gladly taken the entire night if given the opportunity. I love a long runway to hammer on things until they're perfect.

[PeaceWave]

73. God no. 3 hours. Crush that thing. On to the next. Then, party like hell when it's all done.

[Lucky Luciano]

70. For more advanced courses, a 3 hour exam can't...

…test the material well. So they make take home exams which are far more difficult and comprehensive. I approved of this because it’s true that any 3 hour exam only tests superficial understanding, but AI does mean new methods are needed. Probably has to be the take home plus rigorous interviews on the submission….trying to figure out how the labor of grading this could be addressed. Probably it is only an interview without grading the written part so much to save time. Or AI does the interview LOL. I dunno…still unsatisfying…my field is math…it’s a helluva lot easier to understand a proof given to you than to use your own creativity to solve the problem. So having AI solve the problem kills your own creativity even if you labor to understand the solution AI gives.

[hlthe2b]

4. Count me incredibly unsurprised... And good on them for doing this...

As one who has had to face my share of oral exams and boards, well, good. Get some experience early--and show you actually learned something. Not to mention their instructors will soon see who can at least SPEAK in complete sentences, make coherent comments, and understand a verbal question--even if so damned many cannot do so by writing (even before AI's arrival).

[Mysterian]

5. Great idea

Time consuming but so is grading papers.

[Jacson6]

8. Just have them write essays and solve math problems by writing in a blue book.

Just make sure that they have NOT brought in any computer devices or smart glasses. We used the blue book 40 yrs ago when I was in college.

[PeaceWave]

46. Bingo. Those were the days. You were handed the questions and you had 3 hours to get it done.

[orleans]

57. never heard of a blue book. can you give a bit more detail? i figure if i google it then i'll get a lot of links about

cars.

[Jacson6]

59. It was a multipage blank paper notebook with a blue cover.

You had to write out the essays, test questions and math problems by hand writing. No computers back then and no smart phones now.

[PeaceWave]

60. A Blue Book had 12 sheets of paper...24 pages front and back. You were cruising if you needed a second book.

[orleans]

62. thanks. that helps. nt

[fujiyamasan]

66. I may have been among the last to use a blue book

This was about 20 years ago.

[OC375]

9. Excellent Idea

Probably good training for real life as well. Beyond cheating, life is both written and verbal and my assumption that anyone graduating college is better than most at both. I've met far too many job applicants with great coursework, plenty of certs, great references, and yet absolutely no ability to explain it to someone in a way that's usable by the audience. Great personal achievement, but we can't use you.

[FakeNoose]

10. This is an effective way to defeat cheating via AI

However someone with a college degree should demonstrate writing skills and mastery of the English language. How can that be achieved when all the testing is done verbally?

Many college students are sadly deficient and they don't seem to understand the importance of composition skills. It goes back to "teaching to the test" days of the early-aughts. Colleges need to start offering remedial classes for incoming freshmen - make composition a requirement and no phones, tablets or laptops allowed in class.

[Coventina]

14. I've given up on trying to teach my students writing.

(Which I'm not supposed to have to do anyway. They are supposed to arrive to my classroom able to write).

All they do is cheat by putting the assignment in ChatGPT and turning in what it spits out.

[FakeNoose]

35. I completely agree, the remedial work needs to be done before they get to your classes

Maybe even summer school, or however it can fit in. Composition should be required for any bachelor's degree. The high schools are falling down on this.

[Torchlight]

22. Given the obstacles, it appears the most honest method

I'm pretty sure that had it been available, AI would have saved me long hours of study and research when I did university, but I wouldn't have really learned anything other than stubborn, meritless arguing and deleting past comments.

[synni]

26. This should have been done years before AI

Too many students have been paying other people to write their papers. So much cheating has been going on for so long, that this is pretty much the only way you can see what is actually being learned by the students.

It's a sad State of affairs.

[2naSalit]

27. I like it...

I had to do oral exams for my Master's because there wasn't enough faculty to address a written thesis and I wanted to be done with my degree sooner than later since I was already in my 40s. I think it's a good idea, especially when AI is taking over the writing of everything.

[Starry Messenger]

40. I am an art prof

Been at this for nearly 30 years and never did I think I'd have to pull my hair out about cheating AT ART. So demoralizing. I had to eliminate some of my fun and creative prompts and just do skill-building. Can't wait until this fad passes

[Gore1FL]

42. I contend that testing is pointless.

Grades should be based on projects and demonstrative understanding used in conpleting them,

If I can use AI or Google to answer any question I am supposed to learn in a course, why bother taking the class in the first place?

[Coventina]

45. That's the thing. I stopped giving tests years ago.

But I can't use writing assignments, because of ChatGPT.

So, that's why I'm moving to one-on-one discussions of course content.

I'm also moving to projects that don't involve writing, or use a writing component that is unique to the student, so they can't use ChatGPT.

[OC375]

69. Sad you have to outwit learners nowadays

That time could be better spent doing just about anything else, I'm sure. A student actually wanting help might have a crack at it if these losers didn't suck up resources. Fighting with clients isn't fun.

I don't get all that student debt, just to cheat on tests and walk away stupid and with a developed tolerance and penchant for cheating and lying? They're literally buying nothing but bad habits, a poor work ethic, and a pause from entering the work force. Older, dumber and in debt - great start to life.

I worked 2+ part time jobs and got my 4 year degree in 6 years like millions before and after me. I can't imagine spending all those hours of work and personal sacrifice just to spend my school hours screwing around like an 10 year old, and come out a cheat and waste of everyone's time.

I'd like to tell them that if you don't want to learn college material, just don't go to school there. Learn a trade, join the army, or start a hustle related to something you actually care about instead. The word is out on people who can't back up their degrees. We trust, but verify now.

[CrispyQ]

58. I'm confused. Students are accessing their phones during the test?

Otherwise, I would think in-class testing, especially with some essay questions, would demonstrate if they know the material.

[Gore1FL]

63. I research everyday for a living in my IT job.

Knowing how to discover information is infinitely more important than memorizing.

All tests should be open book.

[CrispyQ]

65. So open book is okay, but not Google or AI. Right? -nt

[Jim__]

47. One on one discussions sound great. But aren't they time-consuming?

I'm really surprised that university professors would have time for one-on-one discussions with all of their students.

[Coventina]

48. Fortunately, I have fairly small classes.

And the talks are during my office hours, which I'm required to keep.

[Jim__]

49. That sounds great!

[kairos12]

50. I had to do one of these just to get my Bachelors

Degree. Covered all 4 years of my study.

[Raftergirl]

52. My kid had to write a thesis on a topic related to his major and defend it to graduate from his liberal arts college.

I had a zillion blue book exams back in the day.

[lapfog_1]

53. just a thought

technology will defeat this as well... you may have to do the exam one at a time in a TEMPEST room ( aka SCIF ).

It would be easy for people like the MIT backjack card counting ring to rig up something that transfers information to/from the student to an AI or outside help.

Of course, the effort taken to cheat on exams this way can be large, which is why some clever person will monetize it for the masses.

[AllaN01Bear]

54. i dont do well on written tests , so i always asked for oral tests , in fact,

when i took my codeless tec ham license , i asked for a oral tests and passed

[Pucks mom]

55. No Critical Thinking

When using AI. Was just talking to my youngest about this and he brought up the lack of critical thinking he saw in his peers.

I wonder if the kids will be alright

[Raven123]

67. Long overdue.

[Lucky Luciano]

68. I approve this wholeheartedly.

I discussed something like this with my son’s 8th grade English teacher. She’s literally 80 years old with an education doctorate and she believes AI will end civilization basically. She doesn’t give any essays or writing homework bc her assumption is that the kids will use AI - “write an essay on the following topic, but make it look like a smart eighth grader wrote it.” She does give in class writing though.

I suggested something like random drug tests. Give the assignments and randomly sample kids to orally quiz them on the spot on what they wrote about. She said smart kids could still game that system and it would be an unsustainable burden anyway to conduct those interviews. She participates in some ongoing research at Northwestern University trying to find a solution. A solution is needed though. The toothpaste isn’t going back in the tube.