{"id":64013,"date":"2022-07-20T02:46:59","date_gmt":"2022-07-20T06:46:59","guid":{"rendered":"https:\/\/world.edu\/?p=64013"},"modified":"2022-07-20T02:46:59","modified_gmt":"2022-07-20T06:46:59","slug":"we-have-developed-a-way-to-screen-student-feedback-to-ensure-its-useful-not-abusive-and-academics-dont-have-to-burn-it","status":"publish","type":"post","link":"https:\/\/world.edu\/we-have-developed-a-way-to-screen-student-feedback-to-ensure-its-useful-not-abusive-and-academics-dont-have-to-burn-it\/","title":{"rendered":"We have developed a way to screen student feedback to ensure it\u2019s useful, not abusive (and academics don\u2019t have to burn it)"},"content":{"rendered":"

\"\"<\/p>\n

This week, many Australian universities will be sending academics the results of the first semester student evaluation surveys.<\/p>\n

For some this will be a worrying and unpleasant time. The comments university students make anonymously in their teaching evaluations can leave academics feeling\u00a0fearful<\/a>,\u00a0distressed<\/a>\u00a0and\u00a0demoralised<\/a>.<\/p>\n

And with good reason. As a 2021\u00a0survey<\/a>\u00a0of Australian academics and their experiences of student feedback found:
\nPersonally destructive, defamatory, abusive and hurtful comments were commonly reported.<\/em>
\nHurtful or abusive comments can remain permanently on record as a\u00a0measure of performance<\/a>. These records can affect applications for promotion or for secure continued employment.<\/p>\n

The authors of the 2021 survey, led by Richard Lakeman at Southern Cross University have been among those\u00a0calling for<\/a>anonymous online surveys to be scrapped. Some academics, burned by their experience of student feedback, say they no longer\u00a0open or engage<\/a>\u00a0with student evaluation reports. They said the risk of harm outweighed any benefits.<\/p>\n

In the Netflix show The Chair, a memorable scene sees the character Professor Joan Hambling\u00a0burn<\/a>\u00a0her student evaluations. Clearly, a different solution is needed.<\/p>\n

Feedback from students can still be valuable for lifting teaching standards and it\u2019s important students have their say.<\/p>\n

We have developed a\u00a0screening system<\/a>\u00a0using\u00a0machine learning<\/a>(where software changes its behaviour by \u201clearning\u201d from user input) that allows students to talk about their experiences while protecting academics from unacceptable comments.<\/p>\n

Why a new approach is needed<\/strong><\/h4>\n

University codes of conduct remind students of their general obligation to refrain from abusive or discriminatory behaviour, but not specifically in regard to student evaluations.<\/p>\n

Instead, universities rely on self-regulation or on others to report incidents. Some institutions use profanity blockers to screen comments. Even then, these often fail to detect emerging terms of abuse in online speech.<\/p>\n

So, in setting up our screening system, we wanted to:<\/p>\n

    \n
  • promote staff and student well-being<\/li>\n
  • enhance the reliability and validity of student feedback<\/li>\n
  • improve confidence in the integrity of survey results.<\/li>\n<\/ul>\n

    We developed a method using machine learning and a dictionary of terms to screen for unacceptable student comments. The dictionary was created by QUT drawing on historically identified unacceptable comments and incorporating prior research into abusive and discriminatory terms.<\/p>\n

     <\/p>\n

    \n

    Amen ???? I’ve received many of these in my own “evaluations” – note the rampant misogyny in many of the examples<\/p>\n

    ‘Lose some weight’, ‘stupid old hag’: universities should no longer ask students for anonymous feedback on their teachers https:\/\/t.co\/MBRGaUOW2p<\/a><\/p>\n

    \u2014 Dr Bianca Fileborn, human cat-pillow (@snappyalligator) January 9, 2022<\/a><\/p><\/blockquote>\n