{"id":70729,"date":"2023-11-15T23:28:28","date_gmt":"2023-11-16T04:28:28","guid":{"rendered":"https:\/\/world.edu\/?p=70729"},"modified":"2023-11-15T23:28:28","modified_gmt":"2023-11-16T04:28:28","slug":"you-only-assess-what-you-care-about-a-new-report-looks-at-how-we-assess-research-in-australia","status":"publish","type":"post","link":"https:\/\/world.edu\/you-only-assess-what-you-care-about-a-new-report-looks-at-how-we-assess-research-in-australia\/","title":{"rendered":"\u2018You only assess what you care about\u2019: a new report looks at how we assess research in Australia"},"content":{"rendered":"

\"\"
\nResearch plays a pivotal role in society. Through research, we gain new understandings, test theories and make discoveries.<\/p>\n

It also has a huge economic value. In 2021, the\u00a0CSIRO found<\/a>\u00a0every A$1 of research and development investment in Australia creates an average of $3.50 in economy-wide benefits.<\/p>\n

But how do we know if individual research projects being conducted in Australia are good quality? How is research recognised? The key way this happens is through \u201cresearch assessment\u201d.<\/p>\n

What is research assessment?<\/strong><\/h4>\n

Research assessment is not a centralised or necessarily formal process. It can involve various processes and measures to evaluate the performance of individual researchers and research institutions. This includes assessing the quality, excellence and impact of various outputs.<\/p>\n

Research assessment can be qualitative or quantitative. It can include publications in journals and the number of people who cite the research, gaining grants to do further research, commercialisation, media engagement and impact on decision-making or public policy, prizes and invitations to speak at conferences.<\/p>\n

If research assessment is working fairly and effectively, it should achieve several things. This includes: helping to develop researchers\u2019 careers, making sure innovative research does not get avoided in favour of short-term gains and helping funders and the community have confidence research is providing value for money and adding to the public good.<\/p>\n

Our project<\/strong><\/h4>\n

Our new project aimed to provide a better understanding of how research assessment affects research in Australia.<\/p>\n

In a\u00a0report released today<\/a>, we surveyed more than 1,000 Australian researchers and more than 50 research organisations.<\/p>\n

This included universities, research institutes, industry bodies, government and not-for-profit organisations. The majority of researchers (74%) were in academic roles. Across those research sectors, we also conducted 11 roundtables involving around 120 people and 25 intensive interviews to understand the issues.<\/p>\n

This work was commissioned by Chief Scientist Cathy Foley and conducted by the Australian Council of Learned Academies (involving the academies of science, medical science, engineering and technological sciences, social sciences and humanities).<\/p>\n

It also comes as the\u00a0Universities Accord review<\/a>\u00a0examines how research is funded and approached within higher education.<\/p>\n

What we found<\/strong><\/h4>\n

We found some difficulties with the current approach to research assessment.<\/p>\n

We heard there is a tendency by some researchers to \u201cplay it safe\u201d in terms of doing research they believe will score well. We also heard how the assessment process can unintentionally exclude or devalue particular forms of knowledge, particularly in the humanities and the social sciences, where outputs can be less easily quantified or less immediately seen.<\/p>\n

As one interviewee said:<\/p>\n

What is assessed and how it is assessed are an indication of what the organisation values. You only assess what you care about. Values and culture drive assessment.<\/p><\/blockquote>\n

Our roundtables told us senior staff and supervisors are often seen to reinforce the culture of \u201cpublish or perish\u201d, with the number of articles being valued more highly than the quality.<\/p>\n

We heard early and mid-career researchers and people from underrepresented backgrounds can have difficulties trying to \u201cplay the game\u201d to advance their careers. For example, early-career researchers are often expected to produce work that benefits their larger team, at a cost to their own capacity for promotion.<\/p>\n

As one interviewee noted:<\/p>\n

Metrics are essential for defining value and comparative difference, but Australia requires a modern and fair framework for assessing our current and next generation of researchers.<\/p><\/blockquote>\n

Survey results<\/strong><\/h4>\n

Our survey found a high level of dissatisfaction with the state of research assessment. This included:<\/p>\n