I thought I would reblog this. Partly because I haven’t had a chance to write much recently and it gives me an opportunity to keep things ticking over, partly because it seems like something worth highlighting (although given my readership, this may not help much), and partly because I’ve written about the REF (and been quite critical) and this type of activity is one of the things that I expected to happen and illustrates the issues – in my opinion – with this type of assessment process. I particularly like, and agree with, this comment in the post Whatever this charade is, it is not a framework for research excellence and so I recommend giving this a good read.
Two days ago an open letter from Professor Paolo Palladino, former Head of the History Department at Lancaster University, appeared on the university’s internal History Staff list serve, with copies sent to senior administrators in the Faculty of Arts and Social Sciences (FASS) and Central Administration. I responded the next day with a post supporting Professor Palladino’s position, sent to the same recipients. With Paolo’s permission, I am reproducing both of our letters here. We both believe that the issues raised by Lancaster’s selective culling of research-active staff from submission in the 2014 REF–a practice in which it is not alone among British universities–deserve the widest possible public debate. We would therefore urge anyone who shares our concerns to share this post through social media.
Professor Palladino’s letter:
Over the next few days, a number of colleagues across the university are to be informed that they will not…
Apologies to the few of you who actually read my blog. I’ve been rather ignoring it lately. Anyway, I came across a youtube video recently that I thought I would post here. I initially saw it here. It might have a bit more hyperbole than I would normally use myself, but I thought it quite compelling.
One of the reasons I found it interesting is that I was recently at a meeting where I met and spoke with another physicist who was working (in academia) as a financial modeller. It was an interesting conversation, but what struck me was that they appeared to think only in terms of the stability of the market. The idea being – I think – is that if the market is stable and optimal, then that is best for the economy. The issue that I could see is that there was no obvious link between the market and the real economy on which it was based. Or rather, there seemed to be nothing in the modelling that essentially said, this market is associated with an economy that ideally should be providing employment, products and services for a particular country. Maybe I’m wrong about this and maybe there are good reason why they do model the markets in this way. It does seem as though, typically, we do ignore many important things when deciding on the value of our markets, which is essentially the case being made in the video below.
I guess we should all be reasonably pleased that the science budget has remained ring-fenced. The reality, of course, is that this just means that it is ring-fenced in a flat-cash sense, not in an inflation adjusted sense. As scientists, maybe we should make sure they define the term more specifically in future. It does appear that the current definition would allow the government to claim that something has been ring-fenced, despite the spending power tending to zero. Logically, you mighty expect it to be defined in terms of spending power rather than pounds, but that would require deciding between RPI and CPI, and that is clearly for too difficult.
Anyway, enough cynicism. In truth, we should probably be grateful that the outcome hasn’t been worse. It certainly has been for some and I do feel that the current government has got its basic economic policies completely wrong. It seems like it’s time that someone explained to George Osborne that it’s not necessarily the size of the debt and deficit that matters. What matters is their size relative to the size of our economy. The way its going now it seems like he’s getting it wrong on both counts.
What is maybe more concerning, from a science funding perspective, is the possibility that the government may choose to axe the QR funding. This is the funding stream that comes from the Higher Education Funding Councils and how it is distributed is determined via the outcome of the Research Excellence Framework (REF) exercise. Now, it may well be part of the ring fence and it may well be safe, but I wouldn’t know whether to laugh or cry if it were cut. If you’ve read some of my earlier posts, you’ll know that I’ve been very critical of REF. This is both due to the manner in which it is implemented and due to the shenanigans taking place at UK universities; the potentially risking hiring, the morally/legally questionable redundancies, and the time and effort spent preparing for what is – in my opinion – a completely flawed exercise.
So, if it were to be cut, part of me would feel like saying “serves us right for taking something so silly so seriously, and for playing the kind of games that have not and will not benefit our fundamental role as teachers and researchers”. On the other hand, it is a lot of money (£1.5 billion I believe) and I certainly have no desire to see this money leave the Higher Education sector. As far as I can tell, some may struggle to survive as they are, even if there are no cuts to the QR funding. Well, I certainly hope that it isn’t cut but I also hope that in future, universities will find the backbone to tell the government that playing these kind of games is silly and that they should find a simpler and more effective mechanism for distributing this money (although I don’t think it should simply be given to the research councils, but that might be a topic for another post).
I haven’t been posting much lately as I’ve been busy with other things. I have, however, recently come across this article about the work of Stephan Lewandowsky. He is a cognitive scientist in the School of Experimental Psychology at the University of Bristol. He has published a couple of papers about why some people seem to reject (deny?) many of the findings of climate science. The post that I’m reblogging is reporting on a couple of his papers and suggesting that there is a link between having a libertarian (free-market) ideology and rejecting climate science. If you’ve read any of my other posts, you’ll know I have real issues with the basic tenets of free-market thinking and with those who reject climate science, so this post certainly gels with my thinking and it is interesting that it is based on published work in cognitive science. Doesn’t make it right, I guess, but I would recommend giving it a read.
Just thought I would highlight the San Francisco Declaration on Research Assessment. It’s been a long day and I’m quite tired, so I don’t want to say too much. You can read most of this yourself, but basically a group of editors and publishers of scholarly journals met during the Annual Meeting of The American Society for Cell Biology (ASCB), and have come up with a set of recommendations about the use of journal-based metrics. The basic motivation was
the need to eliminate the use of journal-based metrics, such as Journal Impact Factors, in funding, appointment, and promotion considerations;
the need to assess research on its own merits rather than on the basis of the journal in which the research is published; and
the need to capitalize on the opportunities provided by online publication (such as relaxing unnecessary limits on the number of words, figures, and references in articles, and exploring new indicators of significance and impact).
A lot of it seemed to focus on the use of Journal Impact factors when assessing individual bits of research (which, as many have already pointed out, is horribly flawed) but there was indication that this was attempting to go further than just that. Citation metrics can be useful but can also be problematic. There can be a huge range of different practices even with the same basic area and so using them alone to assess an individual can disadvantage some potentially excellent researchers. It can also be advantageous to some who aren’t particularly good but who just happen to work in an area that is currently popular and in which papers are collecting citations easily.
Anyway, this is an encouraging step and I hope it has some impact and that it’s taken seriously by funding agencies, interview panels and promotion boards. I suspect it’s too late to have much effect on the REF2014 panels, but maybe there’s hope for REF2021.
I haven’t had much chance to write posts recently, although I don’t have much of a following so I suspect not many have actually noticed. I’ve been quite busy with some other things and am also trying to write a talk for a conference next week. My recent post about the integrity of universities did, however, generate a little bit of interest. If you’re interested in that topic can I recommend that you read some of the posts on Richard Hall’s Space. He has a lot of interesting posts about the role of universities and their place in society. The only real criticism I have of his posts is that they are written in a manner that requires quite a lot of concentration. This isn’t necessarily a bad thing, but does mean that I find them quite difficult to understand when I’m perusing them in the evenings after a long day at work.
the need for a disinterested class of intellectuals which acts as a counterweight to prevailing mores.
I have to say that I agree completely with this. It has always surprised me how disinterested UK academics can be. I had always assumed that university academics had a role to play in defining what is acceptable in our societies. They are meant to be the intellectual members of our society; the people who think. If academics are reluctant to be involved in this, then who else is going to do it? This isn’t to say that everyone should bow to the views of academics, simply that academics should feel free to question what is accepted in our societies.
There are probably many reasons why UK academics are reluctant to engage in discussions about our society. One may simply be that academics have become very focused. They see themselves as experts in quite specific areas and so don’t see it as appropriate to engage in areas outside their expertise. There is some merit to this, but it is a bit disappointing – in my opinion. Another may be that there is now quite a lot of pressure on academics. Universities have become very bureaucratic and there is quite a strong publish-or-perish attitude. Academics don’t have much spare time to contemplate the merits – or lack thereof – of our societal mores. Universities have also become much more like businesses. The goal is to maximise teaching and research income and, hence, academics are discouraged from doing anything that doesn’t enhance a university’s ability to generate income.
Personally, I think the latter is the main reason why universities (in the UK) are no longer hotbeds of dissent. We are publicly funded and hence need to do what is expected of us. I’m often very critical, for example, of the Research Excellence Framework (REF2014) and even though most seem to agree, the typical response is “we just have to do this”. Well, yes, but do we have to do it happily. If we think it is damaging what we regard as strengths of the UK Higher Education system, shouldn’t we be making it clear that we’re doing it under duress. There’s also this view that we have to do what is best for UK PLC (i.e., what will best help economic growth in the UK). In a sense, I agree with this. What I disagree with is how we’re influenced to do this. University research has, for many decades, had a very positive impact on economic growth. However, this didn’t happen because politicians told universities to do this. It’s because people recognised the significance of some piece of research and used it to develop something that had economic value. It’s also largely unpredictable. It’s certainly my view that telling us to start predicting the economic benefit of our research will do more harm than good.
The final thing I was going to say regards the main thrust of George Monbiot’s article. If there is increasing evidence that global warming is happening (as there is) and if there is evidence that such warming could lead to life-threatening climate change, shouldn’t the universities where this research is taking place act as though it’s important. Maybe universities shouldn’t be accepting funding from oil companies, if their own research indicates that we should significantly reduce our use of fossil fuels. I have heard some argue that we shouldn’t worry about the provenance of our funding as we’ll typically do good things with whatever money we can get. I think this is naive. The idea that one can take funding from oil companies without being influenced by the source of this funding seems highly unlikely.
We have the solutions to the climate crisis. What is missing to solve the climate crisis is political will. We the people need to tell our elected officials it’s time that polluting industries pay a “dumping” fee, and that we want the money returned to households to help us all make the shift to the clean energy economy of the 21st Century. The price of more delay is economic and human disaster. Our children deserve better.