…“The process of using this interface for analysis is unnecessarily maddening and a severe obstruction to the task”..
Does Ben Goldacre really believe that a multi-billion dollar corporation like GSK can’t provide an easier, more technologically advanced, and productive route- for researchers to access their data?
GSK are taking the absolute piss out of Alltrials, the BMJ, the entire scientific and medical community, and the public at large, with their ‘transparency charade’ but most of all they are harming patients -and that is utterly indefensible… the system GSK have in place is obviously a deliberate attempt to block researchers gathering data properly…
…as a member of the RIAT team who was granted access to the Data from Paxil Study 329 to do an independent reanalysis by GSK, we’ve now had months of experience working with their “remote desktop” interface as a portal to their information. It is a single windowed multiple document interface, totally self contained that can’t be accessed by any software other than that provided inside the window. Multiple passwords are required multiple times for access, and on some days, one is frequently thrown from the system without warning, necessitating repeated logins. There’s another internal window from SAS that contains the data and allows one to run SAS programs to analyze the data. The data is also provided as text-based CSV files that can be moved outside the internal SAS window and displayed in spreadsheets [Open Office is provided]. The open source statistical program, “R” is also provided. In our case having no-one fluent in SAS procedures and programming, we are using “R” which has the necessary statistical functions. Getting the data into the proper format required by “R” means using multiple spreadsheets – which is very difficult in the cramped space provided – sometimes taking days and involving many “start-overs.” Once the data is analyzed, one can only export non-data containing files with results, and that’s only by application for approval. Using the primitive graphing functions of Open Office or “R’ in the “remote desktop” is very difficult and the graphs can’t be exported. That finally lead us to copy the information for the graphs by hand to get it into the computer proper to create our images. The process of using this interface for analysis is unnecessarily maddening and a severe obstruction to the task.
The original hand written CRFs are provided as PDF documents. In our case, there are some 275 subjects, many with several pdfs, each pdf containing 200+pages. In the interface provided, we can see only one page at a time of the nearly 60,000 pages. Tallying the adverse events from the pdfs is hard enough work, but doing to without being able to make printed copies and referring back and forth is a double nightmare, requiring days of wasted time, and delegation is impossible. Working inside of this little window brings home how important it is to have a workspace that allows simultaneous display of lots of information, and this isn’t it. One of our team has lost one assistant already over this interface. The EMA’s decision to even consider using this kind of interface is at best, ill advised, and a negation of the initial promise of Data Transparency. If I weren’t retired and instead had a job to do, I don’t think I could do it. If I were a graduate student given the task, I might go to the chairman of the department and ask for another major professor. It’s impossible to imagine that anyone contemplating this decision who knows the ins and outs of data analysis has tried it out in this kind of environment. As I said before, it’s like going to sea to see the world in a submarine, looking through a periscope.
Following up from my post yesterday, titled ‘Ben Goldacre: Wake The Fuck Up” concerning David Healy’s article on his blog titled ‘Fucked’, I think it might be timely to post Iain Chalmers article in the JRSM from 2006, titled :
“From optimism to disillusion about commitment to transparency in the medico-industrial complex”