Project Management in Science

A Perfect Mess (book review)

2/14/2015

A Perfect Mess: The Hidden Benefits of Disorder

I enjoyed this messy assessment of mess versus order. Like so many books like this, it doesn’t offer revelation so much as affirmation through aphorism, with plenty of examples and interviews to back these up.

The book aims to demonstrate that the costs of getting and staying organized can exceed the benefits, mostly through the ongoing efforts required to maintain order, while also outlining the potential benefits of some level of mess. While not advocating complete chaos, the authors do advocate allowing some mess to add character and sense to ones world. The book includes lengthy interviews and case studies, which both reinforce the lessons and take away from the flow of the book, making it much longer than it needs to be (while maybe they didn’t need a professional organizer, a better editor was likely called for here).

For a book advocating mess, there is considerable and worthy time spent on the classification of mess (12 different types, including clutter, mixture, noise and distortion) and the corresponding classifications of neatness, as well as the measures of mess (width, depth, intensity and scale). More interesting are the listed benefits of mess, based on several illuminating examples. Benefits include flexibility (messy systems can adapt to change quickly and effectively whereas organized systems are constrained by the very rules that keep them organized), invention (messy systems can allow unrelated items to align in unusual and inspiring ways that an organized system would never permit), and efficiency (messy systems are less costly than organized ones).

Likely the best example from the book is the deck of cards. Consider one deck kept in order, another shuffled. With each one, find the queen of hearts. Yes, with the ordered one, it would likely be quicker than with the shuffled one. However, the work involved in making and then keeping the deck in order quickly exceeds the time spent looking for the desired card in the shuffled deck. In other words, the work of maintaining order is sometimes not worth it.

Some other take-aways for me:

“…companies that did a lot of strategic planning performed, on average, no better than companies that did less strategic planning.” This makes sense to me, as the number of variables and assumptions required in long term strategic planning significantly outnumber the certainties; the unknowns are greater than the knowns, meaning plans can either never be concrete or are likely doomed to failure. As a former Head of Strategic Planning, I know of what I speak. A related concept covered is the benefit of some purposeful procrastination – put off planning and executing until it is most timely to do so, otherwise you can end up planning and doing more than once, a most inefficient approach (see also pre-crastination and Wait: The Art and Science of Delay, by Frank Portnoy http://www.amazon.ca/Wait-The-Art-Science-Delay/dp/B00B9ZBSPQ). Indeed, most times the pathway to success and discovery can only truly be seen in retrospect.
“Our brains evolved to function in a messy world, and sometimes, when we insist on thinking in neat, orderly ways, we’re really holding back our minds from doing what they do best.” The authors provide examples where the introduction of some random element into a situation led to increased creativity (such as adding a random word to brainstorming, or inviting an outsider into a discussion) and more successful problem solving (as with the manager who introduced smaller changes into her own life, such as taking a different route to work, in order to facilitate adopting larger and more significant changes into her leadership style).
“…in the eighteenth century improvisation was regarded as an integral part of serious music.” A by-product of the globalization of music has been its homogenization. Essentially, Bach and his contemporaries (and most composers who came before) did not meticulously document their compositions for each and every part of the orchestra; rather they allowed for, and in fact required, musicians in all areas to interpret their charts with riffs and improvisation, allowing for greater creativity and the absolute certainty that many of the modern and canonical versions of those works bear little resemblance to what their creators had in mind. The fact that today’s Goldberg Variations will sound the same from Australia to Zurich may be a triumph of organization over mess, but the tragic consequence is the loss of the creativity and ephemeral beauty of such musical creations as they were originally intended.

In essence, a little mess can go a long way. It can facilitate serendipity (somewhat oxymoronic, I know), demonstrate character, and be a more efficient use of time and space. And none of this is anything new. We all know that person who’s desk or home appears messy or cluttered, but they can lay their hands on that necessary paper or book or toy in the blink of an eye. So, order is really in the eye of the beholder – one person’s mess is another person’s system. Whatever works for you.

0 Comments

Responsible Conduct of Research

2/5/2015

0 Comments

A colleague asked me to write about a recent article in the National Post, on the topic of research integrity and the responsible conduct of research. Not being a researcher or a doctor, my opinions and experience are limited to the field in which I work – academic research in various -omics, dipping a toe into translational research in healthcare – and my role therein, as project manager. That role has allowed me to interact with researchers in many areas, as well as with many professors, doctors, institutions, funders, students, contractors and other managers and administrators. And so, what do I think about researchers caught out like the ones profiled above?

First of all, and not in any way to be considered an excuse, the research environment is cutthroat, a pressure cooker, a boiler room: the requirement to get funding and more funding in an increasingly funding-poor environment (don’t get me started on co-funding); the pressure to get data and publications out, generate patents, start companies; the responsibility for staff and facilities. Trying to do good and thoughtful science amidst the noise and chaos.

That science is what they signed up for. Using their brains that are uniquely wired (I mean that in the nicest way) for experimental design, attention to detail, intuition and hypothesis, not financial variance explanations and employee attendance management and contract language about liability and insurance. Yes, there are some exceptions – some excellent scientists who also happen to be good administrators or managers. But I think even those ones have developed management skills because they had to, not because they wanted to, and if they could use their time 100% for research they most likely would.

In today’s world, research is no longer just about science and finding answers. It is also about management and fiscal accountability. The main reason for that is the requirement to be accountable for the public (government and philanthropic) dollars entrusted to researchers and institutions for research; as a donor and a taxpayer, this does make sense to me, as I don’t want to see dollars for public goods being blatantly wasted. (Aside: What the funds support – science or art or other public goods – would not be waste, even if I don’t like or understand the purpose. How projects are selected and funded, through peer review or popularity or other arcane mechanism – perhaps a topic for another time.)

A reason for the increased and increasing scrutiny and accountability is the folks who blatantly waste it. In addition to improper spending, wasting resources in science includes publishing data that is falsified or tainted or in any way not wholly reliable. This is perhaps the worst kind of waste, not only because the funding for that research cannot be recovered (it can’t) but because science functions like a collective, each researcher building on the work that came before them. Subsequent work that may have been excellent is also wasted when it builds on specious data, and so the knock-on effects of fake data or misspent funds (which can call into question the research results, regardless of their soundness) are highly penetrant.

So, what does all this have to do with the role of the project manager? Plenty! The project manager can – and good ones do – enable the project and leaders to meet the requirements of governance, accountability and sound management, while freeing their time and brains to do what they are supposed to do – science. More significantly in this context, they can serve, in a way, as the conscience of the project: asking for justifications and documentation for expenses to compare to funding rules and the project budget; monitoring project activities and redirecting resources back on track as required; tracking and renewing permits and approvals, such as ethics and safety; and facilitating changes so that all stakeholder expectations and requirements are considered and met. You know, management stuff.

This role can sometimes influence the scientific work, too, not by interpreting data or designing experiments, but by analysis of that work through the lens of project management – scope, time, cost, quality and the rest.

Project management and the responsible conduct of research is not about saying yes-or-no to project activities – it can look like that sometimes, but it is more subtle and involved than that. It’s about fully enabling the project to be successful – facilitating the best work possible, with sufficient controls to mitigate the pressure that can lead to fraud or waste or both. While much of the emphasis tends to be on the oversight element, there is an equal measure of facilitation – finding ways for those exciting scientific activities and discoveries to happen within the projects and funding. That facilitation is just as much a part of responsible conduct – the responsibility to contribute to making the best stuff happen, along side the responsibility to mitigate the bad stuff from happening.

Research today must also have a purpose. Commercialization, return on investment, marketability – these are all terms that can seem out of place in the realm of science, but are very much a part of current public funding. Where the answer to “Why?” used to be “to find out”, research now requires an ultimate function, preferably a product that can be sold or an investor who would be interested. This is certainly a desirable outcome when funding of science is presented as an investment, but it is antithetical to the purpose of scientific research, especially if it becomes the driver of the work, which is at it’s core about uncertainty – asking questions we don’t know the answers to and then doing the work to find the answers. By requiring certainty from the start – prioritizing funding and support for work with less risk and/or work where the buyer is already on the line – research and researchers can become blinkered to see only work and results that align with that. This is very much to the detriment of science, where there is nearly as much real value in a failed experiment (which can confirm that your approach or hypothesis is incorrect, an important thing to know) as a successful one (which still requires validation through replication and peer review). Researchers that are immersed in the research-for-commercialization stream can be pressured enormously to “make it work”, potentially resulting in this kind of thing:

http://grants.nih.gov/grants/guide/notice-files/NOT-OD-15-061.html

I have no knowledge of the circumstances of any of these researchers – whether their alleged misconduct was the result of poor management, a pressured environment, blatant malfeasance, or some combination of these. Mistakes happen, people are sometimes bad (lazy, arrogant, greedy), and so waste, fraud and misconduct are always a risk – this is true in any environment. Rules that get put in place in response to fraudulent researchers don’t punish the bad ones – they will figure out ways to be bad no matter what rules are in place. The good ones – the vast majority that are trying to be responsible and “get stuff done” (a quote from one the PIs I work with) – are the ones who pay, through decreased freedom to pursue scientific questions, increased administrative burden, and a minefield of checks-and-balances that can make a honest mistake look like a criminal caper.

I’m very confident that the involvement of a competent, ethical, responsible project manager could have mitigated the risk and waste in these cases; indeed, I see everyday how the work of dedicated project managers both enable and protect researchers, funders and institutions to get stuff done, keeping everyone on the straight-and-narrow with a minimum of fuss. More effort spent on facilitating responsible conduct through good management could reduce the efforts required in trying to catch and punish the bad actors, and the subsequent backlash against the good ones. Good management can also make more good research happen, which is the reason why most of us do this in the first place.

0 Comments