ROI calculations are a joke

  • 8-Feb-2010

Our colleagues over at Forrester recently undertook some interesting research regarding content management investment attitudes in 2010 (DM, RM and WCM).  The overall finding was along the lines one might expect, "72% of respondents intend to expand their use of ECM technologies"... but there was an intriguing second key conclusion in the report: "49% could not estimate the ROI for any of their ECM systems."

Let me state my take on ROI calculations as clearly as I can. ROI calculations for information technology are junk calculations, a fraud, a nonsense, and a complete waste of time. Clear enough for you? Oh and by the way, ROI calculations from software vendors are even worse...

ROI assessments are based on the simplistic formula of benefits minus costs to calculate the return on your investment. But simple is not always smart, and most if not all the of the benefits in such calculations are by nature predictive. In other words they are guesses, and in my experience, almost always overly optimistic -- and fatuous guesses at that.

There is a cost to any new system, and there is also always a return (sometimes a good one, sometimes bad, often a bit of both) from the system. Far better and more honest I believe to just build a valid business case that details these costs and potential returns, and utilize more concrete and verifiable calculations such as TCO (Total Cost of Ownership) or CDB (Cost of Doing Business). That way you have a business case that details the investment and what you hope and expect to achieve as a result, and at least have a business case based on facts. One that when it strays into the predictive (as it must at times) is clear about its limitations and values.

The industry analyst guru's guru, Paul Strassman, has written extensively on this topic. For those who want to know more about the pointlessness of ROI calculations, I highly recommend you read Paul's bestselling book, "The Squandered Computer", a work that IMHO should be on the required reading list for any IT or Business related degree course.

But to return to the Forrester research findings, I would respectfully argue that they asked the wrong question.  For rather than asking buyers of content technologies whether they can build a valid ROI for new investments, they could have been asked whether they believed new investments in content technology would deliver worthwhile benefits. The results from that would have been very interesting indeed, and I suspect quite different from the question that was asked.

Just like writing an RFP, developing a solid business case can be detailed and tricky work - and it is work that we help our advisory clients with on a daily basis. But in essence it is the core purpose of our work: we help buyers make the right and best technology investments possible. Yet over the years I have seen so many nonsensical ROI calculations, so many works of fiction claiming to be business cases, and so many buyers misled by farcical ROI calculations, that the very sight of those three letters is enough to make my blood boil...

Our customers say...

"The analysis of the current technology vendors and products is very comprehensive and it provides an excellent guide for potential purchasers to frame their functional, architectural and usability benchmarks."

Len Asprey, Director, Practical Information Management Solutions, and, Author, Integrative Document and Content Management

Other ECM & Cloud File Sharing posts

Thanks for the Book Reviews!

  • September 18, 2017

We wanted to take a moment to say a special thank you to a few people who took the time to write extended reviews of the book....

Apply Design Thinking to Technology Selection

  • September 12, 2017

Digital teams should replace outdated, waterfall-based approaches to selection with a more agile, adaptive process better suited to modern enterprise environments...

New Book Applies Design Thinking to Tech Selection

  • August 2, 2017

Tony and I try to capture how design thinking can lead to better technology selection in a new book, "The Right Way to Select Technology: Get the Real Story on Finding the Best Fit."...