Updates to our WCXM Evaluation Criteria

  • 2-Jul-2012

With the latest major release of our Web Content Management & Experience Management vendor evaluations (version 21!), we updated our criteria to represent evolving customer needs. I think the changes are meaningful and signal where the industry is going.

The charts below show the before-and-after ratings from Version 20 to Version 21 for the same vendor. Want to guess which vendor? Leave a comment below...

Scenario Fit

Scenarios are the most important criteria and definitely changed in Version 21.  We added a new category of "mid-range" scenarios -- where many customers reside today. 

OLD NEW
Old scenarios New Scenarios

Technology Services

Our technology criteria didn't change, but that doesn't mean technology is unimportant, or that vendors have mastered it.  Far from it.  These attributes remain critical differentiators.

OLD NEW
Old Tech Chart Tech old chart

Content Services

Similarly, we made only one minor change to Content Services categories.  None of these are new concepts, but vendors still struggle to execute on them and customers still struggle to master them.  Remember: good experiences start with good content. 

OLD NEW
Content-old Content-New

Site / Experience Services

Not surprisingly, this category saw the most changes.  We broke out mobile as a separate rating, included some specific attributes for digital workplace (a.k.a., intranet) scenarios, and focused more intently on e-marketing services.  In the latter category, however, WCXM vendors remain comparatively weak next to best-of-breed alternatives.

OLD NEW
Site-Old Experience-new

Vendor Intangibles

Vendor intangibles are timeless, and cross all the technology marketplaces we cover.  Our criteria hasn't changed, but you can see that with this vendor, they lost ground in a couple areas.  In other words, vendors do change -- sometimes for better, sometimes (as here) for worse...

OLD NEW
Intangibles-old Intangibles-New

If you've never seen our evaluations before, you can always check out a free sample here.

Our customers say...

"As high-end web consultants, we use a variety of research tools to keep on top of the evolving technology platforms. Among these, Real Story Group is by far the best--a sort of bible for our CMS consulting practice. We've used The Web CMS Research both to get a jump on understanding products in advance of a formal CMS selection, as well as to start the conversation about potential partnerships. It's also great when a client asks you about an obscure product -- and you can get back to them within an hour with a grounded, thoughtful appraisal of the product, knowing that the information is accurate and written by analysts with real perspective."

John Berndt, President and CEO, The Berndt Group, Ltd.

Other Web Content & Experience Management posts

Twenty Years of Web CMS

  • June 22, 2017

My 1996 initiation — with TeamSite, EBT DynaWare, and StoryServer — was pretty brutal....