Updates to our WCXM Evaluation Criteria

  • 2-Jul-2012

With the latest major release of our Web Content Management & Experience Management vendor evaluations (version 21!), we updated our criteria to represent evolving customer needs. I think the changes are meaningful and signal where the industry is going.

The charts below show the before-and-after ratings from Version 20 to Version 21 for the same vendor. Want to guess which vendor? Leave a comment below...

Scenario Fit

Scenarios are the most important criteria and definitely changed in Version 21.  We added a new category of "mid-range" scenarios -- where many customers reside today. 

OLD NEW
Old scenarios New Scenarios

Technology Services

Our technology criteria didn't change, but that doesn't mean technology is unimportant, or that vendors have mastered it.  Far from it.  These attributes remain critical differentiators.

OLD NEW
Old Tech Chart Tech old chart

Content Services

Similarly, we made only one minor change to Content Services categories.  None of these are new concepts, but vendors still struggle to execute on them and customers still struggle to master them.  Remember: good experiences start with good content. 

OLD NEW
Content-old Content-New

Site / Experience Services

Not surprisingly, this category saw the most changes.  We broke out mobile as a separate rating, included some specific attributes for digital workplace (a.k.a., intranet) scenarios, and focused more intently on e-marketing services.  In the latter category, however, WCXM vendors remain comparatively weak next to best-of-breed alternatives.

OLD NEW
Site-Old Experience-new

Vendor Intangibles

Vendor intangibles are timeless, and cross all the technology marketplaces we cover.  Our criteria hasn't changed, but you can see that with this vendor, they lost ground in a couple areas.  In other words, vendors do change -- sometimes for better, sometimes (as here) for worse...

OLD NEW
Intangibles-old Intangibles-New

If you've never seen our evaluations before, you can always check out a free sample here.

Our customers say...

"The Web CMS Research was the roadmap for our entire CMS selection process. It truly provided a basis for understanding what we should look for and expect in a CMS. Above all, since we used the report as our guide, we are more than confident in our CMS selection. If we had to go through the process all over again, we'd still rely as heavily on this report as we did the first time."

Michele McDonald, IT Project Manager, University of Oklahoma

Other Web Content & Experience Management posts

The CMS Game of Thrones

  • April 20, 2018

Why did we assign a vendor to a particular character? (And who survives the red wedding?)...

Sitecore versus Episerver

  • March 6, 2018

I sometimes refer to Episerver in shorthand as "a poor man's Sitecore," but as you'll see below, that's a real over-simplification...

There is STILL no such thing as a DXP

  • January 23, 2018

There is no marketplace here, because no enterprise digital leader in her right mind would actually purchase "digital experience" as a platform....