Tech Selection Tips #12: Evaluate Proposals Critically

  • 9-Aug-2017

Reviewing proposals can serve as an illuminating first step as vendors try to address your use cases. But you'll want to give your team adequate time to read and evaluate, enabling your colleagues to pay particular attention to responses on user stories, architecture, and pricing — before undertaking their first downselect decision-making.

Proposals can be exciting to read — all that fantastic modern functionality! — but this task can also become a slog for the team, so you want to do it as efficiently as possible. First, recognize that reading will take time and make sure that selection team members receive a respite from their other duties as part of your overall schedule. A useful tip is to gather the team in a conference room for a day or two to read them together.

When everyone has finished reading, it can be useful for the team to gather over a happy hour or some other social venue to share their impressions informally. The goal here is not to make a formal decision (that comes next), but to share information and impressions in a relaxed, social setting — often helpful lubrication for the sometimes intense discussions to follow during the downselect meeting.

It's all about fit
Your downselect decisions should be driven by trade-offs among the different types of solution "fit" presented by each vendor.

Tips

There's a lot to accomplish here, so below find a longer-than-usual list!

  • Give evaluators "time off" from regular duties to read carefully, perhaps in an offsite location
  • Avoid overly complex scoring methodologies, which are typically quite unscientific
  • Adopt and modify as necessary a basic "SWOT" analysis to fit your organizational culture
  • Schedule sufficient time for a downselect meeting to consider all views
  • The most senior business stakeholder should chair the downselect meeting
  • Gather and collate written feedback in advance of the downselect meeting
  • Work to normalize and compare pricing in advance of the downselect meeting
  • Note, however, that all fees are negotiable and service costs in particular are at best a guesstimate at this stage
  • Make sure that all key stakeholders who evaluated the proposals are represented in the downselect session
  • Agree on a decision-making format in advance (e.g., consensus, voting, etc.)
  • Remember that you are not making the final selection decision, but merely filtering for the next round
  • Also remember that you have only seen words and pictures, and not yet (a more revealing) interactive demo
  • Use the downselect meeting to prepare a recommendation or justification statement to higher governance bodies
  • Gather questions for vendors who have advanced to the next stage to make sure they address them in their demos
  • Re-evaluate scenarios for the demo round: reduce the number and enhance the relevancy based on what you’ve learned

 

Other Posts in This Series

 

Our customers say...

"Setting aside the hype and buzzwords of social media technology, RSG offers a clear, objective and comprehensive review of software products and vendors with a specific focus on their applicability to the enterprise. Before embarking on a collaboration or social media project, this research should be any company's first investment."

Heidi Strom Moon, Director of Marketing, CDG Interactive

Other Enterprise Collaboration & Social Networking posts

New Book Applies Design Thinking to Tech Selection

  • August 2, 2017

Tony and I try to capture how design thinking can lead to better technology selection in a new book, "The Right Way to Select Technology: Get the Real Story on Finding the Best Fit."...

New CRM Evaluation Research

  • June 5, 2017

Customer Relationship Management is increasingly the backbone of MarTech and digital customer engagement. After many requests from RSG subscribers to apply our rigorous evaluation methodology to this marketplace, we decided to add a new vendor evaluation stream...