We use "appraise" instead of "evaluate" or "measure" to emphasize that in considering supplier performance, we ultimately measure the value they deliver to our organization. We review practices which we have found of value below.

Supplier performance is tracked on an engagement level and reported overall on a monthly basis as part of our ongoing governance process. There is an additional aspect to performance, however, looking at which relationships are expanding, contracting, or are stable; Client customer satisfaction with the supplier's staff and services; how our suppliers compare to each other at the end of the day. We will be discussing both current activities and ones in development.

Qualitative measures offer the greatest insight to strategic supplier performance. From our presentation. © PJV

Relationship summary

We recommend a periodic revew and documentation of the current state of key supplier relationships. Most of this information would be provided by suppliers in their monthly governance reporting deck:

  • Relationship duration
  • Current $ volume
  • Current headcount
  • Relationship status — growing? shrinking? risks? etc.
  • Supplier type — "Tier 1"? Specialty?
  • Services being delivered — range of in-progress engagements currently in progress
  • Delivery locations— staff and equipment locations
  • Contract type — summary of MSA, SOWs
  • RFP Bid:Win:Loss — history of bids and losses on prior opportunitie
  • Customer satisfaction survey — last survey results, scores, and trend
  • Management asessment — strengths and weaknesses, client and supplier actions which can strengthen relationship

Customer satisfaction survey

Surveying customer satisfaction is vital to understanding the value of a supplier relationship. All major suppliers conduct surveys, minimally of client management annually. This is helpful for the suppliers, however, there is marginal value to the client as each supplier survey is different.

Our approach is to work with all key suppliers to adopt a common consolidated customer survey:

  • Ideally, suppliers adopt the sourcing survey in place of their own. In return, sourcing administers the survey process, collates and scores the responses, and maps the scale, scores, and questions to the supplier's if requested. While this is generally not possible for senior management surveys—typically conducted by third parties for a supplier, does address engagement surveys. In the closest client-supplier relationships, suppliers may elect to incorporate the client survey into their own performance tracking and employee reward processes.
  • A common set of questions and a common process across suppliers allows the client to compare performance across suppliers. This helps in assessing the value delivered across suppliers and informs decisions on potential reallocations of work.
  • A single standardized survey also provides a venue for supplier competition other than cost. Our experience is that suppliers are always eager to find out where they stand regarding their competition.

We have also found that annual surveys do not provide timely-enough information and suggest conducting them semi-annually. All basic areas should be covered:

  • Meeting commitments
  • Quality of communications
  • Quality of services — Applications
  • Quality of services — BPO and Help Desk
  • Quality of services — Infrastructure management
  • General service competency
  • Overall service

Reporting should include breakdowns regarding ranges and trends of responses and history.

Engagement scorecards

For key engagements, we recommend a short bi-monthly scorecard to be completed by both client (customer rating) and supplier (self-assessment). This is another early warning system for any engagement issues, and is particularly valuable in identifying any "disconnects" between the supplier's perception of their performance versus the client's. A sample scorecard, including supplier and client scoring on a simple Fails/Meet/Exceeds scale:

Project executionDescriptionSupplier F/M/EClient F/M/E
Project Scope ManagementAbility to clearly define scope throughout project lifecycle, setting the right expectations, managing scope creep, and so forth.  
Change managementFlexibility to adapt to changing user requirements. Prioritization and management of change requests.  
CommunicationAbility to clearly communicate risks, regular status updates.  
Quality and timelinessDescriptionSupplier F/M/EClient F/M/E
Compliance with user requirementsAccuracy of deliverables versus stated requirements. Percentage of requirements addressed in deliverables.  
Defects and remediationNumber of defects reported in deliverables, time to remedy.  
Defect severityDeliverables quality as measured by defect severity and effort to remedy.  
Compliance with committed timelinesDeadlines missed as percentage of total.  
Utilization and productivityDescriptionSupplier F/M/EClient F/M/E
ProductivityTeam productivity for a relevant unit of work, as appropriate.  
Resource utilization% utilized versus % available.  
ResourcesDescriptionSupplier F/M/EClient F/M/E
Quality of resourcesF/M/E[1] qualitative "Fails/Meets/Exceeds" score.  
Time to fill open positionsAverage time to fill vacant positions.  
Average attrition rate and time to transition% and time until replacement resources achieved expected productivity levels.  
Added valueDescriptionSupplier F/M/EClient F/M/E
InnovationsTechnical innovations with regard to architecture and methodologies.  
Process improvementsProcess improvements positively impacting deliverables.  
Other improvementsFor example, productivity.  

Supplier satisfaction survey

One of the key factors in a successful supplier-Client relationship is the degree to which the partnership is truly reciprocal. We advocate clients preiodically conduct a "supplier view of client" survey. As an ombudsman for the success of supplier engagements, such a survey can be an important tool in uncovering and addressing client process issues.

Key performance metrics

Our experience is that a robust qualitative survey across all suppliers provides the most value—particularly as an early warning system for developing issues before they materially, adversely, affect an engagement.

There are, however, metrics outside those tracked by project management which can offer additional insights into engagement health. One such example is effort utilization, which is effort divided by available hours. If low, it may indicate resource productivity or availability issues. If high—over 100$—then the supplier is assigning shadow resources or investing additional resources. Over an extended period, or if significantly over 100%, this may signal the engagement is in trouble.

We discuss metrics further here.

Supplier scorecards

Suppliers generally provide summaries of relationship health based on their own methodologies and reporting priorities. These can be particularly valuable in surfacing any client issues for sourcing follow-up.

Site contents copyright © 2018, P. Vecrumba. All Rights Reserved. Wikipedia™ and external site links are provided for convenience and do not constitute endorsement of, affiliation with, or responsibility for such content. Please Email us at contact@itsourcers.com with comments, questions, suggestions, or issues.

We do not use cookies and do not track users.