Scorecards offer an easy way to track and evaluate maintenance effectiveness. They give a quick picture of your capability and help you to effectively target areas for improvement. They are also an important tool to help justify obtaining additional resources for your mission to achieve continuous improvement.
But not all scorecards are the same. There are many different kinds of scorecards, each with different levels of detail included. So which scorecard should you use for your organisation?
We are going to compare three different scorecards: Simple, Pyramid, and Full Audit below. But before we look at the selection, here are some questions to ask yourself before you choose which scorecard is right for you, and to help establish parameters around which they will be used.
- How many metrics do I need?
- How long will it take to score?
- What resources are available to score?
- Automated reports
- Self-scored reports
- Manual reports
For most of the scorecards we used at Monsanto, we developed software that extracted the data from SAP so we knew everybody was measuring in the exact same way. Wherever possible the data should be pulled with a push of a button so that scores are calculated in the same way for multiple locations.
- How often will we measure?
- Establish the optimal frequency (weekly, monthly, quarterly or annually) based on the metrics you are measuring.
- Who is my target audience?
- Can the scorecards be rolled up into one score?
- You don’t want to have disjointed reporting from multiple scorecards. Wherever possible it’s best to have a consolidated 10-point or 50-point scorecard with just report one score at the end of it.
Here are three options for scorecards: a simple scorecard, a pyramid and a full audit. Watch the videos below for more in-depth information on each:
1. Simple Scorecards
- Smaller number of metrics
- Usually the metrics you wish to focus on most
- Can be evaluated monthly or quarterly
- Content will change more often than the other methods
- Calculations can be simple or multifaceted
- Usually self-scored and then discussed
- Scoring generally 1 – 10
2. Pyramid Scorecards
- Set of blocks in the form of a pyramid
- Each level adds complexity
- Series of questions behind each block
- Questions are weighted 1 through 4
- Ratings for questions can be partial or all/nothing
- Ratings are usually updated quarterly although in the beginning monthly may work better
- Blocks are colour coded (Green – Yellow – Red) to show status
3. Full Audit Scorecards
- In-depth look at hundreds of metrics
- Usually grouped in categories
- Takes several days to a week to complete
- Generally performed every one to two years
- Scoring is on a point scale. 0 – 1,000 points is typical
- Subsections can be colour coded
This post is based on Kevin Desrosiers’ top-rated presentation at Mainstream Conference 2017. You can watch the video of his full presentation “Choosing Metrics to Achieve Cost Optimisation and World Class Performance.”
About the Author
Kevin Desrosiers is Systems Reliability Team Lead at Monsanto (USA). He has been in Engineering and Maintenance for 35 years: moving from plant engineer to maintenance supervisor to maintenance superintendent to engineering manager, and finally as a corporate strategic asset planning manager. He is a Certified Maintenance and Reliability Professional.