Our company recently adopted the SAFe framework. One pillar of SAFe’s House of Lean is Relentless Improvement. There are many ways to identify areas to improve – retro, inspect and adapt, iteration review and system demo just to name a few.
Another tool that SAFe provides is Team Self-Assessment.
When I started looking into the tool, I noticed there wasn’t clear direction around how to use it, just a short description of the tool’s purpose. I started to think:
- Does each team member take this and then I average the scores?
- Do we take this together, like sizing, where we all agree on a number?
- Do I want to get a quick snapshot here, or have the team kind of think about each question (with a timebox either way)?
- Am I over thinking this in general?
- How often should this assessment be taken? Once a PI, multiple times? Once every other PI?
I started to do some research on implementation practices and I found an article with great ideas.
- What I liked
- They suggest doing this as a team activity, rather than having people take the assessment and submitting it back to one person
- They used an external facilitator, so the entire team could focus
- They used a planning poker cadence (everyone says their number at the same time) using post-its & time boxing each question
- Also, they used posters to represent each category and placed sticky notes along the axis (see pics in the post)
- Questions that remained
- Does it make sense to do this more often than once a PI?
- How does this work with remote team members?
- How does the scoring work with a poker cadence? Discuss it to meet somewhere or just average the scores?
This article helped me think about implementation, so the team took the assessment last week and here are some more takeaways from our experience.
- We took the assessment after the second of six iterations in our first PI (after ~1 month)
- I originally planned to do this each month, to get a good idea of how the team is working within the PI
- We used Zoom to facilitate discussion (3 remote team members and 3 local team members)
- Everyone had a working webcam
- I shared my screen as we went through the excel sheet, to be transparent and visual
- We spent ~45 minutes going through the entire assessment (keep in mind, this was the first time we did this)
- We counted down 3-2-1 before giving our score using our hands
- We posted individual scores on the webcam using our hands; fist = 0 through five fingers = 5
- I quickly average all the scores and marked them on the excel sheet
- I then asked for any comments, especially at the extremes of scoring
- I tried time boxing discussion 2-5 minutes so we could keep moving
Our Learning Lessons/Feedback
- Some questions were not applicable because we didn’t complete that SAFe event yet or haven’t completed the PI yet
- Example: “Team reliably meets 80-100% of committed PI Objectives’ business value” – we only completed 2 iterations so we couldn’t answer this question
- Some questions seem more like a true/false answer or simplifying the scoring may be needed in the future
- Example: “Team participates in System Demo every two weeks, illustrating real progress towards objectives” & “CI, build and test automation infrastructure is improving” could be true/false answers
- A 0-5 scale is rather large for short questions in this format. It may make sense to modify the scoring scale to simplify the assessment. Maybe 1-3 like The Five Dysfunctions Of A Team assessment (1 = Rarely, 2 = Sometimes, 3 = Always)
- The discussion after the question is more valuable than the actual answers to the questions
- One of my team members made this comment and it was insightful because everyone can interpret the questions a little differently. So discussing the questions after the answers helped everyone think about the question and how the team can improve
Overall, this assessment worked well after the first two iterations. It helped the team take a step back from the day-to-day and think about the bigger picture. Also, I think this tool is useful multiple times per PI, but you need to modify some of the questions. Lastly, I think the next time my team is in-town, following the other blog post about using posters and post-it notes to take the assessment is a great idea that I want to implement.
If you have any questions, suggestions or other experiences, please reach out and let me know!