Assessing the Performance of Your Team

French National Football Team Celebrates Winning the 2018 FIFA World Cup (photo: @FIFAWorldCup)

One day after Bastille Day, the French National Football Team (Équipes de France de Football) emerged as the 2018 FIFA World Cup champions. France defeated Croatia by a score of 4–2 in the Final match on July 15. It was the highest-scoring World Cup Final since England beat West Germany in 1966. Les Bleus (the official name of the French team) won the World Cup once before: 20 years ago when they hosted the tournament on their home soil.

The 2018 French team fielded exceptional players, including midfielder Paul Pogba and the sensational young striker Kylian Mbappé. During the World Cup, Mbappé scored 4 goals in the 7 matches that France played. At just 19 years of age, Mbappé is the second-youngest player to score a goal in a World Cup Final match. (The youngest was Pele, who was 17 when he scored in the 1958 World Cup Final.)

But football — or soccer, as it’s known in the U.S. — is a team sport. A player can only make a shot on goal if the team enables the opportunity. This is well-known by Didier Deschamps, the coach of Les Bleus who was also a player on the French 1998 championship team. Deschamps is only the third man who has won the World Cup as both a player and a coach.

On Deschamps’ coaching, the New York Times made this observation:

His 2018 team will not be remembered as the most elegant champions, or the most creative. Instead, it will be remembered for what it was: a team of exceptional talent and ruthless efficiency, a group in which every player knew his job and performed it flawlessly…

France was not so much great as fundamentally outstanding: a team of top-class talents willing to sublimate their individual games to a collective mission.

Each football squad fields 11 players on the pitch at a given time. The individual positions run the gamut from goalkeeper (100% defense), backfield positions like sweepers and stoppers (mostly defense), midfielders (mixture of offense & defense), and forwards such as wingers and strikers (almost entirely offense). It’s the combination of play from the entire team that determines victory or defeat. As noted in The Telegraph, Deschamps reverted to “a more disciplined and pragmatic approach which meant shackling some of their extraordinary attacking talents” in coaching his squad. Deschamps struck the right balance: coaching both for individual performance as well as overall team results.

It’s crucial for any coach to objectively look at key player stats, focusing on those that are relevant for each position. The official FIFA World Cup website offers a collection of statistics on every player in the tournament:

• Goals (goals scored, penalties scored, etc.)
• Attempts (total attempts, attempts on-target, attempts off-target, shots blocked, shots from free kick, etc.)
• Passing, Crossing & Dribbling (assists, total passes, passes completed, crosses attempted, crosses completed, corners, etc.)
• Defending (tackles, tackles won, lost balls, tackles suffered, recovered balls, clearances, blocks, saves, save rate, goal kicks successfully reaching a teammate)
• Fouls, Offsides & Discipline (red cards, yellow cards, fouls committed, fouls causing penalty, fouls suffered, offsides)

Among these metrics, some categories (Goals, Attempts) are only relevant to players on offense. The metrics in the Defending category are most relevant to midfielders and defensive positions. Passing, Crossing & Dribbling metrics can apply to most positions. And all players can be evaluated against the Fouls, Offsides & Discipline statistics. As an example from Les Bleus, the player stats for Hugo Lloris (goalkeeper) look very different from those of Paul Pogba (midfielder) and also Kylian Mbappé (striker).

Player Metrics Across 3 Very Different Positions

A strong coach will identify and communicate the appropriate measurements with his players — so they can strive for higher levels of performance.

Ultimately the job of any coach is to:

1. Identify the levers of individual performance.
2. Provide the environment and the training to affect these performance levers.
3. Coach & develop each Team Member to operate at their highest level.
4. Educate the entire Team on how their combination of skills inter-operate.
5. Coordinate the performance of the team on the field to achieve their collective purpose.

A coach that accomplishes all of the above is on the path to creating a high-performance team. Effective coaching requires: gathering relevant performance data, identifying the best techniques for each position, and enforcing discipline in the execution of every role. The team may not always enjoy the work of a strong coach, but they will appreciate the results.

Coach Didier Deschamps thrown in the air by Les Bleus. (photo: Thanassis Stavrakis, AP)

Similarly, an Engineering Manager is the coach of the team. Just like a football coach, an Engineering Manager is trying to field the best team based on the roster. Managers should constantly review their team roster, in the following ways:

• recruiting new individuals to fill gaps on their existing team.
• identifying individuals that no longer complement the rest of the team

Simultaneously, an Engineering Manager should coach everyone currently on their roster to greater levels of performance. Growing individuals to the best of their abilities will increase the likelihood of the team achieving its purpose:

Engineering teams are comprised of many different roles, which can take the form of distinct disciplines: Development, QA, Data, Platform, Tooling, Architecture, Ops/DevOps. Just like a football coach, an Engineering Manager should be able to identify metrics that are relevant to each role on their team. Creating a shared understanding of appropriate metrics allows a Manager to coach Engineers to higher-levels of proficiency and responsibility. Engineering Managers should be able to identify data points that can measure the technical expertise, delivery & execution of their team members.

Here’s a non-exhaustive list of metrics that one might consider:

• pull requests merged
• pull requests reviewed
• bugs or support tickets touched
• open source contributions
• delivery of workshops / tech talks / lunch & learns
• test cases authored
• % automated test passing rate
• % committed Epics completed in Quarter
• … and many more, but NOT “lines of code”!

Keep in mind, many factors should determine whether an individual is the right person for your roster. Engineers need to be able to collaborate with their peers while working in the context of the company. Overall team fit should incorporate some (or all) of the following: Business & Domain Knowledge, Technical Expertise, Quality Mindset, Delivery & Execution, Culture & Leadership potential.

Managers need to coach team members both on WHAT they do and HOW they do it:

• “What” Engineers Deliver (Technical Expertise, Delivery & Execution)
• “How” Engineers Deliver (Business & Domain Knowledge, Quality Mindset, Culture & Leadership potential)

A few days prior to the World Cup Final, I had the privilege of participating at Elevate, a summit for Engineering Leaders organized by Plato. In my role as a mentor, I facilitated a workshop titled “Assessing the Performance of Your Engineers” which attracted individuals and managers of varying levels. The conversation was rich, and participants had many motivations for discussing this topic. Here are some of the (paraphrased) questions and ideas that were stated by the group:

• How do I know if an Engineer is ramping-up at an adequate pace?
• How can I determine if an Engineer is underperforming for their level?
• How do I normalize performance ratings across teams? Across levels?
• How do I know if an Engineer is the right fit for my organization?
• One of my Engineers is a prolific coder, but doesn’t consider the impact of his work on other teams. Is that underperformance?
• I want to create a high-performing team, not a collection of individuals that work in silos. How do I measure an Engineer’s impact on making others more productive?
• I’m about to become a manager. How do I evaluate my team members?
• I’m an individual, but interested in what it means to be considered high-performing.
• Communication in a team environment is critical. If a project is going off-the-rails, that information should be shared immediately as it has impacts on the rest of the team (and the company).

Ultimately there’s no single “right answer” on how to assess the performance of your engineers. An Engineer that is thriving in one environment may struggle in another — subject to any of the following factors: stage of company, business domain, size of team, company culture, and overall team composition. Engineering Managers need an analytical approach to performance management and the ability to evaluate the “soft” skills of collaboration, motivation, and culture fit in a dynamic business context. Being the coach of an Engineering team is complicated, but your team (and your CEO) will celebrate your success.

Game on!

Emmanuel Macron celebrating the French Victory (photo: Alexei Nikolsky, TASS)