Developments in Judging

Para Equestrian Dressage Judge General Marco Orsini's began the session with a comprehensive overview of the evolution of Judging practices in the sport. He emphasised that Judging has been a key topic of discussion since Dressage became an Olympic discipline in 1912.

He also noted that the Judging system had undergone various systems throughout the years including varying numbers of Judges — sometimes three, five, or seven — who either sat together or separately.

In some instances, the highest and lowest scores were discarded, final results were determined based on the rankings of each Judge rather than the cumulative points awarded for each movement. Penalties were imposed for timing discrepancies, either for performing the test too quickly or too slowly, and errors such as counting too many or too few steps resulted in penalties. Some of these practices occasionally led to unpredictable outcomes, with final results sometimes only being made available after a two-day delay.

Over time, there has been a shift towards more transparent and understandable Judging processes. Today’s Judging framework strives for clarity and consistency, supported by extensive education and training for Judges at all levels. FEI Para Dressage Judges come from diverse backgrounds, and have competitive riding and national Judging experience, as well as comprehensive FEI education.

This education includes the Competency-based Evaluation System (CES), which provides a yearly online test on rule changes and fundamental knowledge that Judges must complete annually. Additionally, Judges are required to attend maintenance courses every three years, available both online and in-person, to ensure they remain up to date with the latest developments in the sport.

Orsini noted how scoring standards have shifted over time, with increased appreciation and more rewarding marks for quality performances.

He acknowledged the role of advanced systems like Global Dressage Analytics (GDA) and the Judges Supervisory Panel (JSP) in ensuring consistency – particularly at the Paralympic Games, by addressing score differences of 6% or more – while also supporting Judges through self-evaluation and constructive feedback.

Furthermore, the introduction of open scoring and paperless judging systems, such as those developed by BlackHorseOne and Equipe, allows athletes immediate access to individual marks and Judges' comments after each performance, further promoting transparency and accountability. At many Events, including Championships and CPEDIs, Judges engage in post-competition discussions to critically reflect on their performance and discuss potential improvements.

However, despite these advancements, Orsini noted that significant differences still exist in Judging, with potential explanations including varying seating positions, unconscious biases, and differences in cognitive skills among Judges. These factors can contribute to inconsistencies in the evaluation of performances, highlighting the need for continuous improvements in the Judging process.

A key challenge discussed was the inconsistency in judging the walk, particularly in Grade I tests, where differing interpretations have led to scoring discrepancies. Orsini stressed the importance of ongoing dialogue and education between Judges, trainers, and riders to align expectations and improve performance evaluation.

Looking towards the future, Orsini introduced the idea that Artificial Intelligence (AI) could play a crucial role in further enhancing the Judging process.

AI has the potential to support Judges by providing 360-degree 3D computer-generated data to assess performances from multiple angles. This technology could assist in both the Judging process itself and in training new Judges, enabling them to better understand nuances in performances.

Furthermore, AI could offer innovative ways to enrich the fan experience, allowing audiences to enjoy new viewing formats and interactive content. Eye tracking technology is also being explored as an educational tool, particularly for less experienced Judges, helping them to focus on key aspects of performance and improve their decision-making skills.

Throughout his presentation Orsini emphasised the importance of balancing tradition with innovation. He highlighted the need to uphold core principles such as the training scale, classical riding, and horse welfare, while adapting to evolving technologies and conditions.

During the discussion session, concerns were raised about the time frame of the FEI's Competency-based Evaluation System (CES), which ensures that officials are properly certified before events. While the system protects the integrity of the sport, organisers expressed frustration over delays in schedule approvals due to Officials having to complete the test before being appointed. Improved communication between all stakeholders was identified as a key solution.

Presenter
♦ Marco Orsini, FEI Para Dressage Judge General