From Alignment to Reason: Multi-Agent Debate for Tactical Badminton Video Retrieval

National Yang Ming Chiao Tung University

Methodology Framework

We propose a Generate-then-Retrieve framework for badminton rally videos, which enables users to search for videos using high-level tactical queries. In the first stage, game logs, such as shuttle trajectories and player positions, are extracted from the videos. A tactical debate team, consisting of multiple agents, analyzes player intentions and tactics based on these logs to transform the videos into tactical narratives. In the second stage, rally videos are retrieved by comparing user queries with the generated narratives.

Methodology Framework Overview

Retrieval Results

Category 1: Factual Queries

Queries focused on identifying specific rally attributes, simple actions, or distinct events.

Specific Event

Query: Identify the rallies where the point is won with a drop shot at the end.

Rally Attribute

Query: Identify the rallies where both players only hit drive shots, with no drop shots or smashes.


Category 2: Relational Queries

Queries demanding the understanding of temporal sequences or causal relations between events.

Temporal Sequence

Query: Identify the rallies where an attack is set up through net shots and eventually ends with a smash winning the point.

Causal Relation

Query: Find rallies where a lob from the front court pushes the opponent deep into the backcourt, followed by an aggressive smash resulting in an out-of-bounds error.


Category 3: Strategic Reasoning Queries

Complex queries requiring the deduction of abstract intents or deep tactical performance analysis.

Performance Analysis

Query: Instances of losing a rally due to a shallow defensive clear from the rear court that fails to disrupt the opponent's attacking rhythm, allowing them to execute a decisive wrist smash.

Abstract Intent

Query: Identify rallies where the player defends first and then turns to offense to win the point.