We propose a Generate-then-Retrieve framework for badminton rally videos, which enables users to search for videos using high-level tactical queries. In the first stage, game logs, such as shuttle trajectories and player positions, are extracted from the videos. A tactical debate team, consisting of multiple agents, analyzes player intentions and tactics based on these logs to transform the videos into tactical narratives. In the second stage, rally videos are retrieved by comparing user queries with the generated narratives.
Queries focused on identifying specific rally attributes, simple actions, or distinct events.
Query: Identify the rallies where the point is won with a drop shot at the end.
Query: Identify the rallies where both players only hit drive shots, with no drop shots or smashes.
Queries demanding the understanding of temporal sequences or causal relations between events.
Query: Identify the rallies where an attack is set up through net shots and eventually ends with a smash winning the point.
Query: Find rallies where a lob from the front court pushes the opponent deep into the backcourt, followed by an aggressive smash resulting in an out-of-bounds error.
Complex queries requiring the deduction of abstract intents or deep tactical performance analysis.
Query: Instances of losing a rally due to a shallow defensive clear from the rear court that fails to disrupt the opponent's attacking rhythm, allowing them to execute a decisive wrist smash.
Query: Identify rallies where the player defends first and then turns to offense to win the point.