Paper for CVSports @ CVPR 2023 accepted
The paper with the title "All Keypoints You Need: Detecting Arbitrary Keypoints on the Body of Triple, High, and Long Jump Athletes" by Katja Ludwig, Julian Lorenz, Robin Schön and Rainer Lienhart is accepted at the 9th International Workshop on Computer Vision in Sports (CVsports) at CVPR 2023. In this paper, the authors detect arbitrary keypoints on the body of triple, high, and long jump athletes by extending previous methods with detections on the hands, feet, heads, elbows, and knees. Different representations regarding the head and the network input are evaluated in the paper. Performance analyses based on videos are commonly used by coaches of athletes in various sports disciplines. In individual sports, these analyses mainly comprise the body posture. This paper focuses on the disciplines of triple, high, and long jump, which require fine-grained locations of the athlete's body. Typical human pose estimation datasets provide only a very limited set of keypoints, which is not sufficient in this case. Therefore, we propose a method to detect arbitrary keypoints on the whole body of the athlete by leveraging the limited set of annotated keypoints and auto-generated segmentation masks of body parts. Evaluations show that our model is capable of detecting keypoints on the head, torso, hands, feet, arms, and legs, including also bent elbows and knees. We analyze and compare different techniques to encode desired keypoints as the model's input and their embedding for the Transformer backbone. Katja Ludwig, Julian Lorenz, Robin Schön and Rainer Lienhart. 2023. All keypoints you need: detecting arbitrary keypoints on the body of triple, high, and long jump athletes. In 2023 IEEE/CVF International Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), June 17 2023 to June 24 2023, Vancouver, BC, Canada. IEEE, Piscataway, NJ, 5179-5187 DOI: 10.1109/CVPRW59228.2023.00546
Abstract
Reference
PDF | BibTeX | RIS | DOI