SmartCrop-H: AI-Based Cropping of Ice Hockey Videos
Authors: 
Mohammad Majidi, 
Mehdi Houshmand Sarkhoosh, Cise Midoglu, Saeed S. Sabet, Tomas Kupka, Dag Johansen, 
P�l HalvorsenAuthors Info & Claims
Mohammad Majidi, Mehdi Houshmand Sarkhoosh, Cise Midoglu, Saeed S. Sabet, Tomas Kupka, Dag Johansen, P�l HalvorsenAuthors Info & ClaimsPages 471 - 477
Abstract
Sports multimedia plays a central role in captivating audiences on social media platforms. However, fast-paced sports such as ice hockey pose unique challenges due to their swift gameplay and the small puck size, making object tracking-based video adaptation for social media a complex task. In this context, we introduce SmartCrop-H, an innovative ice hockey video cropping tool powered by advanced AI models. It excels at tracking the puck and ensuring that crucial gameplay remains the center of attention, regardless of the desired target aspect ratio. The tool combines various techniques including object detection, scene detection, outlier detection, and smoothing, to deliver high-quality ratio-adapted videos. In this demonstration, we showcase SmartCrop-H in real-world scenarios through an intuitive step-by-step Graphical User Interface (GUI) that vividly illustrates how the tool works. The demonstration emphasizes the vital role of AI in enhancing the sports viewing experience, and its importance in the dynamic realm of social media content distribution. A video of the demo can be found here: https://youtu.be/rMmYOCM-k7A.
References
[1]
K. Apostolidis and V. Mezaris. 2021. A fast smart-cropping method and dataset for video retargeting. In Proc. of IEEE ICIP. 2618--2622.
[2]
Backlight. 2023. Cloud-Based video CMS, playout, distribution and app builder. https://www.backlight.co/streaming.
[3]
Brandon Castellano. 2023. SceneDetect. https://github.com/Breakthrough/PySceneDetect/tree/main.
[4]
Rick Cavallaro. 1997. The foxtrax hockey puck tracking system. IEEE computer graphics and applications 17, 2 (1997), 6--12.
[5]
T. Deselaers, P. Dreuw, and H. Ney. 2008. Pan zoom scan - time-coherent trained automatic video cropping. In Proc. of IEEE CVPR. 1--8.
[6]
Sayed Mohammad Majidi Dorcheh, Mehdi Houshmand Sarkhoosh, Cise Midoglu, Saeed Shafiee Sabet, Tomas Kupka, Michael A. Riegler, Dag Johansen, and Pal Halvorsen. 2023. SmartCrop: AI-Based cropping of soccer videos. In Proc. of IEEE ISM.
[7]
Xin Duan. 2011. Automatic determination of puck possession and location in broadcast hockey video. Ph.D. Dissertation. University of british columbia.
[8]
E. Jain, Y. Sheikh, A. Shamir, and J. Hodgins. 2015. Gaze-driven video re-editing. ACM TOG 34, 2 (2015), 1--12.
[9]
Glenn Jocher, Ayush Chaurasia, and Jing Qiu. 2023. Ultralytics YOLOv8. https://github.com/ultralytics/ultralytics
[10]
H. Kaur, S. Kour, and D. Sen. 2019. Video retargeting through spatio-temporal seam carving using kalman filter. IET Image Processing 13, 11 (2019), 1862--1871.
[11]
Swedish Hockey League. 2023. SHL. https://www.shl.se/shl-in-english.
[12]
H.-S. Lee, G. Bae, S.-I. Cho, Y.-H. Kim, and S. Kang. 2019. Smartgrid: video retargeting with spatiotemporal grid optimization. IEEE Access 7 (2019), 127564--127579.
[13]
Muyu Li, Henan Hu, and Hong Yan. 2023. Ice hockey puck tracking through broadcast video. Neurocomputing (2023), 126484.
[14]
F. Liu and M. Gleicher. 2006. Video retargeting: automating pan and scan. In Proc. of ACM MM. 241--250.
[15]
Magnifi. 2023. Automated sports highlights, AI video highlights. https://magnifi.ai/.
[16]
Cise Midoglu, Saeed Shafiee Sabet, Mehdi Houshmand Sarkhoosh, Mohammad Majidi, Sushant Gautam, H�kon Maric Solberg, Tomas Kupka, and P�l Halvorsen. 2024. AI-Based Sports Highlight Generation for Social Media. In Proceedings of the 3rd Mile-High Video Conference on Zzz (MHV '24). Association for Computing Machinery, New York, NY, USA, 7--13. https://doi.org/10.1145/3638036.3640799
[17]
H. Nam, D. Park, and K. Jeon. 2020. Jitter-robust video re-targeting with kalman filter and attention saliency fusion network. In Proc. of IEEE ICIP. 858--862.
[18]
Juha-Pekka Parto. 2021. Ice hockey checking detection from indoor localization data. Master's thesis. Tampere Univeristy, Finland.
[19]
Pendular. 2023. Content generation technology for broadcasters and publishers. https://pendular.io/.
[20]
Hemanth Pidaparthy and James Elder. 2019. Keep your eye on the puck: Automatic hockey videography. In Proc. of IEEE WACV. 1636--1644.
[21]
K.-K. Rachavarapu, M. Kumar, V. Gandhi, and R. Subramanian. 2018. Watch to edit: video retargeting using gaze. Computer Graphics Forum 37 (2018), 205--215.
[22]
Sehar Saleem, Maria Aslam, and Mah Rukh Shaukat. 2021. A review and empirical comparison of univariate outlier detection methods. Pakistan Journal of Statistics 37, 4 (2021).
[23]
Mehdi Houshmand Sarkhoosh, Sayed Mohammad Majidi Dorcheh, Sushant Gautam, Cise Midoglu, Saeed Shafiee Sabet, and P�l Halvorsen. 2023. Soccer on social media. arXiv preprint arXiv:2310.12328 (2023).
[24]
Mehdi Houshmand Sarkhoosh, Dorceh Sayed Mohammad Majidi, Cise Midoglu, Saeed Shafiee Sabet, Tomas Kupka, Michael A. Riegler, Dag Johansen, and Pal Halvorsen. 2024. AI-Based cropping of soccer videos for different social media representations. In Proc. of MMM.
[25]
Zheng Shou, Junting Pan, Jonathan Chan, Kazuyuki Miyazawa, Hassan Mansour, Anthony Vetro, Xavier Giro-i Nieto, and Shih-Fu Chang. 2018. Online detection of action start in untrimmed streaming videos. In Proc. of ECCV. 534--551.
[26]
Robert H Shumway, David S Stoffer, and David S Stoffer. 2000. Time series analysis and its applications. Vol. 3. Springer.
[27]
Tom�s Soucek and Jakub Lokoc. 2020. TransNet V2: an effective deep network architecture for fast shot transition detection. CoRR (2020). arXiv:2008.04838
[28]
Wsc sport. 2023. Wsc sport. https://wsc-sports.com/.
[29]
Kanav Vats, Mehrnaz Fani, David A Clausi, and John Zelek. 2021. Puck localization and multi-task event recognition in broadcast hockey videos. In Proc. of the IEEE/CVF CVPR. 4567--4575.
[30]
Kanav Vats, William McNally, Chris Dulhanty, Zhong Qiu Lin, David A. Clausi, and John Zelek. 2021. PuckNet: Estimating hockey puck location from broadcast video. arXiv:1912.05107 [cs.CV]
[31]
Chien-Yao Wang, Alexey Bochkovskiy, and Hong-Yuan Mark Liao. 2022. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv preprint arXiv:2207.02696 (2022).
[32]
S. Wang, Z. Tang, W. Dong, and J. Yao. 2020. Multi-operator video retargeting method based on improved seam carving. In Proc. of IEEE ITOEC. 1609--1614.
[33]
Mehmet Yakut and Nasser Kehtarnavaz. 2016. Ice-hockey puck detection and tracking for video highlighting. Signal, Image and Video Processing 10 (2016), 527--533.
[34]
Xionghao Yang. 2021. Where is the puck? Tiny and fast-moving object detection in videos.
Index Terms
- SmartCrop-H: AI-Based Cropping of Ice Hockey Videos
Recommendations
Multimodal AI-Based Summarization and Storytelling for Soccer on Social Media
MMSys '24: Proceedings of the 15th ACM Multimedia Systems ConferenceThe rapid advancement of technology has been revolutionizing the field of sports media, where there is a growing need for sophisticated data processing methods. Current methodologies for extracting information from soccer broadcast videos to generate ...
AI-Based Sports Highlight Generation for Social Media
MHV '24: Proceedings of the 3rd Mile-High Video ConferenceSocial media plays a significant role for sports organizations with millions of active fans, but publishing highlights is often a tedious manual operation. With the development of AI, new tools are available for content generation and personalization to ...
AI-Based Cropping of�Soccer Videos for�Different Social Media Representations
MultiMedia ModelingAbstractThe process of re-publishing soccer videos on social media often involves labor-intensive and tedious manual adjustments, particularly when altering aspect ratios while trying to maintain key visual elements. To address this issue, we have ...
Comments
Information & Contributors
Information
Published In
April 2024
557 pages
ISBN:9798400704123
DOI:10.1145/3625468
Copyright � 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 17 April 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
MMSys '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 176 of 530 submissions, 33%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 45Total Downloads
- Downloads (Last 12 months)45
- Downloads (Last 6 weeks)4
Reflects downloads up to 21 Oct 2024
Other Metrics
Citations
Cited By
View allView Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in