Development of a method for redundant frame removal in video sequences based on assessment of the black-and-white frames similarity

Video sequences redundant frame removal currently plays an important role in various video preprocessing applications related to video classification, change detection, and object recognition (e.g., defects, faults, human actions, etc.). This paper proposes a video sequence subsampling method based on estimating the similarity of two consecutive black-and white frames using a "sign-sign" correlation function and associativity coefficients, verifying the compliance of the calculated metric values with threshold intervals, and making decisions regarding frame removal. A generalized scheme of the proposed method is considered with a detailed description of the stages, and an algorithm for finding similarities and differences between two consecutive black-and-white frames of video sequences is described. This method reduces the size of video sequences by removing redundant or repeated frames, thereby reducing the amount of stored information and increasing the efficiency of detecting key moments in video images obtained in uncontrolled environments. Research results are presented, demonstrating that the proposed method can halve frame redundancy without losing important information or improving the quality of video sequences.

1. Quality-guided key frames selection from video stream based on object detection / Chen Mingju, Xiaofeng Han, Hua Zhang [et al.] // Journal of Visual Communication and Image Representation. – 2019. – Vol. 65 (24). – Article no. 102678. – DOI 10.1016/j.jvcir.2019.102678.

2. Best frame selection to enhance training step efficiency in video-based human action recognition / A. A. Gharabagh, V. Hajihashemi, M. C. Ferreira [et al.] // Applied Sciences. – 2022. – Vol. 12 (4). – Article No. 1830. – DOI 10.3390/app12041830.

3. Too many frames, not all useful: efficient strategies for long-form video QA / J. Park, K. Ranasinghe, K. Kahatapitiya [et al.] // Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics. – 2024. – P. 3569–3588. – DOI 10.48550/arXiv.2406.09396.

4. Yoon, J. Exploring video frame redundancies for efficient data sampling and annotation in instance segmentation / J. Yoon, M.-K. Choi // IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). – 2023. – P. 3308–3317. – DOI 10.1109/CVPRW59228.2023.00333.

5. Kızıltepe, R. S. A novel keyframe extraction method for video classification using deep neural networks / R. S. Kızıltepe, J. Q. Gan, J. J. Escobar // Neural Computing and Applications. – 2023. – Vol. 35. – P. 24513–24524. – DOI 10.1007/s00521-021-06322-x.

6. Similarity score of two images using different measures / V. Appana, T. M. Guttikonda, D. Shree [et al.] // 6th International Conference on Inventive Computation Technologies (ICICT). – 2021. – P. 741–746. – DOI 10.1109/ICICT50816.2021.9358789.

7. Video key frame extraction based on scale and direction analysis / Y. Dong, Y. Zhang, J. Zhang, X. Zhang // The Journal of Engineering. – 2022. – P. 910–918. – DOI 10.1049/tje2.12173.

8. Usatov, A. A. Assessing similarity between data sets using vector representations / A. A. Usatov, A. M. Nedzved, Guo Jizhan // BSUIR Proceedings. – 2025. – Vol. 23, No. 3. – P. 70–76. – DOI 10.35596/1729-7648-2025-23-3-70-76.

9. Narasimharao, J. Digital image processing / J. Narasimharao. – AGPH Books (Academic Guru Publishing House), 2023. – 201 p. – ISBN 978-93-95468-31-2.

10. Pugachev, V. S. Fundamentals of the statistical theory of automatic systems / V. S. Pugachev, I. E. Kazakov, L. G. Evlanov. – Moscow : Mashinostroenie, 1974. – 400 p.

11. Optimization of distributed database structures in automated control systems / A. G. Mamikonov, V. V. Kulba, S. A. Kosyachenkov, I. A. Uzhastov. – Moscow : Nauka, 1990. – 240 p. – ISBN 5-02-014389-8.