Deep Features and Clustering Based Keyframes Selection with Security

Authors

  • Prachi Chauhan Govind Ballabh Pant University of Agriculture and Technology, Pantnagar, Uttarakhand, India
  • Hardwari Lal Mandoria Govind Ballabh Pant University of Agriculture and Technology, Pantnagar, Uttarakhand, India
  • Alok Negi School of Business, UPES, Dehradun, Uttarakhand, India

DOI:

https://doi.org/10.23755/rm.v48i0.1139

Keywords:

Clustering, Color Histogram, General Linear Group, Image Encryption and Decryption, Inception-V3, Video Summarization

Abstract

The digital world is developing more quickly than ever. Multimedia processing and distribution, however become vulnerable issues due to the enormous quantity and significance of vital information. Therefore, extensive technologies and algorithms are required for the safe transmission of messages, images, and video files. This paper proposes a secure framework by acute integration of video summarization and image encryption. Three parts comprise the proposed cryptosystem framework. The informative frames are first extracted using an efficient and lightweight technique that make use of the color histogram-clustering (RGB-HSV) approach's processing capabilities. Each frame of a video is represented by deep features, which are based on an enhanced pre-trained Inception-v3 network. After that summary is obtain using the K-means optimal clustering algorithm. The representative keyframes then extracted using the clusters highest possible entropy nodes. Experimental validation on two well-known standard datasets demonstrates the proposed methods superiority to numerous state-of-the-art approaches. Finally, the proposed framework performs an efficient image encryption and decryption algorithm by employing a general linear group function GLn (F). The analysis and testing outcomes prove the superiority of the proposed adaptive RSA.

Author Biographies

  • Prachi Chauhan, Govind Ballabh Pant University of Agriculture and Technology, Pantnagar, Uttarakhand, India

    Prachi Chauhan is a research scholar in Department of Information Technology, Govind Ballabh Pant University of Agriculture and Technology, Pantnagar, Uttarakhand, India. She has published some research papers in International Journals and conferences. Her research area is Information Security, Machine Learning, Multimedia Retrieval, Multimedia Security.

  • Hardwari Lal Mandoria, Govind Ballabh Pant University of Agriculture and Technology, Pantnagar, Uttarakhand, India

    Hardwari Lal Mandoria is Professor in Department of Information Technology, Govind Ballabh Pant University of Agriculture and Technology, Pantnagar, Uttarakhand, India. He has published more than 70 research papers in International Journals and conferences. His research area is Computer Network, Information Security and Cyber Security. He has guided more than 20 M.Tech students and presently three Ph.D scholars pursuing their Ph.D.

  • Alok Negi, School of Business, UPES, Dehradun, Uttarakhand, India

    Alok Negi is Assistant Professor in School of Business, UPES, Dehradun, Uttarakhand, India and  pursuing his Ph.D. (CSE) at NIT, Uttarakhand, India. His current research interests include Image processing, Computer Vision, evolutionary algorithms, and Deep Learning.

References

M. Ahmed, R. Seraj, and S. M. S. Islam. The k-means algorithm: A comprehensive survey and performance evaluation. Electronics, 9(8):1295, 2020. F. Alamdar and M. Keyvanpour. A new color feature extraction method based on quadhistogram. Procedia Environmental Sciences, 10:777–783, 2011.

M. Avi-Aharon, A. Arbelle, and T. R. Raviv. Deephist: Differentiable joint and color histogram layers for image-to-image translation. arXiv preprint arXiv:2005.03995, 2020.

S. Cheng, L. Wang, N. Ao, and Q. Han. A selective video encryption scheme based on coding characteristics. Symmetry, 12(3):332, 2020.

R. da Silva Torres and A. X. Falcao. Content-based image retrieval: theory and applications. RITA, 13(2):161–185, 2006.

Y. Ding, G. Wu, D. Chen, N. Zhang, L. Gong, M. Cao, and Z. Qin. Deepedn: a deep-learning-based image encryption and decryption network for internet of medical things. IEEE Internet of Things Journal, 8(3):1504–1518, 2020.

P. Gaherwar, S. Joshi, R. Joshi, and R. Khengare. Sisa: Securing images by selective alteration. In Information and Communication Technology for Competitive Strategies (ICTCS 2020), pages 729–740. Springer, 2022.

M. Gygli. Ridiculously fast shot boundary detection with fully convolutional neural networks. In 2018 International conference on content-based multimedia indexing (CBMI), pages 1–4. IEEE, 2018.

M. Gygli, H. Grabner, H. Riemenschneider, and L. V. Gool. Creating summaries from user videos. In European conference on computer vision, pages 505–520. Springer, 2014.

R. Hamza, A. Hassan, T. Huang, L. Ke, and H. Yan. An efficient cryptosystem for video surveillance in the internet of things environment. Complexity, 2019, 2019.

C. Huang and H. Wang. A novel key-frames selection framework for comprehensive video summarization. IEEE Transactions on Circuits and Systems for Video Technology, 30(2):577–589, 2019.

Z. Ji, K. Xiong, Y. Pang, and X. Li. Video summarization with attention-based encoder– decoder networks. IEEE Transactions on Circuits and Systems for Video Technology, 30(6):1709–1717, 2019.

M. Z. Khan, S. Jabeen, S. ul Hassan, M. Hassan, and M. U. G. Khan. Video summarization using cnn and bidirectional lstm by utilizing scene boundary detection. In 2019 International conference on applied and engineering mathematics (ICAEM), pages 197–202. IEEE, 2019.

K. Kumar and D. D. Shrimankar. F-des: Fast and deep event summarization. IEEE Transactions on Multimedia, 20(2):323–334, 2017.

M. Li and X. Jiang. An improved algorithm based on color feature extraction for image retrieval. In 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC), volume 2, pages 281–285. IEEE, 2016.

B. Liang, N. Li, Z. He, Z. Wang, Y. Fu, and T. Lu. News video summarization combining surf and color histogram features. Entropy, 23(8):982, 2021.

J. Lu, G. Liu, Y. Liu, B. Sun, C. Li, and L. Liu. Improved neural distinguishers with (related-key) differentials: Applications in simon and simeck. arXiv preprint arXiv:2201.03767, 2022.

B. Mahasseni, M. Lam, and S. Todorovic. Unsupervised video summarization with adversarial lstm networks. In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pages 202–211, 2017.

K. Muhammad, T. Hussain, and S. W. Baik. Efficient cnn based summarization of surveillance videos for resource-constrained devices. Pattern Recognition Letters, 130:370–375, 2020.

M. Mukhedkar, P. Powar, and P. Gaikwad. Secure non real time image encryption algorithm development using cryptography & steganography. In 2015 Annual IEEE India Conference (INDICON), pages 1–6. IEEE, 2015.

A. Nazir, R. Ashraf, T. Hamdani, and N. Ali. Content based image retrieval system by using hsv color histogram, discrete wavelet transform and edge histogram descriptor. In 2018 international conference on computing, mathematics and engineering technologies (iCoMET), pages 1–6. IEEE, 2018.

D. P. Papadopoulos, V. S. Kalogeiton, S. A. Chatzichristofis, and N. Papamarkos. Automatic summarization and annotation of videos with lack of metadata information. Expert Systems with Applications, 40(14):5765–5778, 2013.

S. Ramanujam and M. Karuppiah. Designing an algorithm with high avalanche effect. IJCSNS International Journal of Computer Science and Network Security, 11 (1):106–111, 2011.

S. Rani and M. Kumar. Social media video summarization using multi-visual features and kohnen’s self organizing map. Information Processing & Management, 57(3): 102190, 2020.

A. Sahu and A. S. Chowdhury. Summarizing egocentric videos using deep features and optimal clustering. Neurocomputing, 398:209–221, 2020.

X. Sixing, S. Xin, L. Bing, et al. New image encryption technology of image based on computer generated hologram [j]. Laser & Optoelectronics Progress, 49(4):040902, 2012.

T. Soucek and J. Loko ˇ c. Transnet v2: an effective deep network architecture for fast shot transition detection. arXiv preprint arXiv:2008.04838, 2020.

D. Srivastava, R. Wadhvani, and M. Gyanchandani. A review: color feature extraction methods for content based image retrieval. International Journal of Computational Engineering & Management, 18(3):9–13, 2015.

C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 2818–2826, 2016.

Z. Wu and P. Xu. Shot boundary detection in video retrieval. In 2013 IEEE 4th International Conference on Electronics Information and Emergency Communication, pages 86–89. IEEE, 2013.

K. Zhang, W.-L. Chao, F. Sha, and K. Grauman. Video summarization with long short-term memory. In European conference on computer vision, pages 766–782. Springer, 2016.

Y. Zhang, X. Liang, D. Zhang, M. Tan, and E. P. Xing. Unsupervised object-level video summarization with online motion auto-encoder. Pattern Recognition Letters, 130: 376–385, 2020.

B. Zhao, X. Li, and X. Lu. Hsa-rnn: Hierarchical structure-adaptive rnn for video summarization. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 7405–7414, 2018.

U. Zia, M. McCartney, B. Scotney, J. Martinez, M. AbuTair, J. Memon, and A. Sajjad. Survey on image encryption techniques using chaotic maps in spatial, transform and spatiotemporal domains. International Journal of Information Security, pages 1–19, 2022.

Downloads

Published

2023-12-30

Issue

Vol. 48 (2023)

Section

Volume 48-2023

License

This journal provides immediate open access to its content on the principle that making research freely available to the public supports a greater global exchange of knowledge. The journal is committed to real and immediate open access for academic work. All of the journal articles are free to access immediately from the date of publication. There are no charge for readers to download articles and reviews for their own scholarly use. Benefits of open access for authors, include:

  • Free access for all users worldwide
  • Increased visibility and readership
  • Rapid publication
  • No spatial constraints
  • Authors can share their research papers on their personal web-pages (i.e. ResearchGate, etc.)

Ratio Mathematica publishes open access articles under the terms of the Creative Commons Attribution (CC BY) License. The Creative Commons Attribution License (CC-BY) allows users to copy, distribute and transmit an article, adapt the article and make commercial use of the article. The CC BY license permits commercial and non-commercial re-use of an open access article, as long as the author is properly attributed. Copyright on any research article published by Ratio Mathematica is retained by the author(s). Authors grant Ratio Mathematica a license to publish the article and identify itself as the original publisher. Authors also grant any third party the right to use the article freely as long as its original authors, citation details and publisher are identified. 
For further information visit: https://creativecommons.org/licenses/by/3.0/. The following logo will appear in any paper that will be published from the volume number 31/2016 onwards.