IRMA-International.org: Creator of Knowledge
Information Resources Management Association
Advancing the Concepts & Practices of Information Resources Management in Modern Organizations

A Benchmark and VLM-Based Method for Quantifying Novelty-Usefulness-Coherence in Industrial Product Form Design

A Benchmark and VLM-Based Method for Quantifying Novelty-Usefulness-Coherence in Industrial Product Form Design
View Sample PDF
Author(s): Tao Shi (Wuxi Vocational Institute of Arts and Technology, China)and Qiang Wan (Hanseo University, South Korea & Shunde Polytechnic University, China)
Copyright: 2026
Volume: 19
Issue: 1
Pages: 17
Source title: International Journal of Information Technologies and Systems Approach (IJITSA)
Editor(s)-in-Chief: Sangbing (Jason) Tsai (International Engineering and Technology Institute (IETI), Hong Kong)and Wei Liu (Qingdao University, China)
DOI: 10.4018/IJITSA.397635

Purchase


Abstract

Aiming at the subjective assessment of industrial design creativity, this paper presents a quantitative assessment framework that combines novelty, appropriateness, and consistency and establishes a benchmark for assessing the modeling creativity of multi-category products. With the help of human subjective scores from human-computer collaborative labeling, this study designed a “design critic” model based on a visual language model to enable automatic creativity assessment. The experiment showed that the Spearman correlation coefficient between the design critic model and human ratings in the cross-category test was 0.67, while the appropriateness dimension scored 0.74. In the context of small sample migration, the self-supervised pre-trained model maintained a correlation of 0.61 after fine-tuning with only 20 samples. After three rounds of optimization, the average user preference rate increased by about 24%, with a peak of 68%.

Related Content

Siyu Wang, Xing Liu, Dong Lu, Xiaoyi Yang, Jing Chang. © 2026. 16 pages.
Wenjing Nian, Ye Gao, Juntang Yang, Xiaoyi Yang, Luguang Wen. © 2026. 19 pages.
Yang Li, Yang Yang, Zihan Wang. © 2026. 18 pages.
He Danni. © 2026. 21 pages.
Yiyu Dai, Junzheng Lu, Zesen Li, Jiawei Li, Yunxi Lu. © 2026. 18 pages.
Tao Shi, Qiang Wan. © 2026. 17 pages.
Weijian Zhu, Jingting Lin. © 2026. 19 pages.
Body Bottom