International Journal of

ADVANCED AND APPLIED SCIENCES

EISSN: 2313-3724, Print ISSN: 2313-626X

Frequency: 12
line decor
  
line decor

 Volume 9, Issue 2 (February 2022), Pages: 142-151

----------------------------------------------

 Original Research Paper

 Title: Hybrid optimization in loop: 3D human body reconstruction from basic information

 Author(s): Tran Van Duc 1, Nguyen Tien Dat 1, *, V. L. Nguyen 2

 Affiliation(s):

 1Modeling and Simulation, Viettel High Technology Industries Corporation, Hanoi, Vietnam
 2Institute of Engineering and Technology, Thu Dau Mot University, Binh Duong Province, Vietnam

  Full Text - PDF          XML

 * Corresponding Author. 

  Corresponding author's ORCID profile: https://orcid.org/0000-0002-7537-8708

 Digital Object Identifier: 

 https://doi.org/10.21833/ijaas.2022.02.016

 Abstract:

3D human reconstruction is widely used for digital transformation in different industries such as e-retail, entertainment, health care, epidemiology. For practical applicability, the modeling process is required to be quick, affordable while still ensuring capabilities in reconstruction accuracy and reliability. To meet such business requirements, we propose a novel technique for producing an exact 3D human body using only basic anthropomorphic measurements. To begin, the paper refers to and summarizes core technologies of the three most common 3D human reconstruction approaches, including (1) Using Point Clouds, (2) Using Images, and (3) Using Anthropometric Measurements. Despite successfully recreating 3D human shapes, these methods face problems of long processing time and high investment cost, making the solution impractical for mass use. Moreover, in the human reconstruction sector particularly, the variety of human shapes, poses, and clothing poses a significant challenge to output accuracy. In this regard, our method combines (1) a local optimization model for determining hyperparameters for classifying different human shapes and (2) a global optimization for reconstructing 3D models, allowing reconstruction of both naked human bodies and clothed ones. The proposed method was evaluated quantitatively and qualitatively using a real dataset to demonstrate its feasibility and efficiency when used in real-world applications. 

 © 2022 The Authors. Published by IASE.

 This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

 Keywords: Human shape reconstruction, Parametric model, Hybrid optimization, Weight correction

 Article History: Received 28 September 2021, Received in revised form 24 December 2021, Accepted 24 December 2021

 Acknowledgment 

The authors would like to thank all members of the 3DR team for their contribution. This research is fully funded by Viettel High Technology Industries Corporation.

 Compliance with ethical standards

 Conflict of interest: The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

 Citation:

 Duc TV, Dat NT, and Nguyen VL (2022). Hybrid optimization in loop: 3D human body reconstruction from basic information. International Journal of Advanced and Applied Sciences, 9(2): 142-151

 Permanent Link to this page

 Figures

 Fig. 1 Fig. 2 Fig. 3 Fig. 4 Fig. 5 Fig. 6 

 Tables

 Table 1  

----------------------------------------------    

 References (14)

  1. Bogo F, Kanazawa A, Lassner C, Gehler P, Romero J, and Black MJ (2016). Keep it SMPL: Automatic estimation of 3D human pose and shape from a single image. In the European Conference on Computer Vision, Springer, Amsterdam, Netherlands: 561-578. https://doi.org/10.1007/978-3-319-46454-1_34   [Google Scholar]
  2. Fan J, Yu W, and Hunter L (2004). Clothing Appearance and Fit: Science and technology. Woodhead Publishing, Cambridge, UK. https://doi.org/10.1201/9781439823446   [Google Scholar]
  3. Kanazawa A, Black MJ, Jacobs DW, and Malik J (2018). End-to-end recovery of human shape and pose. In the IEEE conference on computer vision and pattern recognition, Salt Lake City, USA: 7122-7131. https://doi.org/10.1109/CVPR.2018.00744   [Google Scholar]
  4. Liu B, Liu X, Yang Z, and Wang CC (2019). Concise and effective network for 3D human modeling from orthogonal silhouettes. Available online at: https://arxiv.org/abs/1912.11616
  5. Loper M, Mahmood N, Romero J, Pons-Moll G, and Black MJ (2015). SMPL: A skinned multi-person linear model. ACM Transactions on Graphics (TOG), 34(6): 1-16. https://doi.org/10.1145/2816795.2818013   [Google Scholar]
  6. Nguyen DT and Hoang TN (2021). 3D reconstruction human body from anthropometric measurements using diversity control oriented genetic algorithm. MENDEL: Soft Computing Journal, 27: 49-57. https://doi.org/10.13164/mendel.2021.1.049   [Google Scholar]
  7. Pishchulin L, Wuhrer S, Helten T, Theobalt C, and Schiele B (2017). Building statistical shape spaces for 3rd human modeling. Pattern Recognition, 67: 276-286. https://doi.org/10.1016/j.patcog.2017.02.018   [Google Scholar]
  8. Pujades S, Mohler B, Thaler A, Tesch J, Mahmood N, Hesse N, and Black MJ (2019). The virtual caliper: Rapid creation of metrically accurate avatars from 3D measurements. IEEE Transactions on Visualization and Computer Graphics, 25(5): 1887-1897. https://doi.org/10.1109/TVCG.2019.2898748   [Google Scholar] PMid:30794512
  9. Shigeki Y, Okura F, Mitsugami I, and Yagi Y (2018). Estimating 3D human shape under clothing from a single RGB image. IPSJ Transactions on Computer Vision and Applications, 10(1): 1-6. https://doi.org/10.1186/s41074-018-0052-9   [Google Scholar]
  10. Song D, Tong R, Du J, Zhang Y, and Jin Y (2018). Data-driven 3-D human body customization with a mobile device. IEEE Access, 6: 27939-27948. https://doi.org/10.1109/ACCESS.2018.2837147   [Google Scholar]
  11. WHO (2000). Regional office for the Western Pacific: The Asia-Pacific perspective: Redefining obesity and its treatment. World Health Organization, Health Communications Australia, Sydney, Australia.   [Google Scholar]
  12. Wuhrer S and Shu C (2013). Estimating 3D human shapes from measurements. Machine Vision and Applications, 24(6): 1133-1147. https://doi.org/10.1007/s00138-012-0472-y   [Google Scholar]
  13. Zeng Y, Fu J, and Chao H (2017). 3D human body reshaping with anthropometric modeling. In the International Conference on Internet Multimedia Computing and Service, Springer, Qingdao, China: 96-107. https://doi.org/10.1007/978-981-10-8530-7_10   [Google Scholar]
  14. Zhang C and Chen T (2001). Efficient feature extraction for 2D/3D objects in mesh representation. In the International Conference on Image Processing (Cat. No. 01CH37205), IEEE, Thessaloniki, Greece, 3: 935-938. https://doi.org/10.1109/ICIP.2001.958278   [Google Scholar]