Publications
Detailed Information
MIRROR: Towards Generalizable On-Device Video Virtual Try-On for Mobile Shopping
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kang, Dong-Sig | - |
dc.contributor.author | Baek, Eunsu | - |
dc.contributor.author | Son, Sungwook | - |
dc.contributor.author | Lee, Youngki | - |
dc.contributor.author | Gong, Taesik | - |
dc.contributor.author | Kim, Hyung-Sin | - |
dc.date.accessioned | 2024-05-14T08:05:58Z | - |
dc.date.available | 2024-05-14T08:05:58Z | - |
dc.date.created | 2024-02-01 | - |
dc.date.issued | 2023-12 | - |
dc.identifier.citation | Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol.7 No.4, p. 163 | - |
dc.identifier.issn | 2474-9567 | - |
dc.identifier.uri | https://hdl.handle.net/10371/202131 | - |
dc.description.abstract | We present MIRROR, an on-device video virtual try-on (VTO) system that provides realistic, private, and rapid experiences in mobile clothes shopping. Despite recent advancements in generative adversarial networks (GANs) for VTO, designing MIRROR involves two challenges: (1) data discrepancy due to restricted training data that miss various poses, body sizes, and backgrounds and (2) local computation overhead that uses up 24% of battery for converting only a single video. To alleviate the problems, we propose a generalizable VTO GAN that not only discerns intricate human body semantics but also captures domain-invariant features without requiring additional training data. In addition, we craft lightweight, reliable clothes/pose-tracking that generates refined pixel-wise warping flow without neural-net computation. As a holistic system, MIRROR integrates the new VTO GAN and tracking method with meticulous pre/post-processing, operating in two distinct phases (on/offline). Our results on Android smartphones and real-world user videos show that compared to a cutting-edge VTO GAN, MIRROR achieves 6.5× better accuracy with 20.1× faster video conversion and 16.9× less energy consumption. | - |
dc.language | 영어 | - |
dc.publisher | Association for Computing Machinery (ACM) | - |
dc.title | MIRROR: Towards Generalizable On-Device Video Virtual Try-On for Mobile Shopping | - |
dc.type | Article | - |
dc.identifier.doi | 10.1145/3631420 | - |
dc.citation.journaltitle | Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies | - |
dc.identifier.wosid | 001168287200018 | - |
dc.identifier.scopusid | 2-s2.0-85182605561 | - |
dc.citation.number | 4 | - |
dc.citation.startpage | 163 | - |
dc.citation.volume | 7 | - |
dc.description.isOpenAccess | Y | - |
dc.contributor.affiliatedAuthor | Lee, Youngki | - |
dc.contributor.affiliatedAuthor | Kim, Hyung-Sin | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
- Appears in Collections:
- Files in This Item:
- There are no files associated with this item.
Item View & Download Count
Items in S-Space are protected by copyright, with all rights reserved, unless otherwise indicated.