An Empirical Study of On-Device Translation for Real-Time Live-Stream Chat on Mobile Devices

Excerpt

arXiv:2601.02641v3 Announce Type: replace Abstract: Despite its efficiency, there has been little research on the practical aspects required for real-world deployment of on-device AI models, such as the device's CPU utilization and thermal conditions. In this paper, through extensive experiments, we investigate two key issues that must be addressed to deploy on-device models in real-world services: (i) the selection of on-device models and the resource consumption of each model, and (ii) the cap