Recently, there has been increasing interest for easy and reliable generation of 3-D animated models facilitating several real-time applications (like immersive telepresence, motion capture, and gaming). In most of these applications, the reconstruction of soft body animations is based on time- varying point clouds, which are nonuniformly sampled and highly incomplete. To overcome these significantly challenging imperfections without any additional information, first we introduce a novel reconstruction technique based on rank minimization theory, which can result in a unique solution to the otherwise ill-posed problem. This technique is further extended to exploit the spatial coherence, which usually characterizes the soft-body animations. Based on the developed tools, we propose a distributed consolidation technique where the reconstruction is performed by working simultaneously on several groups of frames. To achieve this, we impose temporal coherence between successive frame clusters by constraining the rank minimization problem.
Introduces a novel reconstruction technique based on rank minimization theory to address the challenge of highly incomplete dynamic point clouds, ensuring a unique solution to an otherwise ill-posed problem.
Extends the rank minimization approach to incorporate spatial coherence, which is essential for accurately reconstructing soft-body animations.
Proposes a distributed consolidation method that allows multiple nodes to collaboratively reconstruct point clouds by enforcing temporal coherence between frame clusters, improving scalability and efficiency.
Results & Insights
NMSE comparison of the proposed method against PCA-based reconstruction for different levels of incompleteness.The results demonstrate that the proposed rank minimization-based method significantly outperforms the PCA-based approach in terms of reconstruction accuracy, particularly for highly incomplete point clouds, achieving lower NMSE across all tested configurations.