Welcome to the 3D Vision Reading Group website! We're thrilled to have you here. Join us every week at the University of Toronto as we dive into the exciting world of 3D Vision. From cutting-edge topics like NeRFs, 3D Gaussian Splats, to the latest in Diffusion Models for 3D, and who knows what else might come up - we're passionately interested in it all! Let's explore, learn, and have fun together!
Presenters can select their preferred date for sign-up here, while the paper to be presented each week is usually chosen from recently released papers, typically from the past week or two leading up to the presentation date. Sessions will be recorded and saved to our YouTube Channel.
Time: 4:15-5pm Mondays
Place: 5256 Bahen center
Zoom: shared via email
Reading Sessions
Oct 23, 2023: 4K4D: Real-Time 4D View Synthesis at 4K Resolution
Zhen Xu, Sida Peng, Haotong Lin, Guangzhao He, Jiaming Sun, Yujun Shen, Hujun Bao, Xiaowei Zhou
preprint
Oct 23, 2023: Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model
Anonymous Authors
preprint (ICLR)
Oct 30, 2023: SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3D
Weiyu Li, Rui Chen, Xuelin Chen, Ping Tan
preprint
Oct 30, 2023: DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior
Jingxiang Sun, Bo Zhang, Ruizhi Shao, Lizhen Wang, Wen Liu, Zhenda Xie, Yebin Liu
preprint
Nov 6, 2023: ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Real Image
Kyle Sargent, Zizhang Li, Tanmay Shah, Charles Herrmann, Hong-Xing Yu, Yunzhi Zhang, Eric Ryan Chan, Dmitry Lagun, Li Fei-Fei, Deqing Sun, Jiajun Wu
preprint
Nov 6, 2023: NeRF Revisited: Fixing Quadrature Instability in Volume Rendering
Mikaela Angelina Uy, Kiyohiro Nakayama, Guandao Yang, Rahul Krishna Thomas, Leonidas Guibas, Ke Li
NeurIPS 2023
Nov 13, 2023: EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervision
Jiawei Yang, Boris Ivanovic, Or Litany, Xinshuo Weng, Seung Wook Kim, Boyi Li, Tong Che, Danfei Xu, Sanja Fidler, Marco Pavone, Yue Wang
Arxiv (ICLR)
Nov 13, 2023: LRM: Large Reconstruction Model for Single Image to 3D
Yicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, Hao Tan
Arxiv
Nov 20, 2023: Real-time neural rasterization for large scenes
Jeffrey Yunfan Liu , Yun Chen, Ze Yang, Jingkang Wang, Sivabalan Manivasagam, Raquel Urtasun
ICCV 2023
Nov 20, 2023: Adaptive Shells for Efficient Neural Radiance Field Rendering
Zian Wang, Tianchang Shen, Merlin Nimier-David, Nicholas Sharp, Jun Gao, Alexander Keller, Sanja Fidler, Thomas Müller, Zan Gojcic
SIGGRAPH Asia 2023
Nov 27, 2023: PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics
Tianyi Xie, Zeshun Zong, Yuxing Qiu, Xuan Li, Yutao Feng, Yin Yang, Chenfanfu Jiang
Arxiv
Nov 27, 2023:Drivable 3D Gaussian Avatars
Wojciech Zielonka, Timur Bagautdinov, Shunsuke Saito, Michael Zollhöfer, Justus Thies, Javier Romero
Arxiv
Dec 4, 2023:4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling
Sherwin Bahmani, Ivan Skorokhodov, Victor Rong, Gordon Wetzstein, Leonidas Guibas, Peter Wonka, Sergey Tulyakov, Jeong Joon Park, Andrea Tagliasacchi, David B. Lindell
Arxiv
Dec 4, 2023:"GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfaces"
Yingwenqi Jiang, Jiadong Tu, Yuan Liu, Xifeng Gao, Xiaoxiao Long, Wenping Wang, Yuexin Ma
Arxiv
Dec 11, 2023:ReconFusion: 3D Reconstruction with Diffusion Priors
Rundi Wu, Ben Mildenhall, Philipp Henzler, Keunhong Park, Ruiqi Gao, Daniel Watson, Pratul P. Srinivasan, Dor Verbin, Jonathan T. Barron, Ben Poole, Aleksander Holynski
Arxiv
Dec 11, 2023:SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM
Nikhil Keetha, Jay Karhade, Krishna Murthy Jatavallabhula, Gengshan Yang, Sebastian Scherer, Deva Ramanan, Jonathon Luiten
Arxiv
Jan 8, 2023: DUSt3R: Geometric 3D Vision Made Easy
Shuzhe Wang, Vincent Leroy, Yohann Cabon, Boris Chidlovskii, Jérôme Revaud
Arxiv
Preliminary Links and Resources
NeRF Resources:
NeRF main papers and summaries
NeRF Tutorial Video
Diffusion Model Resources:
score based generative modeling
Diffusion model CVPR Tutorial