Ersin Yumer

I am a Research Scientist at Adobe. I obtained my PhD from Carnegie Mellon University, during which I spent several internship periods at Adobe Research and Google Research.

My research interests lie at the intersection of machine learning, computer graphics, and 3D computer vision. Recently, I have started to focus on bringing the 2D and 3D worlds together by bridging the gap between different media modalities: 3D shapes, video, images and depth scans through end-to-end learning systems. More specifically, I am actively working on deep structured 3D prediction, and graphics for vision from a learning agent's perspective.

Internship Opportunities @ Adobe Research

If you are a PhD student interested in doing a research internship at Adobe and/or collaborating on a project with me, send an e-mail. I do get a significant amount of such requests, hence it will be very helpful if you include a CV, your affiliation, your advisor's name, and a summary of your current research interests.

Publications

2017

Self-supervised Learning of Motion Capture.
Hsiao-Yu Tung , Hsiao Wei, Ersin Yumer, Katerina Fragkiadaki.
Neural Information Processing Systems (NIPS 2017). (SPOTLIGHT)

BibTeX arXiv [Soon] Project Page (Code & Data) [Soon]

Learning Local Shape Descriptors with View-based Convolutional Neural Networks.
Haibin Huang, Evangelos Kalegorakis, Siddhartha Chaudhuri, Duygu Ceylan, Vladimir G. Kim, Ersin Yumer.
ACM Transactions on Graphics (To be presented at SIGGRAPH 2018).

BibTeX arXiv Project Page (Code & Data)

Learning to Predict Indoor Illumination from a Single Image.
Marc-Andre Gardner, Kalyan Sunkavalli, Ersin Yumer, Xiaohui Shen, Emiliano Gambaretto, Jean-Francois Lalonde.
ACM Transactions on Graphics (SIGGRAPH Asia 2017).

BibTeX arXiv

3D-PRNN: Generating Shape Primitives with Recurrent Neural Networks.
Chuhang Zou, Ersin Yumer, Jimei Yang, Duygu Ceylan, Derek Hoiem.
International Conference on Computer Vision (ICCV 2017).

BibTeX arXiv Project Page (Code & Data) [Soon]

Material Editing using a Physcially Based Rendering Network.
Guilin Liu, Duygu Ceylan, Ersin Yumer, Jimei Yang, Jyh-Ming Lien.
International Conference on Computer Vision (ICCV 2017).

BibTeX arXiv Project Page (Code & Data) [Soon]

Learning Hierarchical Shape Segmentation and Labeling from Online Repositories.
Li Yi, Leonidas Guibas, Aaron Hertzmann, Vladimir G. Kim, Hao Su, Ersin Yumer.
ACM Transactions on Graphics (SIGGRAPH 2017).

BibTeX arXiv Project Page (Code & Data)

GRASS: Generative Recursive Autoencoders for Shape Structures.
Jun Li, Kevin Xu, Siddhartha Chaudhuri, Ersin Yumer, Richard Zhang, Leonidas Guibas.
ACM Transactions on Graphics (SIGGRAPH 2017).

BibTeX arXiv Project Page (Code & Data)

Convolutional Neural Networks on Surfaces via Seamless Toric Covers.
Haggai Maron, Meirav Galun, Noam Aigerman, Miri Trope, Nadav Dym, Ersin Yumer, Vladimir G. Kim, Yaron Lipman.
ACM Transactions on Graphics (SIGGRAPH 2017).

BibTeX PDF Code

Skippy: Single View 3D Curve Interactive Modeling.
Vojtech Krs, Ersin Yumer, Nathan Carr, Bedrich Benes, Radomir Mech.
ACM Transactions on Graphics (SIGGRAPH 2017).

BibTeX PDF Project Page

Neural Face Editing with Intrinsic Image Disentangling.
Zhixin Shu, Ersin Yumer, Sunil Hadap, Kalyan Sunkavalli, Eli Shechtman, Dimitris Samaras.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017). (ORAL)

BibTeX arXiv Project Page (Code & Data)

Physically-Based Rendering for Indoor Scene Understanding Using CNNs.
Yinda Zhang*, Shuran Song*, Ersin Yumer, Manolis Savva, J-Y Lee, Hailin Jin, Thomas Funkhouser.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017).
(*equal contribution)

BibTeX arXiv Project Page (Code & Data)

Transformation-Grounded Image Generation Network for Novel 3D View Synthesis.
Eunbyung Park, Jimei Yang, Ersin Yumer, Duygu Ceylan, Alex Berg.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017).

BibTeX arXiv Project Page (Code & Data)

Learning to Extract Semantic Structure from Documents Using Multimodal FCNNs.
Xiao Yang, Ersin Yumer, Paul Asente, Mike Kraley, Daniel Kifer, C. Lee Giles.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017). (SPOTLIGHT)

BibTeX arXiv Project Page (Data)

2016

Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervision.
Xinchen Yan, Jimei Yang, Ersin Yumer, Yijie Guo, Honglak Lee.
Neural Information Processing Systems (NIPS 2016).

BibTeX arXiv Project Page (Code & Data)

Learning Semantic Deformation Flows with 3D Convolutional Networks.
Ersin Yumer, Niloy Mitra.
European Conference on Computer Vision (ECCV 2016).

DOI BibTeX Pdf Supplementary Pdf Data Project Page

Spectral Style Transfer for Human Motion between Independent Actions.
Ersin Yumer, Niloy Mitra.
ACM Transactions on Graphics (SIGGRAPH 2016).

ACM Open Access BibTeX Pdf Supplementary Pdf Project Page

Shape Synthesis from Sketches via Procedural Models and Convolutional Networks.
Haibin Huang, Evangelos Kalogerakis, Ersin Yumer, Radomir Mech.
IEEE Transactions on Visualization and Computer Graphics, 2016.

DOI BibTeX Pdf Supplementary Pdf Code Project Page

2015 and Earlier

Procedural Modeling Using Autoencoder Networks.
Ersin Yumer, Paul Asente, Radomir Mech, Levent Burak Kara.
ACM Symposium on User Interface Software and Technology (UIST 2015).

DOI BibTeX Pdf Project Page

Semantic Shape Editing Using Deformation Handles.
Ersin Yumer, Siddhartha Chaudhuri, Jessica K. Hodgins, Levent Burak Kara.
ACM Transactions on Graphics (SIGGRAPH 2015).

DOI BibTeX Pdf Supplementary Pdf Project Page

Co-Constrained Handles for Deformation in Shape Collections.
Ersin Yumer, Levent Burak Kara.
ACM Transactions on Graphics (SIGGRAPH Asia 2014).

DOI BibTeX Pdf Supplementary Pdf Project Page

Co-Segmentation of Textured 3D Shapes with Sparse Annotations.
Ersin Yumer, Won Chun, Ameesh Makadia.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2014).

BibTeX Pdf Supplementary Pdf

Learning 3D Part Detection from Sparsely Labeled Data.
Ameesh Makadia, Ersin Yumer.
International Conference on 3D Vision (3DV 2014).

DOI BibTeX Pdf Supplementary Pdf

Co-Abstraction of Shape Collections.
Ersin Yumer, Levent Burak Kara.
ACM Transactions on Graphics (SIGGRAPH Asia 2012).

DOI BibTeX Pdf Supplementary Pdf Project Page

Surface Creation on Unstructured Point Sets Using Neural Networks.
Ersin Yumer, Levent Burak Kara.
Computer-Aided Design, 2012.

DOI BibTeX Pdf Project Page

Sketch-Based Image Editing Using Clothoid Curves.
Gunay Orbay, Ersin Yumer, Levent Burak Kara.
Journal of Visual Languages and Computing, 2012.

Conceptual Design and Modification of Freeform Surfaces Using Dual Shape Representations in Augmented Reality Environments.
Mark Fuge, Ersin Yumer, Gunay Orbay, Levent Burak Kara.
Computer-Aided Design, 2012.