Ersin Yumer

I am a Research Scientist at Adobe. I obtained my PhD from Carnegie Mellon University, during which I spent several internship periods at Adobe Research and Google Research.

My research interests lie at the intersection of machine learning, 3D computer vision, and graphics. I develop end-to-end learning systems and holistic machine learning applications that bring signals of the visual world together: images, depth scans, video, 3D shapes and points clouds. More specifically, I am actively working on deep structured 3D inference from the limited view of the world obtained by a learning agent, under realistic assumptions of limited data and experience. To address this challenge, my research focuses on: (1) incorporating our knowledge about the real world into deep neural networks as custom differentiable layers, (2) exploiting synthetic data and data augmentation to bootstrap lack of training data.

My research at Adobe has powered a number of features in the following products so far: Adobe Dimension, Adobe Photoshop Mix, and Adobe Fuse.

Internship Opportunities @ Adobe Research

If you are a PhD student interested in doing a research internship at Adobe and/or collaborating on a project with me, send an e-mail. I do get a significant amount of such requests, hence it will be very helpful if you include a CV, your affiliation, your advisor's name, and a summary of your current research interests.

Publications

2017

Self-supervised Learning of Motion Capture.
Hsiao-Yu Tung , Wei Tung, Ersin Yumer, Katerina Fragkiadaki.
Neural Information Processing Systems (NIPS 2017). (SPOTLIGHT)

BibTeX Pdf arXiv Project Page (Code & Data)

Learning Local Shape Descriptors with View-based Convolutional Neural Networks.
Haibin Huang, Evangelos Kalegorakis, Siddhartha Chaudhuri, Duygu Ceylan, Vladimir G. Kim, Ersin Yumer.
ACM Transactions on Graphics (To be presented at SIGGRAPH 2018).

BibTeX arXiv Project Page (Code & Data)

Learning to Predict Indoor Illumination from a Single Image.
Marc-Andre Gardner, Kalyan Sunkavalli, Ersin Yumer, Xiaohui Shen, Emiliano Gambaretto, Jean-Francois Lalonde.
ACM Transactions on Graphics (SIGGRAPH Asia 2017).

BibTeX arXiv

3D-PRNN: Generating Shape Primitives with Recurrent Neural Networks.
Chuhang Zou, Ersin Yumer, Jimei Yang, Duygu Ceylan, Derek Hoiem.
International Conference on Computer Vision (ICCV 2017).

BibTeX arXiv Code (Github) Data (.zip)

Material Editing using a Physically Based Rendering Network.
Guilin Liu, Duygu Ceylan, Ersin Yumer, Jimei Yang, Jyh-Ming Lien.
International Conference on Computer Vision (ICCV 2017).

BibTeX arXiv Project Page (Code & Data)

Learning Hierarchical Shape Segmentation and Labeling from Online Repositories.
Li Yi, Leonidas Guibas, Aaron Hertzmann, Vladimir G. Kim, Hao Su, Ersin Yumer.
ACM Transactions on Graphics (SIGGRAPH 2017).

BibTeX arXiv Project Page (Code & Data)

GRASS: Generative Recursive Autoencoders for Shape Structures.
Jun Li, Kevin Xu, Siddhartha Chaudhuri, Ersin Yumer, Richard Zhang, Leonidas Guibas.
ACM Transactions on Graphics (SIGGRAPH 2017).

BibTeX arXiv Project Page (Code & Data)

Convolutional Neural Networks on Surfaces via Seamless Toric Covers.
Haggai Maron, Meirav Galun, Noam Aigerman, Miri Trope, Nadav Dym, Ersin Yumer, Vladimir G. Kim, Yaron Lipman.
ACM Transactions on Graphics (SIGGRAPH 2017).

BibTeX PDF Code

Skippy: Single View 3D Curve Interactive Modeling.
Vojtech Krs, Ersin Yumer, Nathan Carr, Bedrich Benes, Radomir Mech.
ACM Transactions on Graphics (SIGGRAPH 2017).

BibTeX PDF Project Page

Neural Face Editing with Intrinsic Image Disentangling.
Zhixin Shu, Ersin Yumer, Sunil Hadap, Kalyan Sunkavalli, Eli Shechtman, Dimitris Samaras.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017). (ORAL)

BibTeX arXiv Project Page (Code & Data)

Physically-Based Rendering for Indoor Scene Understanding Using CNNs.
Yinda Zhang*, Shuran Song*, Ersin Yumer, Manolis Savva, J-Y Lee, Hailin Jin, Thomas Funkhouser.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017).
(*equal contribution)

BibTeX arXiv Project Page (Code & Data)

Transformation-Grounded Image Generation Network for Novel 3D View Synthesis.
Eunbyung Park, Jimei Yang, Ersin Yumer, Duygu Ceylan, Alex Berg.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017).

BibTeX arXiv Project Page (Code & Data)

Learning to Extract Semantic Structure from Documents Using Multimodal FCNNs.
Xiao Yang, Ersin Yumer, Paul Asente, Mike Kraley, Daniel Kifer, C. Lee Giles.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017). (SPOTLIGHT)

BibTeX arXiv Project Page (Data)

2016

Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervision.
Xinchen Yan, Jimei Yang, Ersin Yumer, Yijie Guo, Honglak Lee.
Neural Information Processing Systems (NIPS 2016).

BibTeX arXiv Project Page (Code & Data)

Learning Semantic Deformation Flows with 3D Convolutional Networks.
Ersin Yumer, Niloy Mitra.
European Conference on Computer Vision (ECCV 2016).

DOI BibTeX Pdf Supplementary Pdf Data Project Page

Spectral Style Transfer for Human Motion between Independent Actions.
Ersin Yumer, Niloy Mitra.
ACM Transactions on Graphics (SIGGRAPH 2016).

ACM Open Access BibTeX Pdf Supplementary Pdf Project Page

Shape Synthesis from Sketches via Procedural Models and Convolutional Networks.
Haibin Huang, Evangelos Kalogerakis, Ersin Yumer, Radomir Mech.
IEEE Transactions on Visualization and Computer Graphics, 2016.

DOI BibTeX Pdf Supplementary Pdf Code (.zip) Project Page

2015 and Earlier

Procedural Modeling Using Autoencoder Networks.
Ersin Yumer, Paul Asente, Radomir Mech, Levent Burak Kara.
ACM Symposium on User Interface Software and Technology (UIST 2015).

DOI BibTeX Pdf Project Page

Semantic Shape Editing Using Deformation Handles.
Ersin Yumer, Siddhartha Chaudhuri, Jessica K. Hodgins, Levent Burak Kara.
ACM Transactions on Graphics (SIGGRAPH 2015).

DOI BibTeX Pdf Supplementary Pdf Project Page

Co-Constrained Handles for Deformation in Shape Collections.
Ersin Yumer, Levent Burak Kara.
ACM Transactions on Graphics (SIGGRAPH Asia 2014).

DOI BibTeX Pdf Supplementary Pdf Project Page

Co-Segmentation of Textured 3D Shapes with Sparse Annotations.
Ersin Yumer, Won Chun, Ameesh Makadia.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2014).

BibTeX Pdf Supplementary Pdf

Learning 3D Part Detection from Sparsely Labeled Data.
Ameesh Makadia, Ersin Yumer.
International Conference on 3D Vision (3DV 2014).

DOI BibTeX Pdf Supplementary Pdf

Co-Abstraction of Shape Collections.
Ersin Yumer, Levent Burak Kara.
ACM Transactions on Graphics (SIGGRAPH Asia 2012).

DOI BibTeX Pdf Supplementary Pdf Project Page

Surface Creation on Unstructured Point Sets Using Neural Networks.
Ersin Yumer, Levent Burak Kara.
Computer-Aided Design, 2012.

DOI BibTeX Pdf Project Page

Sketch-Based Image Editing Using Clothoid Curves.
Gunay Orbay, Ersin Yumer, Levent Burak Kara.
Journal of Visual Languages and Computing, 2012.

Conceptual Design and Modification of Freeform Surfaces Using Dual Shape Representations in Augmented Reality Environments.
Mark Fuge, Ersin Yumer, Gunay Orbay, Levent Burak Kara.
Computer-Aided Design, 2012.