Ersin Yumer

I am a Research Scientist at Adobe. I obtained my PhD from Carnegie Mellon University, during which I spent several internship periods at Adobe Research and Google Research.

My research interests lie at the intersection of machine learning, computer graphics, and 3D computer vision. Recently, I have started to focus on bringing the 2D and 3D worlds together by bridging the gap between different media modalities: 3D shapes, video, images and depth scans through end-to-end learning systems. More specifically, I am actively working on deep structured 3D prediction, procedural generative networks, and graphics for vision from a learning agent's perspective.

My PhD work was on developing algorithms to infer high-level structure and semantics of 3D objects. I focused on building intelligent frameworks where the end user is abstracted from low-level interaction with the content, but is enabled with simple and intuitive 'natural language like' controllers to manipulate the geometry and appearance of it.

Internship Opportunities @ Adobe Research

If you are a PhD student interested in doing a research internship at Adobe and/or collaborating on a project with me, send an e-mail. I do get a significant amount of such requests, hence it will be very helpful if you include a CV, your affiliation, your advisor's name, and a summary of your current research interests.


Publications

Neural Face Editing with Intrinsic Image Disentangling.
Zhixin Shu, Ersin Yumer, Sunil Hadap, Kalyan Sunkavalli, Eli Shechtman, Dimitris Samaras.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017). (ORAL)

BibTeX arXiv Project Page (Code & Data)

Physically-Based Rendering for Indoor Scene Understanding Using CNNs.
Yinda Zhang*, Shuran Song*, Ersin Yumer, Manolis Savva, J-Y Lee, Hailin Jin, Thomas Funkhouser.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017).
(*equal contribution)

BibTeX arXiv Project Page (Code & Data)

Transformation-Grounded Image Generation Network for Novel 3D View Synthesis.
Eunbyung Park, Jimei Yang, Ersin Yumer, Duygu Ceylan, Alex Berg.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017).

BibTeX arXiv Project Page (Code & Data)

Learning to Extract Semantic Structure from Documents Using Multimodal FCNNs.
Xiao Yang, Ersin Yumer, Paul Asente, Mike Kraley, Daniel Kifer, C. Lee Giles.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017). (SPOTLIGHT)

BibTeX arXiv [Soon] Project Page (Code & Data) [Soon]

Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervision.
Xinchen Yan, Jimei Yang, Ersin Yumer, Yijie Guo, Honglak Lee.
Neural Information Processing Systems (NIPS 2016).

BibTeX arXiv Project Page (Code & Data)

Learning Semantic Deformation Flows with 3D Convolutional Networks.
Ersin Yumer, Niloy Mitra.
European Conference on Computer Vision (ECCV 2016).

DOI BibTeX Pdf Supplementary Pdf Data Project Page

Spectral Style Transfer for Human Motion between Independent Actions.
Ersin Yumer, Niloy Mitra.
ACM Transactions on Graphics (SIGGRAPH 2016).

ACM Open Access BibTeX Pdf Supplementary Pdf Project Page

Shape Synthesis from Sketches via Procedural Models and Convolutional Networks.
Haibin Huang, Evangelos Kalogerakis, Ersin Yumer, Radomir Mech.
IEEE Transactions on Visualization and Computer Graphics, 2016.

DOI BibTeX Pdf Supplementary Pdf Code Project Page

Procedural Modeling Using Autoencoder Networks.
Ersin Yumer, Paul Asente, Radomir Mech, Levent Burak Kara.
ACM Symposium on User Interface Software and Technology (UIST 2015).

DOI BibTeX Pdf Project Page

Semantic Shape Editing Using Deformation Handles.
Ersin Yumer, Siddhartha Chaudhuri, Jessica K. Hodgins, Levent Burak Kara.
ACM Transactions on Graphics (SIGGRAPH 2015).

DOI BibTeX Pdf Supplementary Pdf Project Page

Co-Constrained Handles for Deformation in Shape Collections.
Ersin Yumer, Levent Burak Kara.
ACM Transactions on Graphics (SIGGRAPH Asia 2014).

DOI BibTeX Pdf Supplementary Pdf Project Page

Co-Segmentation of Textured 3D Shapes with Sparse Annotations.
Ersin Yumer, Won Chun, Ameesh Makadia.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2014).

BibTeX Pdf Supplementary Pdf

Learning 3D Part Detection from Sparsely Labeled Data.
Ameesh Makadia, Ersin Yumer.
International Conference on 3D Vision (3DV 2014).

DOI BibTeX Pdf Supplementary Pdf

Co-Abstraction of Shape Collections.
Ersin Yumer, Levent Burak Kara.
ACM Transactions on Graphics (SIGGRAPH Asia 2012).

DOI BibTeX Pdf Supplementary Pdf Project Page

Surface Creation on Unstructured Point Sets Using Neural Networks.
Ersin Yumer, Levent Burak Kara.
Computer-Aided Design, 2012.

DOI BibTeX Pdf Project Page

Sketch-Based Image Editing Using Clothoid Curves.
Gunay Orbay, Ersin Yumer, Levent Burak Kara.
Journal of Visual Languages and Computing, 2012.

Conceptual Design and Modification of Freeform Surfaces Using Dual Shape Representations in Augmented Reality Environments.
Mark Fuge, Ersin Yumer, Gunay Orbay, Levent Burak Kara.
Computer-Aided Design, 2012.