Ersin Yumer

I am a Research Scientist at Adobe since June 2015. I completed my PhD studies at the Carnegie Mellon University in May 2015. I did internships at Adobe Research and Google Research.

My research interests lie at the intersection of machine learning, computer graphics, and 3D computer vision. Recently, I have started to focus on bringing the 2D and 3D worlds together by bridging the gap between different media modalities: 3D shapes, video, images and depth scans through end-to-end learning systems. More specifically, I am actively working on deep structured 3D prediction, procedural generative networks, and graphics for vision from a learning agent's perspective.

My PhD work was on developing algorithms to infer high-level structure and semantics of 3D objects. I focused on building intelligent frameworks where the end user is abstracted from low-level interaction with the content, but is enabled with simple and intuitive 'natural language like' controllers to manipulate the geometry and appearance of it.

Internship Opportunities @ Adobe Research

If you are a PhD student interested in doing a research internship at Adobe and/or collaborating on a project with me, send an e-mail. I do get a significant amount of such requests, hence it will be very helpful if you include a CV, your affiliation, your advisor's name, and a summary of your current research interests.


Selected Publications

Zhixin Shu, Ersin Yumer, Sunil Hadap, Kalyan Sunkavalli, Eli Shechtman, Dimitris Samaras, 2017, Neural Face Editing with Intrinsic Image Disentangling. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017), July 2017, Honolulu, HI. (ORAL)

BibTeX arXiv [Soon] Project Page (Code & Data) [Soon]

Eunbyung Park, Jimei Yang, Ersin Yumer, Duygu Ceylan, Alex Berg, 2017, Transformation-Grounded Image Generation Network for Novel 3D View Synthesis. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017), July 2017, Honolulu, HI.

BibTeX arXiv Project Page (Code & Data)

Yinda Zhang*, Shuran Song*, Ersin Yumer, Manolis Savva, Hailin Jin, Joon-Young Lee, Thomas Funkhouser, 2017, Physically-Based Rendering for Indoor Scene Understanding Using Convolutional Neural Networks. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017), July 2017, Honolulu, HI. (*indicates equal contribution)

BibTeX arXiv Project Page (Code & Data)

Xiao Yang, Ersin Yumer, Paul Asente, Mike Kraley, Daniel Kifer, C. Lee Giles, 2017, Learning to Extract Semantic Structure from Documents Using Multimodal Fully Convolutional Neural Networks. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017), July 2017, Honolulu, HI. (SPOTLIGHT)

BibTeX arXiv [Soon] Project Page (Code & Data) [Soon]

Xinchen Yan, Jimei Yang, Ersin Yumer, Yijie Guo, Honglak Lee, 2016, Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervision. Neural Information Processing Systems (NIPS 2016), December 2016, Barcelona, Spain.

BibTeX arXiv Project Page (Code & Data)

Ersin Yumer, Niloy Mitra, 2016, Learning Semantic Deformation Flows with 3D Convolutional Networks. European Conference on Computer Vision (ECCV 2016), October 2016, Amsterdam, the Nedherlands.

DOI BibTeX Pdf Supplementary Pdf Data Project Page

Haibin Huang, Evangelos Kalogerakis, Ersin Yumer, Radomir Mech, 2016, Shape Synthesis from Sketches via Procedural Models and Convolutional Networks. IEEE Transactions on Visualization and Computer Graphics

DOI BibTeX Pdf Supplementary Pdf Code Project Page

Ersin Yumer, Niloy Mitra, 2016, Spectral Style Transfer for Human Motion between Independent Actions. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2016), Volume 35, Issue 4.

ACM Open Access BibTeX Pdf Supplementary Pdf Project Page

Ersin Yumer, Paul Asente, Radomir Mech, Levent Burak Kara, 2015, Procedural Modeling Using Autoencoder Networks. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST), November 2015, Charlotte, NC.

DOI BibTeX Pdf Project Page

Ersin Yumer, Siddhartha Chaudhuri, Jessica K. Hodgins, Levent Burak Kara, 2015, Semantic Shape Editing Using Deformation Handles. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2015), Volume 34, Issue 4.

DOI BibTeX Pdf Supplementary Pdf Project Page

Ersin Yumer, Levent Burak Kara, 2014, Co-Constrained Handles for Deformation in Shape Collections. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2014), Volume 33, Issue 6.

DOI BibTeX Pdf Supplementary Pdf Project Page

Ersin Yumer, Won Chun, Ameesh Makadia, 2014, Co-Segmentation of Textured 3D Shapes with Sparse Annotations. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2014), June 2014, Columbus, OH.

BibTeX Pdf Supplementary Pdf

Ameesh Makadia, Ersin Yumer, 2014, Learning 3D Part Detection from Sparsely Labeled Data. International Conference on 3D Vision (3DV) 2014, Tokyo, Japan.

DOI BibTeX Pdf Supplementary Pdf

Ersin Yumer, Levent Burak Kara, 2012, Co-Abstraction of Shape Collections. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2012), Volume 31, Issue 6, pp. 166:1-166:11.

DOI BibTeX Pdf Supplementary Pdf Project Page

Ersin Yumer, Levent Burak Kara, 2012, Surface Creation on Unstructured Point Sets Using Neural Networks. Computer-Aided Design, Volume 44, Issue 7, pp. 644-656.

DOI BibTeX Pdf Project Page



Earlier Publications

Gunay Orbay, Ersin Yumer, Levent Burak Kara, 2012, Sketch-Based Aesthetic Product Form Exploration from Existing Images Using Piecewise Clothoid Curves. Journal of Visual Languages and Computing, Volume 23, Issue 6, pp. 327-339.

Mark Fuge, Ersin Yumer, Gunay Orbay, Levent Burak Kara,2012, Conceptual Design and Modification of Freeform Surfaces Using Dual Shape Representations in Augmented Reality Environments. Computer-Aided Design, Volume 44, Issue 10, pp. 1020-1032.

Gunay Orbay, Ersin Yumer, Levent Burak Kara,2012, Sketch-Based Shape Exploration Using Multi-Scale Free-Form Surface Editing. AI EDAM, Special Issue on Sketching and Pen-based Design Interaction, Volume 26, Issue 3.

Anil Koyuncu, Ender Cigeroglu, Ersin Yumer, Ozguven H.N., Localization and Identification of Structural Nonlinearities Using Neural Networks. International Modal Analysis Conference (IMAC), Feb. 2013, Garden Groove, CA.

Ersin Yumer, Ender Cigeroglu, H. Nevzat Ozguven, 2012, Mistuning Identification of Integrally Bladed Disks with Cascaded Optimization and Neural Networks. ASME Journal of Turbomachinery, Volume 135, Issue 3, pp. 031008.

Gunay Orbay, Ersin Yumer, Levent Burak Kara, Sketch-Based Image Editing Using Clothoid Curves. International Workshop on Visual Languages and Computing (VLC), as part of International Conference on Distributed Multimedia Systems, Aug. 2011, Florence, Italy

Ersin Yumer, Levent Burak Kara, Conceptual Design of Freeform Surfaces from Unstructured Point Sets Using Neural Network Regression. ASME International Design Engineering Technical Conferences/DAC, Aug. 2011, Washington, D.C.

Ersin Yumer, Ender Cigeroglu, H. Nevzat Ozguven, Modal Updating with Neural Networks and Genetic Optimization. International Modal Analysis Conference (IMAC), Feb. 2011, Jacksonville, FL.

Ersin Yumer, Ender Cigeroglu, H. Nevzat Ozguven, Robustness Analysis of Intentional Mistuning Patterns in Randomly Mistuned Bladed Disk Assemblies. International Conference on Uncertainties in Structural Dynamics, Sep. 2010, Leuven, Belgium.

Ersin Yumer, Ender Cigeroglu, H. Nevzat Ozguven, Non-Linear Forced Response Analysis of Bladed Disk Assemblies. ASME Gas Turbines Technical Congress and Exposition (TurboExpo), June 2010, Glasgow, UK.

Ersin Yumer, Ender Cigeroglu, H. Nevzat Ozguven, Mistuning Identification of Bladed Disks Utilizing Neural Networks. ASME Gas Turbines Technical Congress and Exposition (TurboExpo), June 2010, Glasgow, UK.

Bilge Kocer, Tugce Yuksel, Ersin Yumer, Cem Alper Ozen, Ulas Yaman, Polymorphic Robotic System Controlled by an Observing Camera. International Conference of Digital Image Processing, Feb. 2010, Singapore.

Ersin Yumer, Bilge Kocer, M. Bilgehan Tosun, A New Approach to Construct Generalized Local Voronoi Diagrams via Digital Image Processing. International Conference of Digital Image Processing, Feb. 2010, Singapore.