Our primary interests are in 3D user interfaces and interaction design for head-mounted displays. We build high-fidelity prototypes with our students through projects and coursework, and collaborate with Cornell faculty on exploratory AR/VR-related research across disciplines such as computer vision, computer graphics, and human-computer interaction.
We are excited to announce the XR Collaboratory Prototyping Grant. The grant is meant to support Cornell faculty and their graduate students in the development of XR applications, specifically for applying best practices in building high-fidelity 3DUI prototypes for research purposes. Learn more about the grant and winning proposals here.
Our work can be categorized into instructional activities, project activities, and community activities.
INSTRUCTIONAL ACTIVITIES
The XR Collaboratory runs two courses within Cornell Tech’s graduate program in New York City
INFO 5340 / CS 5650: Virtual and Augmented Reality
This course presents an introduction to virtual and augmented reality technologies, with an emphasis on designing and developing interactive virtual and augmented reality experiences. The course covers the history of the area, fundamental theory, interaction techniques, and specific application areas. Concepts from the contributing fields of computer vision, computer graphics and human computer interaction are introduced in the context of virtual and augmented reality. Students are tasked with creating their own virtual reality application as a course project.
Instructor: Harald Haraldsson
Featured course projects
XRC Student Projects
CS 5678: 3D User Interfaces
This course explores the field of virtual and augmented reality with emphasis on topics from the research area of 3D user interfaces (3D UIs), including theoretical foundations, design principles, prototyping, and evaluation. Students will be tasked with designing, implementing, and evaluating their own interaction techniques for 3D UI tasks such as selection and manipulation, travel, and system control for head-mounted displays. Additional topics covered may include but not limited to: remote collaboration, input devices, and more.
Instructor: Harald Haraldsson
Featured course projects
XRC Student Projects
In addition to the courses listed above, Cornell Tech and Cornell University offer a wide range of XR-related courses on topics such as computer vision, computer graphics, and machine learning.
PROJECT ACTIVITIES
The XR Collaboratory provides mentorship and research guidance for several projects each semester
These projects range from staff-led longer-term research projects to single-semester independent research and shorter explorations by students.
Featured Projects
Publications
Explorations and Other Projects
We value creativity and curiosity, and encourage our students to embrace the interdisciplinary nature of AR/VR research through exploratory projects and prototypes.
ViewfindAR
6 Degrees-of-freedom camera synthesis from monocular RGB video
Justin Kae
Immersive MakerLAB
Improving the maker experience with augmented reality instructions and assistance
Karen El Asmar, Ke Ding
Egocentric Plant Detection
Moving from handheld to head-mounted displays for fine-grained classification
Pranjal Mittal
Anon-Emoji
Augmented reality system for reducing appearance bias in social interactions
Ran Sun
Annotate-All
Annotation system for asynchronous collaboration on optical see-through head-mounted displays
Po Yen Tseng
PointAR
Augmented reality laser pointer for tele-assistance
Harald Haraldsson, Serge Belongie
COMMUNITY ACTIVITIES
The XR Collaboratory regularly organizes events with the objective of strengthening the XR community across Cornell campuses
XRC Community Gallery
Internal events
If you are a Cornell community member (student, faculty, researcher, staff) and would like to attend the events and meetings below, please contact us for details.
-
Held for Cornell faculty, researchers, staff, and students, featuring a full day of lightning talks, discussions, posters, and demos.
Website: https://xr.cornell.edu/retreat
-
Cross-campus meeting for Cornell faculty, researchers, and students interested in XR (Augmented / Virtual Reality) research. This is meant for research presentations, round table updates, and project planning for XR-related activities at Cornell University, Cornell Tech, and Weill Cornell.
-
Weekly meetings for XR Collaboratory students and staff at Cornell Tech, with focus on project updates.
External events
We also co-organize academic workshops and regularly contribute to public campus events.
-
Held annually in conjunction with major conferences in computer vision (CVPR, ICCV). Co-organized by XR Collaboratory.
Website: https://xr.cornell.edu/workshop/
-
The XR Collaboratory showcases projects at the end of each semester in conjunction with the Cornell Tech Open Studio event.
PEOPLE
Team
XRC Leadership
Students and Alumni
Featured
Visiting students
Featured
CONTACT
Students
If you are a Cornell student interested in XR research, please get in touch using the form below with a description of your interests and experience. We recommend that students have completed or be enrolled in at least one XR-related course.
Partners
Want to support student projects, groundbreaking research, and new XR applications? We have opportunities for sponsor involvement at a number of levels. Fill in the form below for more information.
Contact XR Collaboratory - please complete the form below
Partners
The XR Collaboratory is generously supported by the following sponsors:
