CS 12 SI: Spring 2024

Spatial Computing Workshop

1 Unit

Mondays 6pm - 7:20pm

STLC 104

Overview

This one-unit workshop introduces UX design fundamentals for XR (Extended Reality) applications through a combination of hands-on work sessions and guest lectures from industry and academic experts focusing on spatial prototyping and introducing Xcode for implementing applications on the Apple Vision Pro. Students will work in teams to propose and develop prototypes for applications that embody best practices within virtual, augmented, and mixed-reality environments. The course covers user-centered design principles and the distinct challenges and opportunities inherent in design for spatial computing. Emphasis will be placed on prototyping techniques that allow for the rapid iteration and testing of XR environments, ensuring students thoroughly understand how to conceptualize, design, and refine user experiences in this emerging field.

Application deadline: March 15. Application results will be released sometime before the first day of the quarter, at which point accepted students will recieve an enrollment code to join the course.

Syllabus

Week 1

Introduction: Try out headsets & brainstorm ideas

Week 2

Guest Lecture: Marco Cavallo on Spatial Data Visualization

Deliverable: Project Proposal

Week 3

Implementation Lecture: Xcode & SwiftUI Basics for visionOS

Week 4

Guest Lecture: Jonathan Edelman on Design Methodologies

Week 5

Guest Lecture: Bezi & 3D Prototyping Tools

Deliverable: Design Spec & Bezi Design

Week 6

Implementation Lecture: RealityKit & 3D Scenes

Week 7

Immersive Design Case Study

Deliverable: Initial Xcode Implementation

Week 8

No Class: Memorial Day

Week 9

Implementation Lecture: ARKit & Scene Understanding

Deliverable: Final Prototype

Week 10

Demo Day: Showcase Final Prototypes

Course Project

The final deliverables for this course will be (1) a small XCode prototype, designed and developed over the course of the quarter., and (2) an accompanying poster outlining the proposed application scenario, brief summary of technical implementation, description of your design and implemented features, and reflection on opportunities and challenges faced during prototype development. This project will build on intermediate design and prototyping assignments from throughout the quarter.

Teaching Team

Gabriel Lipkowitz

Trishia El Chemaly

Steven Le

Casey Manning

Jasmine Sumpter

Alexander Worley