Cours : Virtual reality

Aperçu des sections

Généralités
Virtual Reality

Presential course in INF2 by R. Boulic with one Lecture by Dr Bruno Herbelin on May 9th
(the use of the webinar 668 8117 1531 is limited to the first week)

For Q&A about the course, hands-on and the project, use the dedicated channels in the VR Discord server

see the detailed schedule below for the the type of activity during the 10-13h time range
the course plans 5 weeks of VR hands-on with coding work (--2h/week) from weeks 3-4 to 8 of the semester. For this reason, the 1h of exercise from 12h to 13h is used for teaching for the first 2 weeks whereas there will be only 1h of lecture from 10h to 11h during the weeks 4 to 8 period.
The paper study is an individual work done within week2 to 5.
The project starts on week 3 where groups of 3 persons are formed and can retrieve their Oculus Quest HMD(s) ; we have 22 of them (half Oculus Quest and half Quest2) for this spring. The project pitch is planned on week 5 just before the hands-on. The project end on week 13.

GRADING SCHEME
- The paper study grade has a weight of 20% ; you will know your grade before the final oral (see below)
- The programming assignment has a weight of 50%: The project oral evaluation will be conducted in presential if possible
- The short individual theoretical oral control during week 14 has a weight of 30% (on the chosen paper for the paper study + general VR theoretical concepts)) . The theoretical oral exam will be conducted in presential if possible
- DETAILED SCHEDULE(2021-22)
Section 1
Feb. 21 st [1h course presentation and embodied VR concepts, 2h about Game concepts and testing]

R. Boulic : Course structure including a brief overview of the 4 hands-on demos, the paper study and the small project

R. Boulic : VR as "Embodied Interaction"
N. Tian : Introduction to game design
M. Delahaye: Game: Play testing
- Slides R. Boulic "course organization" [21.02.2022] Fichier
- video switchTube: organization [21.01.2022] URL
- Slides R. Boulic "VR as embodied interactions" [21.02.2022] Fichier
- video switchTube : embodied VR [21.01.2022] URL
- Nana Tian : Introduction to Game Design_2022 [22.02.2021] Fichier
- video switchTube : Game design [21.01.2022] URL
- Introduction to Game Design - Prototyping and Playtesting [2021] Fichier
- video switchTube : Play testing [21.02.2022] URL
- Example of paper study [Slater Presence 2004, N°32] Fichier
- Paper list proposed for the Paper study [2021-22] Fichier
  Later this week, you will be able to select the paper you want to study by registering to the "paper study group" with the number of the first authors' name on the first page.
  Carefully read the abstracts before choosing a paper as you cannot revert your choice.
  
  You can join only one group => one paper to study (alone) ; it's not a work to do with the potential other person choosing the same paper to study. We'll run the plagiarism detection tool to check such issue.
- Paper Study choice [there are still 6 paper choices for the remaining 5 persons who did not make their choice yet] Choix de Groupe
  reminder: choose MAXIMUM 1 group / the paper study work is individual. The word "group" comes from the moodle interface design ; it just mean the maximum number of person choosing a specific paper.
  The Turn-it-in assignment uploading tool will be visible in the TOPIC5 box. According to EPFL regulations, this tool will check for plagiarism on all uploaded assignments including those provided in previous years.
- Hands-on - Weeks 1 and 2 : Setup of the environment URL
- Hands-on - Weeks 1 and 2 : Setup of the environment - Video URL
Section 2
February 28th [3h teaching] from now on, without webinar ; recorded video from previous year will be visible after the course period

R. Boulic 1h: Feeding human senses through "Immersion"

R. Boulic 1h: Depth Perception
Mathias Delahaye / Nana Tian 1h: VR systems
Section 3
March 7th [2h teaching and 1h UNITY intro]

R. Boulic 1h: How much Immersion is necessary ? what is he difference between Immersion and Presence ? and Flow ?
R. Boulic 1h: Cybersickness
Hands-on HO1 Week3
- Slides "Immersion, Presence and Flow" [ok for 2021-22] Fichier
- video switchTube URL
- Slides "Cybersickness" [ok for 2021-22] Fichier
- video switchTube part1: perceptual conflict theory URL
- video switchTube part2: Rest frame theory and "motion to photon" latency URL
- video switchTube part3: measuring cybersickness, design guidelines URL
- The VR Project Guidelines - 2022 Fichier
- Game design document (Deadline 16th 23:59) Devoir
  The game design document is maximum two pages. This is not graded ; it will be used to provide better feedback during the pitch session in week 5.
  Please Mark your group_id in the pdf name and your document title.
  One person per group make the submission
  You should include the following bullet points: Please carefully read updated project guideline_ 2022 for references:
  1. Game background description. (e.g. stories (if any), game world (if any))
  2. Basic gameplay (e.g. the goal of the game)
  3. Game mechanism ( e.g. the core game mechanism, key interactions, etc)
  4. Locomotion style.
  5. Designs to avoid cybersickness (Optional).
  6. Other features (User interface, Sound & Effects).
  We recommend that you use drawings or other forms of graphical representation to convey your idea more efficiently.
  For the pitch session, please prepare a presentation slide (maximum 5 pages).
- Hands-on - Week 3 : Introduction to Unity 3D URL
- Sign up for pitch Rendez-vous
  Accès restreint Non disponible à moins que l'une des conditions suivantes soit remplie :
  Vous soyez membre de VR project 01
  Vous soyez membre de VR project 02
  Vous soyez membre de VR project 03
  Vous soyez membre de VR project 04
  Vous soyez membre de VR project 05
  Vous soyez membre de VR project 06
  Vous soyez membre de VR project 07
  Vous soyez membre de VR project 08
  Vous soyez membre de VR project 09
  Vous soyez membre de VR project 10
  Vous soyez membre de VR project 11
  Vous soyez membre de VR project 12
  Vous soyez membre de VR project 13
  Vous soyez membre de VR project 14
  Vous soyez membre de VR project 15
  Vous soyez membre de VR project 16
  Vous soyez membre de VR project 17
  Vous soyez membre de VR project 18
  Vous soyez membre de VR project 19
  Vous soyez membre de VR project 20
  Vous soyez membre de VR project 21
  Vous soyez membre de VR project 22
Section 4
March 14th [1h teaching, 2h TP with own laptop]

R. Boulic 1h: Basic 3D interaction techniques: Magic vs Naturalism (Part1)
Hands-on HO2 Week4
- Starting to present the 3D interaction techniques that will be exploited later in the hands-on practical work.
- Slides "Basic 3D interaction techniques: Magic vs Naturalism (up to the section on NAVIGATION/Naturalistic techniques)" [28.03.2022] Fichier
- video on SwitchTube : Naturalism vs magic / the Navigation task (partly) [2021] URL
- Hands-on - HO2 Week 4 : Setup of a basic scene for the Oculus Quest URL
- Video HO2 Week4 on SwitchTube URL
Section 5
March 21st [reduced teaching/ focus on the pitch]
R. Boulic : Basic 3D interaction techniques: Magic vs Naturalism [15 min]

Mathias/Nana : Project Pitch from 10h38 to 12h50 (sign-up and upload of the game design document is in Topic3)
- Technical focus: Part2 of 3D interaction techniques
- Slides "Basic 3D interaction techniques: Magic vs Naturalism" part magic navigation[28.03.2022] Fichier
- Video switchTube on "magic" navigation techniques (20 min) URL
Section 6
March 28 th [1h teaching / 2h TP]

R. Boulic 1h : Basic 3D interaction techniques: Magic vs Naturalism (part 4)
Hands-on Week6
- Slides "Basic 3D interaction techniques: other 3DUI components" Last Part [28.03.2022] Fichier
- Video switchTube on the Selection and the Manipulation components (25 min) [2021] URL
- video switchTube on other components of 3D interaction(42 min) [2021] URL
- Hands-on - HO3 Week 6 : Design of an interaction URL
- Hands-On HO3 Week6 video on Switchtube URL
- Paper study assignment [shifted by one week to march 28th 23h55] Exercice Turnitin 2
  Please upload a pdf structured as follows :
  - 1 page = [min: 2400 , max: 3000] characters including spaces (use text editing tools to count characters)
  - Do not copy-paste any piece of text from the paper to study unless you make clear it is a citation (with double quotes).
  - you may have one image on page 1, only if it is essential to understand the paper.
  - the full reference of the studied paper appears at the beginning of page 3 and is referred to as [0] in page 1 and 2.
  - use numbered references like this [1] to spare space on pages 1 and 2.
  
  HEADER : your name + beginning of paper title/only first author/year.
  
  PAGE 1 : this page focuses on the contributions of the paper, highlighting a selection of key earlier papers [min: 2, max: 4] to show how the paper exploits them/ compares to them. At the bottom of the page, provide a 1-2 sentence(s) summary for each of the selected earlier papers. Follow this style :
  Paper [1] compares the effectiveness of.... with.... etc....
  
  PAGE 2 : includes your analysis of the citations of this paper by others (e.g. who, why, when) ; first indicate the tool you used and the total number of citations you found. Then make a selection of papers (min 4, max 8) to highlight a VARIETY of cases about how the field has evolved since the paper appeared in publication. Include the most cited paper among this selection. The VARIETY criteria will be assessed as follow:
  - no more than 2 references from authors of [0]
  - no more than 1 survey/review/book
  - time range of the chosen references should spread between [0] publication year and now ; let's note N the number of years since the publication of [0], then a maximum of half of the references should be in the N/2 years that followed the publication of [0].
  
  Provide an explicit subsection "Conclusion" stating your own viewpoint on the past and future evolution of the topic.
  
  PAGE 3 : list of the papers references used for pages 1and 2. For each numbered reference provide the paper title, publication year, author list, source of publication (conference, journal, book), publisher, volume and number (for journal) or chapter (for book), page numbers, and DOI (or a link to the internet location where you found the paper) so that we can find it easily.
Section 7
April 4th [1h teaching, the initially planned 2h TP]

R. Boulic 1h : Haptic interfaces (part1 & 2)
Hands-on week7
Section 8
April 11 th [1h teaching / 2h TP]

R. Boulic : Haptic Interfaces (part3) / The perception of Action (Part 1/2)
Hands-on HO5 Week8
Section 9
April 25 th [2 x 45 min]

R. Boulic : The perception of action (end)
R. Boulic : What makes an interactive virtual human alive (or plain zombies) [part 1/3 & 2/3]?
Section 10
May 2 nd [2 x45 min]
R. Boulic: What makes an interactive virtual human alive (or plain zombies) [part 3/3]?
R. Boulic: Motion capture for real-time interaction
Section 11
May 9 th [2h teaching] invited lecture from Dr Bruno Herbelin
B. Herbelin: Immersive Virtual Reality, Telepresence and their cognitive foundation / Embodied Virtual Reality (course material from B Herbelin from EPFL-LNCO)
Section 12
May 16 th: no course / time is dedicated to the mini-project
Section 13
May 23rd : Project Public Demo/PlayTesting in INF2 to everybody
This session helps to gather some playtesting feedback from other players that are not members of your group. It will help to refine some aspects before the final upload of the project.
- Final VR project submission Devoir
  The deadline for submitting the final version of the project is on May 25 at 23:55.
  
  The submission, only one per group, must contain the build of the game, the sources, the report, and the video of the project.
  
  Submission item list:
  
  Build of the game
  We will directly import your builds (i.e., games) in the .apk format to HMDs to evaluate your games.
  
  Sources
  We should be able to rebuild your game only based on the sources you provided to us.
  
  Report
  It should contain a short synopsis of the game with an illustration of the theme of the game (e.g., a screenshot of a characteristic moment in the game)
  Then the report would concisely describe the scenario followed by the interactions (e.g., how to trigger it, what it does, and how it manages to do it with a short description of the implementation, schemas are highly appreciated)
  Commands and cheat codes should be summarized in a short table.
  A short description of the playtesting session(s) and feedback should also be described (e.g., you can describe interactions you had to change if it was too complicated or tended to induce motion-sickness, who tested your game, what you learned/disliked from participants, etc.)
  You can put emphasis on the care you added to the graphics, the sounds, maintaining the theme of the game, or things you believe matter a lot to you while you develop the game.
  The report shouldn't be longer than 5 pages (except for exceptional caption)
  Finally, you can add short acknowledgments for your playtesters, friends, family, StackOverflow, etc.
  
  Pdf is highly recommended, although .doc or .odt are accepted.
  
  Video of the project
  This should be a short video ( <5 mins) showing the core parts of the game
  We don't expect a trailer with special effects.
  
  Usual formats are accepted, and if the video is too heavy, it can be submitted as a link in a file to a video-sharing platform.
  N.B. Let us know in case you do not want it to be posted on any video-sharing platform in the future (mathias.delahaye@epfl.ch)
  
  Submission methods:
  
  Archive
  The submission archive must be a single .zip archive file named 2022_cs444_vr_project_group_XX.zip, where XX is the group number and must contain the following items:
  - ./build.apk : the build
  - ./sources : the folder containing the unity project (with the code and all assets)
  - ./report.pdf : the report
  - ./video.mp4 : the video
  
  EPFL's GitLab
  ⚠️You must warn us and share the project URL in advance (before May 25 at 20:00) so that we can fork it at the expected deadline.
  You must invite us to the project (mdelahay, ntian, boulic, or using emails) as project members with at least the Developer role.
  The fork will be performed at the deadline; therefore, changes until then will be taken into account.
  (i.e., sending the invite is not the final upload, it does not freeze the state of the project, you can still push changes until the deadline)
  
  The project repository, containing the application code and all assets, must also contain the following items:
  - ./build.apk : the build (not within the Build folder as the .gitignore policy would discard it)
  - ./report.pdf : the report
  - ./video.mp4 : the video
  
  This repository should be named 2022_cs444_vr_project_group_XX, where XX is the group number .
Section 14
May 30th: Final Individual Oral Exams for theory between 8h00 to 13h00 and 13h30 to 18h50 in presential in INJ 141.
May 30th: Project Group Presentation between 8hxx to 11h30/12h00 and 12h30/13h00 to xxh00 in presential in INF2 or another room to be confirmed during week 13.
Given the high number of students, the individual oral on the project code (smoke detector) will be spread during week 14.
- Project evaluation protocol:
  Whole group presentation
  These sessions are on May 30th in BC129 from 9 a.m. to 4 p.m. and each session lasts for 15mins.
  ⚠️ Please register here (one per group): https://www.needtomeet.com/meeting?id=f3xqz8qsV⚠️
  
  Sessions start with a 10 mins group presentation during which you will explain your game, key elements of its conception, etc.
  Slides should be prepared (+/- 10 slides is a good target)
  This will allow you to defend your work and justify choices in the conception of the game.
  During the oral presentation, you should not perform any live demo as it would be too expensive in terms of time.
  The presentation should be a kind of a short story; therefore, you should ask yourself what message you want to give through this presentation and how to transmit it clearly.
  A good way to check that the message is correctly received is to present your presentation to external friends, family, etc., and then ask them what the message of your presentation was.
  If they can tell you the same message you intended to share, you're on the right path.
  Otherwise, you might consider changing slides/discarding details, ensuring the transition works between slides, etc.
  
  This presentation is followed by 5 mins of Questions and Answers during which we will ask you questions based on your presentation or your game.
  
  Finally, before leaving please give us back the HMD with the full set.
  
  Individual smoke detection session
  These sessions are on the 14th week in INJ118 / INJ139 / INJ140 (those rooms are next to each other) and each session lasts for 5mins.
  ⚠️ Please register here (one per student): https://docs.google.com/spreadsheets/d/14U7O0-lZAfdZyTgnUwJduVzn95oC4KXUUE84g735Nbs/edit?usp=sharing ⚠️
  
  During these individual sessions, you are assessed for 5 mins on your contribution to the project.
  You will be asked questions relative to the parts on which you worked.
  There is no need to prepare anything for this.
- Final theoretical oral exam protocol:
  
  DURATION : 10 min.
  
  No preparation period because the core topic is the paper chosen for the paper study report
  
  Structure of the oral control (see criteria below):
  
  - 1 min : transition between students
  
  - 3 min of oral presentation by the student to present his/her paper study
  
  ----> Contributions over the state of the art and topic evolution
  Optional: you are allowed to have up to 3 slides : one for summary of contribution, one for citation analysis and one for your personal conclusion
  
  - 6 min of questions/discussion
  
  ----> start on the paper topic and the background knowledge of the project,
  
  ----> evaluate also more general VR background knowledge
  
  ----> evaluate your capability to generalize and/or imagine new applications
  
  ALLOWED material during the oral :
  - Open book: your paper study, printed or written material on the course, demos, personal notes
  - the optional 3 slides.
  
  remark from past years experience: if you spend more than 3 min on your paper study (1/3 of the grade), it gives you less time for us to evaluate other VR topics and your capability to generalize and imagine new applications. Hence you penalize yourself on the remaining 2/3 of the grade.
- May 30th theoretical oral exam in INJ 141: single time slot choice (10 min) between 8h and 19h Sondage
  Only the student registered to the course are allowed to fill this form.
  The sooner, the more choice for you.
- Grades of the final theoretical oral exam Fichier

Lundi	Mardi	Mercredi	Jeudi	Vendredi	Samedi	Dimanche
		Aucun événement, mercredi 1 juin	Aucun événement, jeudi 2 juin	Aucun événement, vendredi 3 juin	Aucun événement, samedi 4 juin	Aucun événement, dimanche 5 juin
Aucun événement, lundi 6 juin	Aucun événement, mardi 7 juin	Aucun événement, mercredi 8 juin	Aucun événement, jeudi 9 juin	Aucun événement, vendredi 10 juin	Aucun événement, samedi 11 juin	Aucun événement, dimanche 12 juin
Aucun événement, lundi 13 juin	Aucun événement, mardi 14 juin	Aucun événement, mercredi 15 juin	Aucun événement, jeudi 16 juin	Aucun événement, vendredi 17 juin	Aucun événement, samedi 18 juin	Aucun événement, dimanche 19 juin
Aucun événement, lundi 20 juin	Aucun événement, mardi 21 juin	Aucun événement, mercredi 22 juin	Aucun événement, jeudi 23 juin	Aucun événement, vendredi 24 juin	Aucun événement, samedi 25 juin	Aucun événement, dimanche 26 juin 26
Aucun événement, lundi 27 juin	Aucun événement, mardi 28 juin	Aucun événement, mercredi 29 juin	Aucun événement, jeudi 30 juin

Virtual reality

Aperçu des sections

Généralités

Virtual Reality

GRADING SCHEME

DETAILED SCHEDULE(2021-22)

Section 1

Section 2

Section 3

The game design document is maximum two pages. This is not graded ; it will be used to provide better feedback during the pitch session in week 5.

Please Mark your group_id in the pdf name and your document title.

Section 4

Section 5

Section 6

Section 7

Section 8

Section 9

Section 10

Section 11

Section 12

Section 13

Section 14