Computer Vision Laboratory (CVL)

If you intend to take the course but are not registered, make sure to register ASAP in Ladok, using the Student portal. You need to be registered on the course to receive course email, and to have results registered in Ladok. If you take the course but are not registered to any program at Linköping University, please contact the course examiner in order to make sure that you receive email about the course.

This course is worth 12 ECTS credits, which corresponds to approximately 320h of work per student. The time is divided among the following activities:

More details can be found in Studieinfo (the web interface to the Bilda course database).

• Per-Erik Forssén, lectures, examiner
• Michael Felsberg, lectures
• Mårten Wadenbäck, lectures

• Zahra Gharaee, computer exercises (VT1&VT2)
• Johan Edstedt, computer exercises (VT1&VT2)
• Gustav Häger, computer lessons, project guide (VT1&VT2)
• Karl Holmqvist, project guide (VT1&VT2)
• Pavlo Melnyk, project guide (VT1&VT2)

We all have our offices in the B-building, ground floor. Teacher offices are in corridor D (rooms 2D:513 to 2D:527), assistant offices are in Visionen. We recommend the use of email to request meetings.

In the course we will mainly use the following two books:

1. Richard Szeliski, Computer Vision: Algorithms and Applications, Springer Verlag (2011).
   This book covers topics such as tracking, optical flow and image features.
   The book is available as an on campus e-book via the LiU library. See also Book webpage.
2. Klas Nordberg, Introduction to Representations and Estimation in Geometry (IREG).
   This compendium covers only the 3D geometry part of the course.

Other topics covered in the course, such as background models are missing from these two. For side reading on other topics, we have collected pointers to relevant literature in the column "Material" in both of the "Lecture and Lab schedules" below. A few texts are in the course TSBB15 GIT repository.

• 2021-03-23, 14-18: Re-examination opportunity for last year's students (TEN1), and voluntary mid-term examination for this years's students (KTR1).
• 2021-06-01, 14-18: Examination at end of course.
• 2021-08-17, 8-12: Re-examination opportunity. Note: this exam will be on site.

The Lisam course room for 2021.

Old exams

The exams from 2018, 2019 and 2020 in TSBB15 can be found here.

How to use the old exams: We recommend that you use these exams as pointers into the literature ("instuderingsfrågor"). To answer the exam, read corresponding discussions in your notes, the course book, and the lecture slides. While it is faster to look at other people's exam answers, this merely gives you answers, while reading and thinking also results in understanding.

Grades

How to pass the course, and the grading criteria are described here.

• The course schedule for TSBB15 can be found in TimeEdit.
• A more detailed schedule for VT1, with reading material is given below.
  The course content is similar to last year's course, so you may want to look there for details (e.g. slides). Updated slides for this year will be added below, after each lecture.

• IREG = Introduction to Representations and Estimation in Geometry, LiU compendium, Klas Nordberg
• TOOL = Mathematical Toolbox for studies in Visual Computing at Linköping University, LiU compendium, Klas Nordberg
• CVAA = Richard Szeliski, "Computer Vision: Algorithms and Applications" (2011). The book is available as an on campus e-book via the LiU library. See also Book webpage.
• SHB = Sonka, Hlavac and Boyle "Image Processing, Analysis, and Machine Vision" (Old course book)
• GW = Gonzalez and Woods, "Digital Image Processing"
• HZ = Hartley and Zisserman, "Multiple View Geometry in Computer Vision" (2nd edition 2003). Available as e-book from LiU library
• Wikipedia = Search wikipedia for the listed term
• Mathworld = Search http://mathworld.wolfram.com/ for the listed term.
• Edupack - orientation is a tutorial found here
• EDUPACK2 = orientation2.pdf
• RNDF = J. Weickert: A Review of Nonlinear Diffusion filtering, Scale-Space 1997

• The course schedule for TSBB15 can be found in TimeEdit.
• A more detailed schedule for VT2, with reading material is given below.
  The course content is similar to last year's course, so you may want to look there for details (e.g. slides). Updated slides for this year will be added below, after each lecture.

The two projects are conducted in groups of 5, 4 or 3 students (in order of preference). We aim for 5 project groups this year. Assignment into groups is made on the introductory lecture for project 1.

List of project groups VT2021

• Project 1: Tracking
  Introductory lecture on February 5
  Design plan due February 12
  Report due March 25 (checked by guide before that)
  Presentation seminar on March 30
  

• Project 2: 3D Reconstruction
  Introductory lecture on April 6
  Design plan due April 14
  Report due May 20 (checked by guide before that)
  Presentation seminar on May 25
  

General resources

We suggest and allow you to use the following software:

• OpenCV (Open Source Computer Vision). Version 3.4.3 is installed on the department's Linux computers (first you need to issue the module add prog/opencv/3.4.3 command). See also the minimal example OpenCV progam (contributed by Gustav Häger).
  Read the section on OpenCV in the hints and pitfalls page. There is a cheat sheet for OpenCV. An important exception is the Background modelling with mixtures of Gaussians, which you are NOT allowed to use (as you're supposed to learn this in the course).
• Python with OpenCV bindings. Python 3.6.9 is installed in the computer labs. Essential libraries such as Matplotlib, NumPy, and SciPy are also available.
• VLFeat has a a useful code library, both for Matlab and C/C++. For example, it has an alternative implementation of SIFT, and also an implementation of MSER. Both are made by Andrea Vedaldi.
• The Visual Geometry Group at Oxford University maintains code for affine invariant region detectors, produced in cooperation with other groups.
• The Computer Vision Laboratory at ETH provides an implementation of SURF.
• An IDE, e.g. PyCharm community edition, which is installed in the computer labs after loading the right module (see module avail) (remember to say no to creation of a shortcut on /usr/local when you start pycharm).

Project repositories

Project code should be developed under versioning control, with changes tracked according to LiU-ID of the participating group members.

• Project groups should create their repositories in the LiU Git. Note: this is not GitHub, and GitHub should not be used.
• Project guides and examiner should be given "reporter" access to the group repositories.

Hints and pitfalls

Based on experience from previous year's projects, we have accumulated a list of hints and pitfalls for the projects. Read them carefully before starting your project work.