Robotic Vision (English) - 105 Academic Year

本課程是由 國立陽明交通大學電機工程學系 提供。

This course covers fundamental and advanced domains in vision for mobile robots, including topics from early vision to mid- and high-level vision. We will use "Duckietown" (an open course "MIT 2.166 Autonomous Vehicles) as platform, and students will form teams to develop vision-based projects, including mobile robots, assistive robots, or VR.

(This course is taught in English.)

Textbook:
1. Computer Vision: Algorithms and Applications, Richard Szeliski, Springer, 2010.
2. Robotics, Vision, and Control, Peter Croke, Springer, 2011.
3. Introduction to Autonomous Robots, Nikolaus Correll, 2015.
4. Virtual Reality, Steven M. LaValle, 2016.

For perfect learning results, please buy textbooks!

Instructor(s) College of Electrical and Computer Engineering Prof. Nick Wang
Course Credits 3 Credits
Academic Year 105 Academic Year
Level Graduate Student
Prior Knowledge This course involve a fair amount of probability, linear algebra, and programming. Students who took image processing, computer vision, and creative software project are encouraged to join, but not required. Being familiar
Related Resources Course Video   Course Syllabus   Course Calendar 

WeekCourse ContentCourse Video
單元1 Introduction to Robotic VisionWatch Online
單元2 Duckietown,Robotic Vision for Assistive TechnologyWatch Online
單元3 AprilTagsWatch Online
單元4 Objection Detection and EvaluationWatch Online
單元5 Mid-Level FeaturesWatch Online
單元6 High-Level FeaturesWatch Online
單元9 Sensor Data, RANSAC, FORVISWatch Online
單元10 RANSAC, ICPWatch Online
單元11 Navigation Overview, GazeboWatch Online
單元12 The Map and World Model (2D, 3D Mapping)Watch Online
單元13 Robot ModelWatch Online
單元14 Duckietown ReviewWatch Online
【報告1 In-Class Tutorial】
Jupyter & python
Watch Online
【報告2 In-Class Tutorial】
Object Detector
Watch Online
【報告3 In-Class Tutorial】
Gazebo Simulation
Watch Online
【報告4 In-Class Tutorial】
Caffe Tutorial
Watch Online
【報告5 In-Class Tutorial】
PCL & LCM Tutorial
Watch Online
【報告6 In-Class Tutorial】
PCL Segmentation
Watch Online
【報告7 In-Class Tutorial】
Visual Odometry
Watch Online
【報告8 In-Class Tutorial】
Visual Odometry

【報告9 In-Class Tutorial】
Watch Online
【報告9 In-Class Tutorial】
Husky
Watch Online
【報告10 In-Class Tutorial】
Rosserial Arduino & Encoder Visualization
Watch Online
【報告11 In-Class Tutorial】
Tensorflow
Watch Online
【報告12 In-Class Tutorial】
Multicamera System (Eye to Hand System)
Watch Online
【期中報告】
Group:Team1
Topic:Virtual Reality Simulation
Group member:林哲民、林倪敬
Watch Online
【期中報告】
Group:Team2
Topic:Guidedog Robot
Group member:洪禎浩、陳季希、郭昌易
Watch Online
【期中報告】
Group:Team3
Topic:Smart Home Security Robot
Group member:陳冠宏、蕭詩穎
Watch Online
【期中報告】
Group:Team4
Topic:Consultant Robot
Group member:黃鴻銘、羅少鴻
Watch Online
【期中報告】
Group:Team5
Topic:3D Prediction
Group member:蘇詠善、鄧駿智、歐彥宏
Watch Online
【期中報告】
Group:Team6
Topic:ROBO-Cleaner
Group member:Wongsatorn、Samir、Timothius
Watch Online
【期中報告】
Group:Team7
Topic:Object Recognition
Group member:章宇賢、賴昱廷
Watch Online
【期中報告】
Group:Team8
Topic:Autonomous Lift Riding Robot
Group member:Yury
Watch Online
【期中報告】
Group:Team9
Topic:Multicamera system (Eye to Hand system)
Group member:鄧至普、鄭景鴻
Watch Online
【期中報告】
Group:Team10
Topic:Reinforcement learning
Group member:詹巧同、練怡均
Watch Online
【期末報告】
Group:Team1
Topic:Virtual Reality Simulation
Group member:林哲民、林倪敬
Watch Online
【期末報告】
Group:Team2
Topic:Guidedog Robot
Group member:洪禎浩、陳季希、郭昌易
Watch Online
【期末報告】
Group:Team3
Topic:Smart Home Security Robot
Group member:陳冠宏、蕭詩穎
Watch Online
【期末報告】
Group:Team4
Topic:Consultant Robot
Group member:黃鴻銘、羅少鴻
Watch Online
【期末報告】
Group:Team5
Topic:3D Prediction
Group member:蘇詠善、鄧駿智、歐彥宏
Watch Online
【期末報告】
Group:Team6
Topic:ROBO-Cleaner
Group member:Wongsatorn、Samir、Timothius
Watch Online
【期末報告】
Group:Team7
Topic:Object Recognition
Group member:章宇賢、賴昱廷
Watch Online
【期末報告】
Group:Team8-1
Topic:Autonomous Lift Riding Robot
Group member:Alex
Watch Online
【期末報告】
Group:Team8-2
Topic:Autonomous Lift Riding Robot
Group member:Yury
Watch Online
【期末報告】
Group:Team9
Topic:Multicamera system (Eye to Hand system)
Group member:鄧至普、鄭景鴻
Watch Online
【期末報告】
Group:Team10
Topic:Reinforcement learning
Group member:詹巧同、練怡均
Watch Online

課程目標

This course covers fundamental and advanced domains in vision for mobile robots, including topics from early vision to mid- and high-level vision. We will use "Duckietown" (an open course "MIT 2.166 Autonomous Vehicles) as platform, and students will form teams to develop vision-based projects, including mobile robots, assistive robots, or VR.

 

課程章節

章節 章節內容
單元一Introduction to Robotic Vision
單元二Duckietown,Robotic Vision for Assistive Technology
單元三 AprilTags
單元四Objection Detection and Evaluation
單元Mid-Level Features
單元六 High-Level Features
單元九Sensor Data, RANSAC, FORVIS
單元十RANSAC, ICP
單元十一Navigation Overview, Gazebo
單元十二 The Map and World Model (2D, 3D Mapping)
單元十三Robot Model
單元十四Duckietown Review


課程書目

Computer Vision: Algorithms and Applications, Richard Szeliski, Springer, 2010.
Robotics, Vision, and Control, Peter Croke, Springer, 2011.
Introduction to Autonomous Robots, Nikolaus Correll, 2015.
Virtual Reality, Steven M. LaValle, 2016

 

評分標準

學期作業
The assignments include problem sets, and the process of writing and reviewing a research paper. Students form teams, with 2-3 people.
Each team can choose either a challenge or project to improve existing method to an existing problem or consider non-traditional problems.

考試狀況
There will be midterm/final exams and in-class quiz.

評量方法
Exam (20%),
Class Participation, In Class Quiz, Problem Sets (10%),
Final presentation (10%)
Project Research Paper (50%)

本課程行事曆提供課程進度與考試資訊參考。

學期週次
上課日期
參考課程進度

第一週

2017/02/13
  • Introduction to Robotic Vision
第二週2017/02/20
  • Duckietown, Robotic Vision for Assistive Technology
第三週2017/02/27
  • Holiday 
第四週2017/03/06
  • AprilTags
第五週2017/03/13
  • Objection Detection and Evaluation
第六週2017/03/20
  • Mid-Level Features 
第七週2017/03/27
  • High-Level Features
第八週2017/04/03
  • No Class 
第九週2017/04/10
  • Midterm Discussion
第十週2017/04/17
  • Sensor Data, RANSAC, FORVIS
第十一週2017/04/24
  • RANSAC, ICP
第十二週2017/05/01
  • Midterm Presentation
第十三週2017/05/08
  • Navigation Overview, Gazebo
第十四週2017/05/15
  • The Map and World Model (2D, 3D Mapping)
第十五週2017/05/22
  • Robot Model
第十六週2017/05/29
  • Holiday  
第十七週2017/06/05
  • Duckietown Review
第十八週2017/06/12
  • Final Presentation