Robotic Vision (English) - 105 Academic Year

機器人視覺 (English) - 105學年度

本課程是由 國立陽明交通大學電機工程學系 提供。

This course covers fundamental and advanced domains in vision for mobile robots, including topics from early vision to mid- and high-level vision. We will use "Duckietown" (an open course "MIT 2.166 Autonomous Vehicles) as platform, and students will form teams to develop vision-based projects, including mobile robots, assistive robots, or VR.

(This course is taught in English.)

 

課程用書:
1. Computer Vision: Algorithms and Applications, Richard Szeliski, Springer, 2010.
2. Robotics, Vision, and Control, Peter Croke, Springer, 2011.
3. Introduction to Autonomous Robots, Nikolaus Correll, 2015.
4. Virtual Reality, Steven M. LaValle, 2016.

為求學習成效完美,請購買課本!

 

授課教師 電機工程學系 王學誠老師
課程學分 3學分
授課年度 105學年度
授課對象 研究生
預備知識 This course involve a fair amount of probability, linear algebra, and programming. Students who took image processing, computer vision, and creative software project are encouraged to join, but not required. Being familiar
課程提供 課程影音   課程綱要   課程行事曆 

週次課程內容課程影音課程下載
單元1 Introduction to Robotic Vision線上觀看MP4下載
單元2 Duckietown,Robotic Vision for Assistive Technology線上觀看MP4下載
單元3 AprilTags線上觀看MP4下載
單元4 Objection Detection and Evaluation線上觀看MP4下載
單元5 Mid-Level Features線上觀看MP4下載
單元6 High-Level Features線上觀看MP4下載
單元9 Sensor Data, RANSAC, FORVIS線上觀看MP4下載
單元10 RANSAC, ICP線上觀看MP4下載
單元11 Navigation Overview, Gazebo線上觀看MP4下載
單元12 The Map and World Model (2D, 3D Mapping)線上觀看MP4下載
單元13 Robot Model線上觀看MP4下載
單元14 Duckietown Review線上觀看MP4下載
【報告1 In-Class Tutorial】
Jupyter & python
線上觀看MP4下載
【報告2 In-Class Tutorial】
Object Detector
線上觀看MP4下載
【報告3 In-Class Tutorial】
Gazebo Simulation
線上觀看MP4下載
【報告4 In-Class Tutorial】
Caffe Tutorial
線上觀看MP4下載
【報告5 In-Class Tutorial】
PCL & LCM Tutorial
線上觀看MP4下載
【報告6 In-Class Tutorial】
PCL Segmentation
線上觀看MP4下載
【報告7 In-Class Tutorial】
Visual Odometry
線上觀看MP4下載
【報告8 In-Class Tutorial】
Visual Odometry

【報告9 In-Class Tutorial】
線上觀看MP4下載
【報告9 In-Class Tutorial】
Husky
線上觀看MP4下載
【報告10 In-Class Tutorial】
Rosserial Arduino & Encoder Visualization
線上觀看MP4下載
【報告11 In-Class Tutorial】
Tensorflow
線上觀看MP4下載
【報告12 In-Class Tutorial】
Multicamera System (Eye to Hand System)
線上觀看MP4下載
【期中報告】
Group:Team1
Topic:Virtual Reality Simulation
Group member:林哲民、林倪敬
線上觀看MP4下載
【期中報告】
Group:Team2
Topic:Guidedog Robot
Group member:洪禎浩、陳季希、郭昌易
線上觀看MP4下載
【期中報告】
Group:Team3
Topic:Smart Home Security Robot
Group member:陳冠宏、蕭詩穎
線上觀看MP4下載
【期中報告】
Group:Team4
Topic:Consultant Robot
Group member:黃鴻銘、羅少鴻
線上觀看MP4下載
【期中報告】
Group:Team5
Topic:3D Prediction
Group member:蘇詠善、鄧駿智、歐彥宏
線上觀看MP4下載
【期中報告】
Group:Team6
Topic:ROBO-Cleaner
Group member:Wongsatorn、Samir、Timothius
線上觀看MP4下載
【期中報告】
Group:Team7
Topic:Object Recognition
Group member:章宇賢、賴昱廷
線上觀看MP4下載
【期中報告】
Group:Team8
Topic:Autonomous Lift Riding Robot
Group member:Yury
線上觀看MP4下載
【期中報告】
Group:Team9
Topic:Multicamera system (Eye to Hand system)
Group member:鄧至普、鄭景鴻
線上觀看MP4下載
【期中報告】
Group:Team10
Topic:Reinforcement learning
Group member:詹巧同、練怡均
線上觀看MP4下載
【期末報告】
Group:Team1
Topic:Virtual Reality Simulation
Group member:林哲民、林倪敬
線上觀看MP4下載
【期末報告】
Group:Team2
Topic:Guidedog Robot
Group member:洪禎浩、陳季希、郭昌易
線上觀看MP4下載
【期末報告】
Group:Team3
Topic:Smart Home Security Robot
Group member:陳冠宏、蕭詩穎
線上觀看MP4下載
【期末報告】
Group:Team4
Topic:Consultant Robot
Group member:黃鴻銘、羅少鴻
線上觀看MP4下載
【期末報告】
Group:Team5
Topic:3D Prediction
Group member:蘇詠善、鄧駿智、歐彥宏
線上觀看MP4下載
【期末報告】
Group:Team6
Topic:ROBO-Cleaner
Group member:Wongsatorn、Samir、Timothius
線上觀看MP4下載
【期末報告】
Group:Team7
Topic:Object Recognition
Group member:章宇賢、賴昱廷
線上觀看MP4下載
【期末報告】
Group:Team8-1
Topic:Autonomous Lift Riding Robot
Group member:Alex
線上觀看MP4下載
【期末報告】
Group:Team8-2
Topic:Autonomous Lift Riding Robot
Group member:Yury
線上觀看MP4下載
【期末報告】
Group:Team9
Topic:Multicamera system (Eye to Hand system)
Group member:鄧至普、鄭景鴻
線上觀看MP4下載
【期末報告】
Group:Team10
Topic:Reinforcement learning
Group member:詹巧同、練怡均
線上觀看MP4下載
 

課程目標

This course covers fundamental and advanced domains in vision for mobile robots, including topics from early vision to mid- and high-level vision. We will use "Duckietown" (an open course "MIT 2.166 Autonomous Vehicles) as platform, and students will form teams to develop vision-based projects, including mobile robots, assistive robots, or VR.

 

課程章節

章節 章節內容
單元一Introduction to Robotic Vision
單元二Duckietown,Robotic Vision for Assistive Technology
單元三 AprilTags
單元四Objection Detection and Evaluation
單元Mid-Level Features
單元六 High-Level Features
單元九Sensor Data, RANSAC, FORVIS
單元十RANSAC, ICP
單元十一Navigation Overview, Gazebo
單元十二 The Map and World Model (2D, 3D Mapping)
單元十三Robot Model
單元十四Duckietown Review


課程書目

Computer Vision: Algorithms and Applications, Richard Szeliski, Springer, 2010.
Robotics, Vision, and Control, Peter Croke, Springer, 2011.
Introduction to Autonomous Robots, Nikolaus Correll, 2015.
Virtual Reality, Steven M. LaValle, 2016

 

評分標準

學期作業
The assignments include problem sets, and the process of writing and reviewing a research paper. Students form teams, with 2-3 people.
Each team can choose either a challenge or project to improve existing method to an existing problem or consider non-traditional problems.

考試狀況
There will be midterm/final exams and in-class quiz.

評量方法
Exam (20%),
Class Participation, In Class Quiz, Problem Sets (10%),
Final presentation (10%)
Project Research Paper (50%)

本課程行事曆提供課程進度與考試資訊參考。

學期週次
上課日期
參考課程進度

第一週

2017/02/13
  • Introduction to Robotic Vision
第二週2017/02/20
  • Duckietown, Robotic Vision for Assistive Technology
第三週2017/02/27
  • Holiday 
第四週2017/03/06
  • AprilTags
第五週2017/03/13
  • Objection Detection and Evaluation
第六週2017/03/20
  • Mid-Level Features 
第七週2017/03/27
  • High-Level Features
第八週2017/04/03
  • No Class 
第九週2017/04/10
  • Midterm Discussion
第十週2017/04/17
  • Sensor Data, RANSAC, FORVIS
第十一週2017/04/24
  • RANSAC, ICP
第十二週2017/05/01
  • Midterm Presentation
第十三週2017/05/08
  • Navigation Overview, Gazebo
第十四週2017/05/15
  • The Map and World Model (2D, 3D Mapping)
第十五週2017/05/22
  • Robot Model
第十六週2017/05/29
  • Holiday  
第十七週2017/06/05
  • Duckietown Review
第十八週2017/06/12
  • Final Presentation