> For the complete documentation index, see [llms.txt](https://x.ancorasir.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://x.ancorasir.com/me336/2021-spring/me336-collaborative-robot-learning.md).
# \[ME336] Collaborative Robot Learning
2021 Spring
## Course Description
This course is intended for students advancing in the study of robotic engineering. The focus is on the problems of how a robot can learn to perceive the physical world well enough to act in it and make reliable plans. Subjects covered by this course include robotic collaboration, kinematics, robotic vision, calibration, RGB-D sensing, object recognition, artificial intelligence (AI), and deep learning (DL). Specific projects will be carried out throughout this course regarding the simulation of robot picking using fundamental kinematics and robot vision, an AI robot to play tic-tac-toe game, and a DL robot to play arcade claw game.
Related information regarding this course:
* This course was also offered in [Spring, 2019](https://ancorasir.com/?page_id=1310) and [Spring, 2020](https://ancorasir.com/?page_id=2320).
* [The Machine Intelligence Design and Learning Lab](https://maindl.ancorasir.com/).
* [ME336 Robotics & AI Guest Lecture Series](https://ancorasir.com/?cat=35).
{% columns %}
{% column %}
{% endcolumn %}
{% column %}
{% endcolumn %}
{% column %}
{% endcolumn %}
{% endcolumns %}
## Teaching Goals
* To teach students how to conduct the basic kinematic formulation of a robotic system in simulation.
* To teach students how to use robotic vision, including algorithms, hardware, and software, in simulation.
* To teach students how to program artificial intelligence into robot hardware performing interactive tasks.
* To teach students how to use deep learning methods to program robot hardware to perform advanced tasks.
* To reinforce students’ team skills through various team projects, including problem formulation, problem solutions, and written reporting of results.
* To reinforce students’ visualization and handsÂ-on skills through project virtual prototyping and/or physical construction exercises.
## Co-Requisite Courses
* MEE5101 Introduction to Robotics and Automation
* MEE5104 Robotic Modeling and Control
## Course Instructor & Teaching Team
{% columns %}
{% column %}
Song Chaoyang
{% endcolumn %}
{% column %}
Wan Fang
{% endcolumn %}
{% column %}
Liu Xiaobo
{% endcolumn %}
{% column %}
Sun Haoran
{% endcolumn %}
{% endcolumns %}
{% columns %}
{% column %}
{% endcolumn %}
{% column %}
{% endcolumn %}
{% column %}
{% endcolumn %}
{% column %}
{% endcolumn %}
{% endcolumns %}
{% columns %}
{% column %}
{% endcolumn %}
{% column %}
{% endcolumn %}
{% column %}
{% endcolumn %}
{% column %}
{% endcolumn %}
{% endcolumns %}
## Grading Policy
* Assignment Project #1: 30%
* Assignment Project #2: 30%
* Course Project: 30%
* Individual Marking: 10%
## Teaching Schedule
* Wednesday 1400-1550, Room 235, New Engineering Building
* Friday 0800-0950, Room 235, New Engineering Building
### Week 01
* W01-C01 | [**L01-Course Introduction**](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2FkmtHBLPpoJDILaEA2983%2F2021Spring-ME336-Wk01-3-Lecture01-Course-Introduction-compressed.pdf?alt=media\&token=6c842264-b62d-481a-bd9e-84fc62318e0f) | Wed Jan 13, 1400-1550
* W01-C02 | [**L02-CoBot Designs**](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2FxY4N5kvvp6iXCNky5r2F%2F2021Spring-ME336-Wk01-5-Lecture02-Collaborative-Robots-compressed.pdf?alt=media\&token=aab78c99-46e7-4f67-aa39-fd728dc6c785) | Fri Jan 15, 0800-0950
### Week 02
* W02-C03 | [**P01-Project Overview**](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2Fl0pXWN8407PQVJN5amfo%2F2021Spring-ME336-Wk02-5-Lab01-Project-Overview-compressed.pdf?alt=media\&token=bdcf5e42-1722-4729-aef8-403757a76bf0) / [**G01-He Weipeng**](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2FyCkkOLBEh7oFHvC8djv0%2F2021-guest-lecture-01.jpeg?alt=media\&token=3380a0fd-b80b-4857-b35d-b36c6c0bfa5a) | Wed Jan 20, 1400-1550
* W02-C04 | [**L03-Robot Perception**](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2FUlWpGN5XrkoyFdwkFUSM%2F2021Spring-ME336-Wk02-3-Lecture03-Robot-Perception-compressed.pdf?alt=media\&token=22fbd466-27ca-48fb-ae2e-b87e32e0822b) | Fri Jan 22, 0800-0950
### Week 03
* W03-C05 | [**L04-Machine Learning I**](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2F6mqraok1wyk1r4fZ8Dmr%2F2021Spring-ME336-Wk03-3-Lecture04-Machine-Learning-I.pdf?alt=media\&token=4e0187bc-21cc-445b-ab80-5d91776a874b) | Wed Mar 03, 1400-1550
* W03-C06 | **P02-DeepClaw Tutorial** | Fri Mar 05, 0800-0950
### Week 04
* W04-C07 | [**L05-Machine Learning II**](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2FXvZHS6FgFFSTxgfg4wci%2F2021Spring-ME336-Wk04-3-Lecture05-Machine-Learning-II.pdf?alt=media\&token=1c50011e-6b66-4861-a0b1-60e88daa6c6d) | Wed Mar 10, 1400-1550
* W04-C08 | **P03-Hand-eye Calibration** | Fri Mar 12, 0800-0950
### Week 05
* W05-C09 | [**L06-Deep Networks I**](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2Fktb7todfWpY8xpAvLD0b%2F2021Spring-ME336-Wk05-3-Lecture06-Deep-Networks-I.pdf?alt=media\&token=85905fd0-611c-44f9-ad43-66538bca3739) | Wed Mar 17, 1400-1550
* W05-C10 | **P04-Assignment Project 1** | Fri Mar 19, 0800-0950
### Week 06
* W06-C11 | [**L07-Deep Networks II**](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2F1177AkrjQtpzgGBTKjd2%2F2021Spring-ME336-Wk06-3-Lecture07-Deep-Networks-II.pdf?alt=media\&token=58aa76c0-e187-4e3c-9d5f-8813d55bc127) | Wed Mar 24, 1400-1550
* W06-C12 | **P05-Assignment Project 1** | Fri Mar 26, 0800-0950
### Week 07
* W07-C13 | [**L08-Network Tuning I**](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2F3K57iV0kewlgiHxDECEX%2F2021Spring-ME336-Wk07-3-Lecture08-Network-Tuning-I.pdf?alt=media\&token=5b99370a-e36d-4bfc-bc14-440fafe688ac) | Wed Mar 31, 1400-1550
* W07-C14 | **P06-Data Collection** | Fri Apr 02, 0800-0950
### Week 08
* W08-C15 | [**L09-Network Tuning II**](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2FSFauaMitOGTSrWhuibbS%2F2021Spring-ME336-Wk08-3-Lecture09-Network-Tuning-II.pdf?alt=media\&token=ab1eef79-6d54-4519-93fc-cbcd3739b783) | Wed Apr 07, 1400-1550
* W08-C16 | **P07-Assignment Project 2** | Fri Apr 09, 0800-0950
### Week 09
* W09-C17 | [**L10-Markovian Models I**](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2FrcWGMpMg0cxsem3jAbqm%2F2021Spring-ME336-Wk09-3-Lecture10-Markovian-Modeling-I.pdf?alt=media\&token=a68f9f3d-1887-4d43-b7b8-0cc623077d8f) | Wed Apr 14, 1400-1550
* W09-C18 | **P08-Assignment Project 2** | Fri Apr 16, 0800-0950
### Week 10
* W10-C19 | [**L11-Markovian Models II**](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2FfVDSoN26Snk2ZQ1Ghj5H%2F2021Spring-ME336-Wk10-3-Lecture11-Markovian-Modeling-II-compressed.pdf?alt=media\&token=5955132f-70f3-4498-8292-68bda50bd825) | Wed Apr 21, 1400-1550
* W10-C20 | **P09-Project 3 Review** | Fri Apr 23, 0800-0950
### Week 11
* W11-C21 | **L12-Reinforcement Learning** | Wed Apr 28, 1400-1550
* W11-C22 | **P10-Assignment Project 3** | Fri Apr 30, 0800-0950
### Week 12
* W12 | **No Class** | Wed May 05, 1400-1550
* W12-C23 | **P11-Assignment Project 3** | Fri May 07, 0800-0950
### Week 13
* W13-C24 | [**G03-Wang Tao**](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2FG23kpxCXA43PYrZePile%2F2021-guest-lecture-02.jpeg?alt=media\&token=4a449c84-0f3a-467e-9630-70e045ccbb75) | Wed May 12, 1400-1550
* W13-C25 | **P12-Assignment Project 3** | Fri May 14, 0800-0950
### Week 14
* W14-C26 | [**G02-Wang Guangneng**](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2FTkjUraqcgvAcL9GE8Ltq%2F2021-guest-lecture-03.jpeg?alt=media\&token=3be6e999-4249-4318-8f39-85d417820580) | Wed May 19, 1400-1550
* W14-C27 | **P13-Assignment Project 3** | Fri May 21, 0800-0950
### Week 15
* W15-C28 | **P14-Final Report** | Wed May 26, 1400-1550
* W15-C29 | **P15-Final Presentation** | Fri May 28, 0800-0950
[Download original guest lecture posters (ZIP)](https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCBihtTWvgXohYIbSA4Fx%2Fuploads%2FlBMvHGEv6YyJt8yyBOIM%2FME336-2021-Guest-Lecture-Posters-Originals.zip?alt=media\&token=6347397c-c78f-4031-9dad-a6e9e858f49e)
---
# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.
## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation by asking a question.
Perform an HTTP GET request on the following URL with the `ask` and `goal` query parameters:
```
GET https://x.ancorasir.com/me336/2021-spring/me336-collaborative-robot-learning.md?ask=&goal=
```
`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is what the user is ultimately trying to achieve, the reason they need the answer. Sharing it helps GitBook give you a better, more relevant answer. A goal is most helpful when it describes the outcome the user wants rather than restating the question. For example, with `ask=how do I create an API token`, a goal like `automate deployments from our CI pipeline` lets GitBook tailor the answer to that use case.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.
Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
