> For the complete documentation index, see [llms.txt](https://x.ancorasir.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://x.ancorasir.com/ds323/2022-autumn/ds323-ai-in-design.md).

# \[DS323] AI in Design

2022 Autumn

## Course Description

The goal of this course is to build a bridge between the discipline of design and that of artificial intelligence (AI). The course covers basic concepts and frameworks of artificial intelligence and its applications, including machine learning, deep learning, source of data, design process and decomposition of the design needs for technique requirements. This course is intended for design students aiming at shaping products and services powered by AI, leveraging vision-based intelligence, rigid-soft material interaction, generative design, and user interaction into user, business, and social value, promoting adoption of AI in design across disciplines. By the end of this course, the students should be able to communicate and collaborate with AI scientists and engineers while developing new product or service solutions with AI. The course will include field trips depending on availability and external collaborator and the contents are subject to change to fulfill the course objectives.

## Learning Outcomes

At the end of this course, students will be able to:

1. Spot and describe opportunities to leverage AI for users, business, and social value within a given context.
2. Demonstrate ability to align user needs and guard human values within algorithmic systems.
3. Employ AI concepts in applied design practice.

## Content Summary

### Project Reachy Fusion for DS323

* AI Meets Design
  * Integrating Machine Learning methods with Reachy Fusion for use at SUSTech Campus.

### Project Reachy Fusion for DS323

In this project, we aim to adopt [Reachy by Pollen Robotics](https://www.pollen-robotics.com/) as the subject to practice basic concepts in generative design using Autodesk Fusion 360. The overall goal is to conduct generative design on Reachy, particularly its arm, to evaluate the integration of AI in design, use Fusion 360, and then propose product design architecture of Reachy Fusion for SUSTech using the AI meets Design toolkit to lead the design of advanced robots.

\[All images and videos below are reproduced from Reachy main website for educational purposes only. We hope to talk with Reachy about properly using this media content. Please contact <wanf@sustech.edu.cn> for more.]

<figure><img src="https://content.gitbook.com/content/2kq5EgI12UCOy34ZE2eI/blobs/LKtib8EzQjt7nYmoWsoJ/image%201024x515.png" alt="Original DS323 2022 Autumn course illustration"><figcaption><p>Original DS323 2022 Autumn course illustration</p></figcaption></figure>

<table data-view="cards"><thead><tr><th></th><th data-hidden data-card-cover data-type="image">Cover image</th></tr></thead><tbody><tr><td>Reachy Arm Kit</td><td><a href="https://content.gitbook.com/content/2kq5EgI12UCOy34ZE2eI/blobs/10PaEyhpV9XPfBLXASyU/reachy%20arm%20kit.png">https://content.gitbook.com/content/2kq5EgI12UCOy34ZE2eI/blobs/10PaEyhpV9XPfBLXASyU/reachy%20arm%20kit.png</a></td></tr><tr><td>Reachy Starter Kit</td><td><a href="https://content.gitbook.com/content/2kq5EgI12UCOy34ZE2eI/blobs/DT30FTVhPkbrnni8MGyg/reachy%20expressive%20kit.png">https://content.gitbook.com/content/2kq5EgI12UCOy34ZE2eI/blobs/DT30FTVhPkbrnni8MGyg/reachy%20expressive%20kit.png</a></td></tr><tr><td>Reachy Full Kit</td><td><a href="https://content.gitbook.com/content/2kq5EgI12UCOy34ZE2eI/blobs/1f2Hn0BpvQMAhRgMkrg0/reachy%20advanced%20kit.png">https://content.gitbook.com/content/2kq5EgI12UCOy34ZE2eI/blobs/1f2Hn0BpvQMAhRgMkrg0/reachy%20advanced%20kit.png</a></td></tr></tbody></table>

#### About Reachy by Pollen Robotics

Reachy is an expressive open-source humanoid platform programmable with Python and ROS. He is particularly good at interacting with people and manipulating objects.

#### About Fusion 360 by Autodesk

[Fusion 360 is a cloud-based 3D modeling, CAD, CAM, CAE, and PCB software platform for professional product design and manufacturing.](https://www.autodesk.com/products/fusion-360/overview?term=1-YEAR\&tab=subscription)

With SUSTech School of Design, we have partnered with Autodesk to establish an Autodesk Training Center at SUSTech. A training lab with top-end Mac computers is provided by the School of Design so that our students can use and practice the use of Fusion 360 for the course. Meanwhile, through Autodesk Training Center, we offer technical and financial support for students who are willing to take the certification to become licensed practitioners of Fusion 360 in their future careers.

## Course Instructor & Teaching Team

* **Lead Instructor**: Dr. Wan Fang
* **Teaching Assistants**: Xu Ronghan, Qiu Nuofan, Dong Yujian, Han Xudong
* **Teaching Administrator**: Fu Tian
* **Office**: Level 3, Bldg. C1, Nanshan Zhiyuan

## Grading Policy

1. Form of examination: Letter Grading
2. Grading policy: Attendance  10% | Assignments 20% | Final Presentation 70%
   * Attendance 10%
   * Assignments 20%: Please submit the following materials you practiced during the first 3 weeks **before 23:59 30th Oct**.
     1. Value proposition statement (6%)
     2. Plotting your model (7%)
     3. Confusion matrix (7%)
   * Final Presentation 70%: Please submit the final design report (slides) **before 23:59 6th Nov.** Marks are given based on the learning outcomes.
     1. Spot and describe opportunities to leverage AI for users, business, and social value within a given context.
     2. Demonstrate ability to align user needs and guard human values within algorithmic systems.
     3. Employ AI concepts in applied design practice.

## Academic Integrity

* This course follows the SUSTech Code of Academic Integrity. This course’s students are expected to abide by the SUSTech Code of Academic Integrity. Any work submitted by a student in this course for academic credit will be the student’s work. Violations of the rules (e.g., cheating, copying, non-approved collaborations) will not be tolerated.

## University Calendar

<figure><img src="https://content.gitbook.com/content/2kq5EgI12UCOy34ZE2eI/blobs/xq9c2CBJbNuLvhR6ABJ0/image.png" alt="Calendar supplied on the DS323 2022 Autumn course website; open the original image for full detail"><figcaption><p>Calendar supplied on the DS323 2022 Autumn course website; open the original image for full detail</p></figcaption></figure>

## Recommended Textbook(s)

**Course Materials**

* (1996) The Sciences of the Artificial (Third Edition), Herbert A. Simon, The MIT Press. 「[Read Online](https://monoskop.org/images/9/9c/Simon_Herbert_A_The_Sciences_of_the_Artificial_3rd_ed.pdf)」
* (2019) AI meets Design Toolkit, Nadia Piet, online.「[Read Online](https://aixdesign.co/toolkit)」
  * [Value Proposition Statement](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-AIxDesign-Value-proposition-statement.pdf) | [Benchmarking](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-AIxDesign-Benchmarking.pdf) | [Confusion Matrix](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-AIxDesign-Confusion-matrix.pdf) | [Consequence Wheel](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-AIxDesign-Consequence-wheel.pdf) | [Plotting Your Model](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-AIxDesign-Plotting-your-model.pdf) | [UX of AI Challenges](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-AIxDesign-UX-of-AI.pdf) | [Value Polarities](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-AIxDesign-Value-polarities.pdf)
* **Useful Links**
  * AI risk management framework playbook: <https://pages.nist.gov/AIRMF/>
  * <https://medium.com/aixdesign/ux-challenges-for-ai-ml-products-1-3-trust-transparency-31df88c6f827>
  * What-if tools: <https://pair-code.github.io/what-if-tool/explore/#web>
  * Human pose recognition and fall detection: <https://github.com/cwlroda/falldetection_openpifpaf>
  * Sound detection:
    * <https://github.com/sharathadavanne/seld-dcase2022>
    * <https://github.com/giusenso/seld-tcn>
    * <https://github.com/FIGLAB/DirectionOfVoice>
    * <https://github.com/Navigine/Direction-of-Arrival-DoA-Estimation-Algorithm>

## Teaching Schedule

### Day 01 Mon Oct 10｜[Generative Design](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-Day-01-Generative-Design.pdf)

### Day 02 Thu Oct 13｜[Intro to ML + AI meets Design I](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-Day-02-Intro-to-ML-and-Data-and-AI-meets-Design-I.pdf)

### Day 03 Mon Oct 17｜[AI meets Design II](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-Day-03-AI-meets-Design-II.pdf)

### Day 04 Thu Oct 20｜[Modern Deep Learning Models + Prototyping](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-Day-04-Modern-Deep-Learning-Models-Prototyping.pdf)

### Day 05 Mon Oct 24｜[AI Risk Management Framework](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-Day-05-AI-Risk-Management-Framework.pdf)

### Day 06 Thu Oct 27｜[AI Deployment & Design + Implementation](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-Day-06-AI-Deployment-Design-and-Implementation.pdf)

### Day 07 Mon Oct 31｜Student Project Preparation

### Day 08 Thu Nov 03｜Final Presentation and Review

* **Final Presentations**: [Han Yuanning](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-Day-08-Final-Presentation-Han-Yuanning.pdf) | [Hu Chengwei](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-Day-08-Final-Presentation-Hu-Chengwei.pdf) | [Hu Hongyi](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-Day-08-Final-Presentation-Hu-Hongyi.pdf) | [Jiang Hanxi](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-Day-08-Final-Presentation-Jiang-Hanxi.pdf) | [Xue Renchao](https://github.com/asMagicBrain/DS323/blob/main/2022-autumn/DS323-2022Autumn-Day-08-Final-Presentation-Xue-Renchao.pdf)
* **Spotlight Video Demonstrations**

{% columns %}
{% column width="41.66666666666667%" %}
{% embed url="<https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F2kq5EgI12UCOy34ZE2eI%2Fuploads%2FEYTFw4Ho0UcxonChlA7g%2FDS323-2022Autumn-Day-08-Final-Presentation-Han-Yuanning-Vid1-Reachy-Curiosity.mp4?alt=media&token=d4c9306f-a952-4be0-9441-f090b03305dd>" %}
{% endcolumn %}

{% column width="58.33333333333333%" %}
{% embed url="<https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F2kq5EgI12UCOy34ZE2eI%2Fuploads%2FGrMI0brUgeCPI1ZnsLBN%2FDS323-2022Autumn-Day-08-Final-Presentation-Han-Yuanning-Vid2-Reachy-painting.mp4?alt=media&token=80632241-0940-4c63-a5b9-1bc35ac8914d>" %}
{% endcolumn %}
{% endcolumns %}

{% columns %}
{% column %}
{% embed url="<https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F2kq5EgI12UCOy34ZE2eI%2Fuploads%2FdSKvRwsHor7THWxIVylD%2FDS323-2022Autumn-Day-08-Final-Presentation-Han-Yuanning-Vid3-Reachy-SayHello.mp4?alt=media&token=daa705dd-9ed2-44ab-b74f-4c7d7f2037eb>" %}
{% endcolumn %}

{% column %}
{% embed url="<https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F2kq5EgI12UCOy34ZE2eI%2Fuploads%2FRewssPKPqm5fOQXOY60o%2FDS323-2022Autumn-Day-08-Final-Presentation-Han-Yuanning-Vid4-URPainting.m4v?alt=media&token=2ebd0695-0117-4d28-85dc-679b37de074d>" %}
{% endcolumn %}
{% endcolumns %}

## Important Deadlines

Assignments 20%: Please submit the following materials you practiced during the first 3 weeks **before 23:59 30th Oct**.

Final Presentation 70%: Please submit the final design report (slides) **before 23:59 6th Nov.** Marks are given based on the learning outcomes.


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation by asking a question.

Perform an HTTP GET request on the following URL with the `ask` and `goal` query parameters:

```
GET https://x.ancorasir.com/ds323/2022-autumn/ds323-ai-in-design.md?ask=<question>&goal=<user_goal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is what the user is ultimately trying to achieve, the reason they need the answer. Sharing it helps GitBook give you a better, more relevant answer. A goal is most helpful when it describes the outcome the user wants rather than restating the question. For example, with `ask=how do I create an API token`, a goal like `automate deployments from our CI pipeline` lets GitBook tailor the answer to that use case.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.