Time and Place

  • Temporary Location: Online on Blackboard
  • Lecture: Every Tuesday 10:20-12:10, Location @ #207, 1 Lychee Park
  • Lab: Every Friday 10:20-12:10, Location @ #612, 7 Innovation Park

Instructor Team

  • Lead Instructor: Prof. Song Chaoyang (songcy@sustech.edu.cn)
  • Lab Instructor: Dr. Wan Fang (sophie.fwan@hotmail.com)
  • Student Assistant: Mr. Ge Sheng (11612122@mail.sustech.edu.cn)
  • Teaching Assistant: Mr. Liu Xiaobo (11930807@mail.sustech.edu.cn)
  • Office: Room 606, 7 Innovation Park

Course Objectives

  • This course is intended for students advancing in the study of robotic engineering. The focus is on the problems of how a robot can learn to perceive the physical world well enough to act in it and make reliable plans. Subjects covered by this course include robotic collaboration, kinematics, Robot Operating System (ROS), robotic vision, calibration, RGB-D sensing, object recognition, artificial intelligence (AI) and deep learning (DL). Specific projects will be carried out throughout this course regarding the simulation of robot picking using fundamental kinematics and robot vision, an AI robot to play tic-tac-toe game, and a DL robot to play arcade claw game.
    • To teach students how to conduct the basic kinematic formulation of a robotic system in simulation.
    • To teach students how to use robotic vision, including algorithms, hardware, and software, in simulation.
    • To teach students how to program artificial intelligence into robot hardware performing interactive tasks.
    • To teach students how to use deep learning methods to program robot hardware to perform advanced tasks.
    • To reinforce students’ team skills through various team projects, including problem formulation, problem solutions and written reporting of results.
    • To reinforce students’ visualization and hands­-on skills through project virtual prototyping and/or physical construction exercises.

Learning Outcomes

  • As an elective course for robotic engineering major, this course lays the foundation for students to use widely adopted Robot Operating System (ROS) to perform advanced robot control including basic mathematical formulation, hardware usage, and intelligence integration. The following learning outcomes are expected for students taking this course:
    • Given functional and environmental requirement, utilize concepts generation methods within a team setting to achieve a consensus for a robot design concept.
    • Design and develop functional robot programs from the perspectives of function, hardware, algorithm, and physical environment.
    • Apply basics of disciplines including mechanical engineering, electrical engineering, applied mathematics, computer science to understand the use of robots in action.
    • Communicate engineering decisions, justification for those decisions, designs, programming, and test results in multi-media presentation and report writing.

Pre-requisites

  • MEE5101 Introduction to Robotics and Automation
  • MEE5104 Robotic Modeling and Control

Grading

  • 60%: project marking
    • 15% per project for the first two projects, including 10% code submission and 5% video presentation.
  • 10%: individual marking
  • 30%: final project marking, including
    • 10% final paper
    • 10% final video demo
    • 5% final poster
    • 5% code submission

Robotic Engineering Project

  • Project 1 (Week 08): Vision-guided Picking in PyRep
  • Project 2 (Week 10): Simulated Robot Player
  • Project 3 (Week 11): Arcade Robot Player
  • Project 4 (Week 13): Training a Waste Detector
  • Project 5 (Week 15): Autonomous Waste Sorting Robot
  • Submission Requirement
    • Projects 1~4: PowerPoint, Video Presentation, Code.
    • Project 5**: A 6-page report in IEEE Conference Paper Style with full-code and video presentation

How to Video Record Your Presentation using PowerPoint

  • There is a simple solution in Microsoft PowerPoint, as a recording function is built-in the software.
    • The content of the video should revolve around your presentation, but you are welcome to be creative about how to present it.
    • This is a Team assignment, and the question about who to present makes no sense at all.
    • You need to prepare and submit a PDF version of the slides at this [link].

Late Homework Policy

  • Each student is granted four unpenalized late days for the semester. Homework can be handed in no more than four days late and will receive a 25% penalty for each day late (excluding unpenalized late days used). Homework are due at 3 PM on the due date, and each late day extends the deadline by exactly 24 hours. All homework must be done to pass the course.

Course Materials

Academic Integrity

  • This course follows the SUSTech Code of Academic Integrity. Each student in this course is expected to abide by the SUSTech Code of Academic Integrity. Any work submitted by a student in this course for academic credit will be the student’s own work. Violations of the rules (e.g., cheating, copying, non-approved collaborations) will not be tolerated.

Course Schedule & Lecture Notes

Register your Office 365 account using SUSTech Email first. Otherwise, you won’t be able to access the files.

[table id=23 /]