2025년도 2학기 시각-언어 상호지능 (CSED603-01) 강의계획서

1. 수업정보

학수번호 CSED603 분반 01 학점 3.00
이수구분 전공선택 강좌유형 강의실 강좌 선수과목
포스테키안 핵심역량
강의시간 화, 목 / 11:00 ~ 12:15 / 제2공학관 강의실 [109호] 성적취득 구분 G

2. 강의교수 정보

손진희 이름 손진희 학과(전공) 인공지능대학원
이메일 주소 jeany@postech.ac.kr Homepage
연구실 공학2동 317호 전화 054-279-2251
Office Hours

3. 강의목표

1. Gain the background to conduct interdisciplinary research at the intersection of Vision and Language.
2. Obtain an overview of current research trends at the intersection of Vision and Language.
3. Acquire the skills to design a non-trivial deep learning model for a vision and language problem.

4. 강의선수/수강필수사항

Background: Calculus, probability theory, linear algebra,
Coursework: At least one among computer vision, natural Language processing, and machine learning
Programming skill: Substantial programming experience including script languages in Unix/Linux/MacOS environmen.

5. 성적평가

Assignments (20%) Reading assignments, paper reviews
Paper review presentation (20%)
Class participation (10%): attendance + discussion
Final project (50%): Research project + final report
Note: No Pass/Fail grading

6. 강의교재

도서명 저자명 출판사 출판년도 ISBN
Course slides and papers 0000

7. 참고문헌 및 자료

Deep Learning by I. Goodfellow, Y. Bengio, and A. Courville
Computer Vision: A Modern Approach by D. Forsyth and J. Ponce
Foundations of Statistical Natural Language Processing by C. Manning and H. Schuetze

8. 강의진도계획

1주차: Intro. to CV & NLP
2주차: Convolutional Networks (CNNs) & Recurrent Networks (RNNs)
3주차: Attentions and Transformers
4주차: Vision-language models: Contrastive learning
5주차: Vision-language models: Grounding for object detection & segmentation + student paper reviews
6주차: Vision-language models: Reasoning and visual question answering + student paper reviews
7주차: Student paper reviews
8주차: Project intermediate presentation
9주차: Generations + student paper reviews
10주차: Other modalities: Audio, Video, Actions, Procedures + student paper reviews
11주차: Emerging topics in Vision and Language + student paper reviews
12-13주차ㅣ Student paper reviews
14-15주차: Project final presentation

9. 수업운영

Lecture + research paper reviews + research project

10. 학습법 소개 및 기타사항

11. 장애학생에 대한 학습지원 사항

- 수강 관련: 문자 통역(청각), 교과목 보조(발달), 노트필기(전 유형) 등

- 시험 관련: 시험시간 연장(필요시 전 유형), 시험지 확대 복사(시각) 등

- 기타 추가 요청사항 발생 시 장애학생지원센터(279-2434)로 요청