Text Box: Sungjin Lee

Ph.D.

Intelligent Software Laboratory

Department of Computer Science and Engineering

Pohang University of Science and Engineering (POSTECH)

E-mail: junion [AT] postech.ac.kr

Phone: +82-54-279-5581

 

Research Interest

Spoken (and Multimodal) Dialog Systems, Error Handling in Spoken Dialog Systems, Machine Learning, Natural Language Processing, Spoken Language Understanding, Computer-Assisted Language Learning, Automated English Assessment, Educational Data Mining, User Modeling, Emotion Recognition.

 

 

Education

¡Ü Ph.D. / M.S. Computer Science and Engineering             POSTECH

    September, 2007 – Present

Thesis: Intelligent Corrective Feedback for Communicative Computer-Assisted Language Learning

¡Ü B.S. Computer Science and Engineering                          POSTECH

     March, 1997 – February, 2006

 

 

Work Experience

¡Ü PIOLINK                                                               Jun 2004 – Jan 2007

PIOLINK is a leading application networking company in Korea. It manufactures Application Switches, Network Load Balancers, and Web Security Switches. I worked as a senior team member for the development and design of multi processors and multitasking systems. I implemented and managed firmware and software for embedded Linux systems mixing PowerPC and MIPS. I wrote numerous device drivers including communications processor drivers (BroadCom BCM1250, BCM1480), SSL chip drivers (Britestream BN1010; Cavium CN1000), network chip drivers (BroadCom BCM5690, BCM5464SR), and peripheral device drivers (PCI, HT, System Monitoring chip, RTC & NVRAM, Flash memory, UART).

¡Ü CORECESS                                                            Jan 2001 – May 2004

CORECESS manufactures telecommunications equipment for broadband access networks such as Optical Link Technologies (GEPON and WDM PON), Intelligent Mutilayer Switches, VDSL, and DSLAM. I worked on the development and design of quality of service (Corecess QoS architecture design and implementation), layer 2 network protocols (RSTP, LACP), and a Logging File System. I implemented and managed system software for embedded Linux and pSOS. I wrote numerous device drivers including programmable network processor drivers (Agere APP550), network chip drivers (Switchcore CXE 1000, CXE16; Galileo Galnet II, Galnet II+, Galnet III), and peripheral device drivers (PCI, IIC, System Monitoring chip, RTC & NVRAM, Flash memory, UART).

 

 

Research Experience

¡Ü Selected Project Experience (Project title / Term / Funding Institute)

1.    Research on English Speaking Assessment and Provision of Feedback for Korean, May 2010 – Present, SK Telecom Corporation:
I participated in making the project proposal and drawing the system architecture. In particular, I am developing a component for grammaticality judgment and provision of feedback for oral output.

2.    Research Laboratory for Natural Language-based Immersive English Tutoring System, Mar 2010 – Present, MEST (Ministry of Education Science and Technology):
I am responsible for project management and participated in designing the system architecture consisting of various technologies such as Speech, Vision, and Haptic. I am developing dialog strategies in consideration of students¡¯ proficiency level, emotion, and gameplay.

3.    Development of Mobile Platforms for Dialog-based Speech Interfaces, Mar 2010 – Present, MKE (Ministry of Knowledge and Economy):
I am responsible for investigating dialog management for English tutoring. I am working on data collection, robust language understanding, dialog management, and corrective feedback generation. I am researching a ASR combination to generate feedback on both global and local errors.

4.    Development of Intelligent Robots for English Conversation Tutoring, Aug 2009 – Present, MKE (Ministry of Knowledge and Economy):
I am responsible for speech and language processing of intelligent robots. I collaborated with English teachers to make educational material and developed communicative robots capable of providing recast feedback in response to students¡¯ errors. I participated in a pilot project for elementary students.

5.    Conversational Agent for English Conversation Tutoring July 2008 – July 2009, MSRA (Microsoft Research Asia Funded Project):
I was responsible for project management. I designed and implemented a hybrid language understanding component for robust language understanding and corrective feedback generation.

6.    Research on Dialog-based Computer Aided Language Learning for Spoken Dialog System in English, Mar 2007 – Nov 2007, KT Corporation:
I was responsible for project management. I designed and implemented a spoken dialog system for English conversation practice in the immigration domain. I developed a method to provide recast feedback and suggest expressions in the case of timeout.

 

 

Publications

¡Ü Journal Publications

1.    Sungjin Lee, Hyungjong Noh, Jonghoon Lee, Kyusong Lee, Gary Geunbae Lee, Seongdae Sagong, Moonsang Kim. (2011) On the Effectiveness of Robot-Assisted Language Learning, ReCALL Journal, Vol.23(1), SSCI.

2.    Sungjin Lee, Jonghoon Lee, Hyungjong Noh, Kyusong Lee, Gary Geunbae Lee. (2011) Grammatical Error Simulation for Computer-Assisted Language Learning, Knowledge-Based Systems, SCI

3.    Jonghoon Lee, Sungjin Lee, Hyungjong Noh, and Gary Geunbae Lee. (2011) Iteratively Constrained Selection of Word Alignment Links from Knowledge and Statistics, Knowledge-Based Systems, SCI

4.    Sungjin Lee, Hyungjong Noh, Kyusong Lee, Gary Geunbae Lee. (2011) Foreign Language Tutoring in Oral Conversations Using Spoken Dialog Systems, IEICE Trans. on Information & Systems, SCIE (accepted)

5.    Jinsik Lee, Sungjin Lee, Jonghoon Lee, Byeongchang Kim, Gary Geunbae Lee. (2012) Stacking Model-Based Korean Prosodic Phrasing Using Speaker Variability Reduction and Linguistic Feature Engineering, ACM Transactions on Asian Language Information Processing (accepted)

6.    Sungjin Lee, Cheongjae Lee, Gary Geunbae Lee. (2010) Example-based Dialog System for English Conversation Tutoring. Journal of KIISE: Software and Applications, Vol. 37(2) .129-136.


¡Ü Conference/Workshop/Symposium Publications

1.    Sungjin Lee, Hyungjong Noh, Kyusong Lee, Gary Geunbae Lee, Grammatical Error Detection for Corrective Feedback Provision in Oral Conversations, Proceedings of the AAAI 2011: Twenty-Fifth Conference on Artificial Intelligence, San Francisco, Aug 2011

2.    Sungjin Lee, Changgu Kim, Jonghoon Lee, Hyungjong Noh, Kyusong Lee, Gary Geunbae Lee. Affective Effects of Speech-enabled Robots for Language Learning. Proceedings of the 2010 IEEE Workshop on Spoken Language Technology (SLT 2010), Berkeley, Dec 2010

3.    Sungjin Lee, Hyungjong Noh, Jonghoon Lee, Kyusong Lee, Gary Geunbae Lee. POSTECH Approaches for Dialog-based English Conversation Tutoring. Proceedings of the 2010 APSIPA annual summit and conference, Singapore, Dec 2010 (nominated for student best paper)

4.    Sungjin Lee, Hyungjong Noh, Jonghoon Lee, Kyusong Lee, Gary Geunbae Lee. Cognitive Effects of Robot-Assisted Language Learning on Oral Skills. Proceedings of Interspeech Second Language Studies Workshop, Tokyo, Sep 2010.

5.    Kyusong Lee, Sungjin Lee, Jonghoon Lee, Hyeongjong Noh, Gary Geunbae Lee. Natural Language-based Immersive English Tutoring System. Proceedings of Conference on Human & Cognitive Language Technology, Gwangju, Oct 2010.

6.    Kyusong Lee, Sungjin Lee, Jonghoon Lee, Hyeongjong Noh, Gary Geunbae Lee. Natural Language Dialog-based Language Learning Game Platform. Proceedings of the Korean Society of Speech Sciences. Daejeon, May 2010.

7.    Sungjin Lee, Cheongjae Lee, Jonghoon Lee, Hyungjong Noh, Gary Geunbae Lee. Intention-based Corrective Feedback Generation using Context-aware Model. Proceedings of the International Conference on Computer Supported Education, Valencia, Spain, Apr 2010.

8.    Hyungjong Noh, Minwoo Jeong, Sungjin Lee, Jonghoon Lee, Gary Geunbae Lee. Script-Description Pair Extraction from Text Documents of English as Second Language Podcast. Proceedings of the International Conference on Computer Supported Education, Valencia, Spain, Apr 2010.

 

9.    Cheongjae Lee, Sungjin Lee, Sangkeun Jung, Kyungduk Kim, Donghyeon Lee, Gary Geunbae Lee. Correlation-based Query Relaxation for Example-based Dialog Modeling. Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop (IEEE-ASRU), pages 474-478, Merano, Italy, Dec 2009.

 

10. Sungjin Lee, Hyungjong Noh, Jonghoon Lee, Gary Geunbae Lee. Importing Human Tutor's Conversation Strategy into Dialog Systems for Language Learning using Fuzzy Logic. Proceedings of the international workshop on spoken dialog systems (IWSDS2009), Germany, Dec 2009

 

11. Sungjin Lee, Gary Geunbae Lee. Realistic Grammar Error Simulation using Markov Logic. Proceedings of the ACL 2009, Singapore, August 2009

 

12. Cheongjae Lee, Sangkeun Jung, Kyungduk Kim, Sungjin Lee, Gary Geunbae Lee. Automatic agenda graph construction from human-human dialogs using clustering method. Proceedings of the Korean Society of Speech Sciences. Jeonju, May 2009.

 

13. Sungjin Lee, Gary Geunbae Lee. Recognizing Language Learners¡¯ Intention using Discourse Information. Joint Conference of the Korean Society of Phonetic Sciences and Speech Technology and the Korean Association of Speech Sciences, Seoul, Nov 2008

 

14. Sungjin Lee, Cheongjae Lee, Gary Geunbae Lee. Example-based dialog modeling for English conversation tutoring. Proceedings of the 2nd International Conference on Next Generation Computing (NGC), Seoul, Nov 2007.

15. Sungjin Lee, Cheongjae Lee, Gary Geunbae Lee. Example-based dialog modeling for Computer-Assisted Language Learning. Proceedings of Conference on Human & Cognitive Language Technology, Daegu, Oct 2007.