logo

korean english

게시판

Home > 게시판 > 세미나

이번 학기 콜로퀴움은 학교의 권고를 따라, 사회적 거리두기 단계와 연계하여 온라인 혹은 오프라인(온라인 방송 병행)으로 운영될 예정입니다.

첫번째 강연에는 성균관대학교 소프트웨어학과 박진영 교수님을 모시고 콜로퀴움을 개최하오니, 학과 구성원 여러분의 많은 참여를 부탁 드립니다.

코로나19 확산방지를 위해 다과는 제공하지 않습니다.


                                     
            

1. Title: Scaling laws in Natural Language Processing


2. Speaker: 박  진  영  교수님
(성균관대학교 소프트웨어학과)


3. Date & Time: Mar. 3. (Wed.) 2021.  4:30 PM


4. Place: Natural Science 1,  Room No. 31214


5. Abstract: Many artificial intelligence (AI), machine learning (ML), and natural language processing (NLP) models have seen successes in recent years. Based on these models, there are many good NLP applications such as machine translation, question answering and chatbot. But, we still have questions about the models. One of the questions is the relationship between model performance and several factors such as model size.
Scaling law (power-law) is a functional relationship between two quantities and has been identified in physics. It is also observed in NLP too. In this talk, I will introduce a language model that is an important model for NLP and the power-law distribution between the factors and performance of the model. I will also briefly introduce the convergence of ML and physics.
 

Bio:
JinYeong Bak is an assistant professor in the colleague of computing at Sungkyunkwan
University. His research interests analyzing human behaviors from their conversations and building open-domain conversation models from the insights of the analysis. He worked at Microsoft Research Asia as a research intern and United Nations Global Pulse Lab Jakarta as a junior data scientist. He received Ph.D. and M.S. from the KAIST and a B.S. from Sungkyunkwan University. His research has been published in ACL, EMNLP, CHI, and ICWSM. His personal homepage: https://nosyu.github.io and lab homepage: https://hli.skku.edu

번호 제목 날짜 조회 수
공지 2022학년도 1학기 콜로퀴움 일정 2022.01.10 26975
공지 <12/8(Thu.) 11:00am>노벨상 소개 강연 - 2016년 노벨 물리학상: 위상 응집 물리의 탄생 2016.11.28 968236
285 <Nov.22(Wed.) 4:30 PM> Dark Side of the Universe 2017.11.15 57365
284 <Oct.2(Wed.)> Fundamental physics with high-energy atmospheric and cosmic neutrinos today and in the future 2019.09.26 57589
283 <4/29(수) 오후4:30분> 양자정보 2015.04.23 57804
282 <Nov. 23(Wed.) 4:30 PM> Dry (Plasma) etch process in Semiconductor Device 2016.11.16 57834
281 <Nov. 4(Wed.) 4:30 PM> 기능성 산화물과 그래핀을 접합한 나노소자의 특성 변화 2015.10.30 58153
280 <Sep.19(Wed.) 4:30 PM> Superconducting Quantum Computing (초전도 양자컴퓨팅) 2018.09.12 58155
279 <12/3(수)> 진공은 무( 無)로 채워지지 않았다. 힉스입자를 찾아서 2014.11.27 58534
278 <3/25(수) 오후4:30분> 슈퍼컴퓨터와 국가경쟁력 2015.03.19 58754
277 <Sept.11(Wed.)> Fantastic physics and materials, how to find them? 2019.09.06 58905
276 <5/6(수) 오후4:30분> 빛의 여행 2015.04.29 58917
275 <3/11(수) 오후4시:30분> 테크노-이매지네이션(Techno-imagination) 2015.03.04 58973
274 <Sept.18(Wed.)> Rare-earth: versatility and capability 2019.09.16 58994
273 <Dec.12(Wed.)> First-principles studies of complex oxides interfaces 2018.12.05 59331
272 <4/1(수) 오후4:30분> 과학기술과 미디어 2015.03.26 59743
271 <10/29(수)> 창조경제와 과학기술혁신시스템 2014.10.16 60341
270 <Nov. 11(Wed.) 4:30 PM> 그래핀 산업의 현황과 전망 2015.11.09 60451
269 <6/10(수) 오후4:30분> Closing in on the Axion Dark Matter hypothesis 2015.06.03 60493
268 <Oct. 12(Wed.) 4:30 PM> Silk as a biocompatible optical material 2016.10.05 60528
267 <May.9(Wed.) 4:30 PM> "How gold was produced in the universe?" 2018.05.02 60645
266 <5/20(수) 오후4:30분> Nonequilibrium statistical physics for Brownian heat engine 2015.05.14 60745