logo

korean english

게시판

Home > 게시판 > 세미나

이번 학기 콜로퀴움은 학교의 권고를 따라, 사회적 거리두기 단계와 연계하여 온라인 혹은 오프라인(온라인 방송 병행)으로 운영될 예정입니다.

첫번째 강연에는 성균관대학교 소프트웨어학과 박진영 교수님을 모시고 콜로퀴움을 개최하오니, 학과 구성원 여러분의 많은 참여를 부탁 드립니다.

코로나19 확산방지를 위해 다과는 제공하지 않습니다.


                                     
            

1. Title: Scaling laws in Natural Language Processing


2. Speaker: 박  진  영  교수님
(성균관대학교 소프트웨어학과)


3. Date & Time: Mar. 3. (Wed.) 2021.  4:30 PM


4. Place: Natural Science 1,  Room No. 31214


5. Abstract: Many artificial intelligence (AI), machine learning (ML), and natural language processing (NLP) models have seen successes in recent years. Based on these models, there are many good NLP applications such as machine translation, question answering and chatbot. But, we still have questions about the models. One of the questions is the relationship between model performance and several factors such as model size.
Scaling law (power-law) is a functional relationship between two quantities and has been identified in physics. It is also observed in NLP too. In this talk, I will introduce a language model that is an important model for NLP and the power-law distribution between the factors and performance of the model. I will also briefly introduce the convergence of ML and physics.
 

Bio:
JinYeong Bak is an assistant professor in the colleague of computing at Sungkyunkwan
University. His research interests analyzing human behaviors from their conversations and building open-domain conversation models from the insights of the analysis. He worked at Microsoft Research Asia as a research intern and United Nations Global Pulse Lab Jakarta as a junior data scientist. He received Ph.D. and M.S. from the KAIST and a B.S. from Sungkyunkwan University. His research has been published in ACL, EMNLP, CHI, and ICWSM. His personal homepage: https://nosyu.github.io and lab homepage: https://hli.skku.edu

번호 제목 날짜 조회 수
공지 <12/8(Thu.) 11:00am>노벨상 소개 강연 - 2016년 노벨 물리학상: 위상 응집 물리의 탄생 2016.11.28 1031157
386 2019학년도 2학기 콜로퀴움 일정 2019.07.17 421020
385 2017학년도 1학기 콜로퀴움 일정 2017.01.05 259251
384 2020학년도 1학기 콜로퀴움 일정 2020.01.31 251240
» <Mar.3(Wed.)>Scaling laws in Natural Language Processing 2021.02.25 217590
382 <5/16> 물리학자가 바라 본 단백질: 왜, 어떻게 연구하는가? 2012.05.10 210139
381 <3/14>Adaptive Optics for the Human Eye and Ophthalmic Applications 2008.03.12 209729
380 <6/11> Advanced Physiological Optics and Its Ophthalmic Applications 2014.05.28 177162
379 <11/6> Graphene plasmon and Plasmonics 2013.10.31 171025
378 <May. 25(Wed.) 4:30 PM> Functional Materials @ Nanoscale: Electronics, Energy and ‘Green’Healthcare Applications 2016.05.23 164146
377 <Sep. 23(Wed.) 4:30 PM>Grain boundary effect in Metal : A journey of discovery from crystal to thin films without grain boundaries 2015.09.16 160446
376 <Nov. 18(Wed.) 4:30 PM> Single-molecule chemistry and spectroscopy on ultrathin insulating films 2015.11.11 157399
375 <4/2> Radio Detection of Ultra High Energy Cosmic Rays and Neutrinos in Antarctica 2014.03.26 155077
374 <Dec. 1(Wed.)>Halide Perovskite Single Crystals and Thin Films for Solar Cells and Optoelectronics 2021.11.25 154858
373 2020학년도 2학기 콜로퀴움 일정 2020.07.16 151014
372 <11/26(수)> Neutrino Physics with KamLAND 2014.11.20 150789
371 <June.12(Wed.)> Ribocomputing: Cellular Logic Computation using RNA Devices file 2019.06.07 150014
370 <3/13> Probing hidden magnetism and quantum criticality in unconventional superconductors 2009.03.06 149899
369 <11/7> On-Film Formation of Bi Nanowires with Extraordinary Electron Mobility 2008.11.03 147316
368 <12/4> Shining light on the dark Universe 2013.11.29 145493
367 <10/31> Large-Scale Quantitative Analysis of Painting Arts 2012.10.18 141975