logo

korean english

게시판

Home > 게시판 > 세미나

이번 학기 콜로퀴움은 학교의 권고를 따라, 사회적 거리두기 단계와 연계하여 온라인 혹은 오프라인(온라인 방송 병행)으로 운영될 예정입니다.

첫번째 강연에는 성균관대학교 소프트웨어학과 박진영 교수님을 모시고 콜로퀴움을 개최하오니, 학과 구성원 여러분의 많은 참여를 부탁 드립니다.

코로나19 확산방지를 위해 다과는 제공하지 않습니다.


                                     
            

1. Title: Scaling laws in Natural Language Processing


2. Speaker: 박  진  영  교수님
(성균관대학교 소프트웨어학과)


3. Date & Time: Mar. 3. (Wed.) 2021.  4:30 PM


4. Place: Natural Science 1,  Room No. 31214


5. Abstract: Many artificial intelligence (AI), machine learning (ML), and natural language processing (NLP) models have seen successes in recent years. Based on these models, there are many good NLP applications such as machine translation, question answering and chatbot. But, we still have questions about the models. One of the questions is the relationship between model performance and several factors such as model size.
Scaling law (power-law) is a functional relationship between two quantities and has been identified in physics. It is also observed in NLP too. In this talk, I will introduce a language model that is an important model for NLP and the power-law distribution between the factors and performance of the model. I will also briefly introduce the convergence of ML and physics.
 

Bio:
JinYeong Bak is an assistant professor in the colleague of computing at Sungkyunkwan
University. His research interests analyzing human behaviors from their conversations and building open-domain conversation models from the insights of the analysis. He worked at Microsoft Research Asia as a research intern and United Nations Global Pulse Lab Jakarta as a junior data scientist. He received Ph.D. and M.S. from the KAIST and a B.S. from Sungkyunkwan University. His research has been published in ACL, EMNLP, CHI, and ICWSM. His personal homepage: https://nosyu.github.io and lab homepage: https://hli.skku.edu

번호 제목 날짜 조회 수
공지 2022학년도 1학기 콜로퀴움 일정 2022.01.10 26854
공지 <12/8(Thu.) 11:00am>노벨상 소개 강연 - 2016년 노벨 물리학상: 위상 응집 물리의 탄생 2016.11.28 967497
365 <Sep. 8(Wed.)> Utilizing physics to build a trapped-ion quantum computer 2021.09.01 8090
364 2021학년도 2학기 콜로퀴움 일정 2021.07.01 104461
363 <May 12(Wed.)> Nanomechanical oscillators for quantum technology 2021.05.06 13315
362 <April 28(Wed.)> 손에 잡히는 AI 2021.04.21 8607
361 <April 21(Wed.)> 우주배경복사 편광 관측 - 남극점 기지 바이셉/켁 어레이(BICEP/Keck Array) 망원경 2021.04.12 8100
360 <April 7(Wed.)> Mid-scale facilities for condensed matter research: high magnetic field and neutron scattering 2021.03.31 33808
359 <Mar.31(Wed.)> Nonlinear nanophotonics using on-chip microring resonator 2021.03.25 25148
358 <Mar.24(Wed.)> A tale of quantum magnets 2021.03.18 33413
357 <Mar.17(Wed.)> Glue spectrum for superconductivity obtained via optical spectroscopy 2021.03.10 21726
356 <Mar.10(Wed.)> Dark matter searches in neutrino detectors 2021.03.04 30823
» <Mar.3(Wed.)>Scaling laws in Natural Language Processing 2021.02.25 116273
354 2021학년도 1학기 콜로퀴움 일정 2021.01.13 121957
353 <Dec.9(Wed.)>한국형 암흑물질 실험 2020.12.02 13499
352 <Dec.2(Wed.)>The era of gravitational waves, and the science that makes it possible 2020.11.25 30111
351 <Nov.18(Wed.)>When Physics meets the Living Cells 2020.11.11 48224
350 <Nov.11(Wed.)>Nonlinear optics to study charge, spin, and crystalline structures 2020.11.04 25027
349 <Nov.4(Wed.)>Progresses in Elucidating the Optoelectronic Properties of Perovskite Semiconductor 2020.10.28 41190
348 <Oct.28(Wed.)> Physics of Global Warming 2020.10.22 31844
347 <Oct.14(Wed.)>New Ways to Search for the Dark World 2020.10.12 14045
346 <Oct.7(Wed.)>Organic Photodiode for Image Sensor 2020.09.24 40994