logo

korean english

게시판

Home > 게시판 > 세미나

이번 학기 콜로퀴움은 학교의 권고를 따라, 사회적 거리두기 단계와 연계하여 온라인 혹은 오프라인(온라인 방송 병행)으로 운영될 예정입니다.

첫번째 강연에는 성균관대학교 소프트웨어학과 박진영 교수님을 모시고 콜로퀴움을 개최하오니, 학과 구성원 여러분의 많은 참여를 부탁 드립니다.

코로나19 확산방지를 위해 다과는 제공하지 않습니다.


                                     
            

1. Title: Scaling laws in Natural Language Processing


2. Speaker: 박  진  영  교수님
(성균관대학교 소프트웨어학과)


3. Date & Time: Mar. 3. (Wed.) 2021.  4:30 PM


4. Place: Natural Science 1,  Room No. 31214


5. Abstract: Many artificial intelligence (AI), machine learning (ML), and natural language processing (NLP) models have seen successes in recent years. Based on these models, there are many good NLP applications such as machine translation, question answering and chatbot. But, we still have questions about the models. One of the questions is the relationship between model performance and several factors such as model size.
Scaling law (power-law) is a functional relationship between two quantities and has been identified in physics. It is also observed in NLP too. In this talk, I will introduce a language model that is an important model for NLP and the power-law distribution between the factors and performance of the model. I will also briefly introduce the convergence of ML and physics.
 

Bio:
JinYeong Bak is an assistant professor in the colleague of computing at Sungkyunkwan
University. His research interests analyzing human behaviors from their conversations and building open-domain conversation models from the insights of the analysis. He worked at Microsoft Research Asia as a research intern and United Nations Global Pulse Lab Jakarta as a junior data scientist. He received Ph.D. and M.S. from the KAIST and a B.S. from Sungkyunkwan University. His research has been published in ACL, EMNLP, CHI, and ICWSM. His personal homepage: https://nosyu.github.io and lab homepage: https://hli.skku.edu

번호 제목 날짜 조회 수
공지 <12/8(Thu.) 11:00am>노벨상 소개 강연 - 2016년 노벨 물리학상: 위상 응집 물리의 탄생 2016.11.28 1079785
687 <Oct. 12(Wed.)>Neurodegenerative Diseases from the Chemical Force Point of View 2022.10.05 12
686 <Oct. 5(Wed.)>“사라진 중성미자를 찾아서” 2022.09.29 35
685 <Sep. 21(Wed.)>Dynamics and thermodynamics of bimolecular reactions at aqueous-nonaqueous interfaces 2022.09.15 106
684 <Sep. 14(Wed.)>The Next Generation of Photonic Sources – Light-Emitting Devices 2022.09.08 211
683 <Sep. 7(Wed.)>Flavor of particles, as a key for New physics 2022.09.01 277
682 2022학년도 2학기 콜로퀴움 일정 2022.06.22 1368
681 <July 8(Fri.)>Intertwined magnetism and charge density wave in a kagome metal 2022.06.03 1515
680 <Apr. 27(Wed.)> I) A few first questions by me. II) ‘Topotactic resistance switching RAM’의 최초 발견 2022.04.20 1544
679 <May 18(Wed.)>Magnetoresistance and Hall effects of Fe5Sn3 single crystals 2022.05.12 1582
678 <May 4(Wed.)>Recent progress in the study of topological phases of matter 2022.04.27 1590
677 <Apr. 20(Wed.)> 반도체 공정용 플라즈마 물리 2022.04.14 1607
676 <May. 10(Tue.)>Longitudinal magnon decay in the quasi-two-dimensional antiferromagnet in Ba2FeSi2O7 2022.05.09 1964
675 <May. 3(Tue.)>Anomalous Hall signatures of nonsymmorphic nodal lines in the doped chromium chalcospinel CuCr2Se4 2022.04.19 2098
674 <Mar. 16(Wed.)> 현세대/차세대 이차전지 기술 동향 및 전망 2022.03.02 2099
673 <Mar. 30(Wed.)> Two-dimensional Semiconductors and their applications 2022.03.23 2182
672 <Apr. 6(Wed.)> Holographic Flat Panel Displays 2022.03.30 2216
671 <May 11(Wed.)>Key Nuclear Experimental Studies to Find the Origin of Elements 2022.05.04 2483
670 <Mar. 2(Wed.)>Introduction to high-energy nuclear physics 2022.02.24 2768
669 <Jan. 27(Thu.)>Emulating twisted double bilayer graphene with a multiorbital optical lattice 2022.01.18 2935
668 <Mar. 23(Wed.)> Next-generation artificial intelligence devices and physics 2022.03.16 3254