Deep Learning for Recommendations:
Fundamentals and Advances

Keywords: DNNs, DRL, GNNs, AutoML, Adversarial Attacks, Trustworthy Recommendations

Aug 20 20:00 – 2:00 (Next day) Montreal Time (UTC-4)

INTRO

Being able to provide personalized suggestions to each user, recommender systems have become an indispensable tool for mitigating the information overload problem in our daily lives, especially in many user-oriented online services. It not only facilitates users seeking information, but also benefits content providers with more potentials for making profits. Driven by the recent success in deep neural networks (DNNs), recommendation techniques have achieved promising performance under DNNs paradigm. However, most existing DNNs based methods suffer some drawbacks in practice. More specifically, they treat each interaction as a separate data instance and overlook the relations among instances. Meanwhile, they consider the recommendation procedure as a static process and make recommendations following a fixed greedy strategy. Also, the majority of existing DNNs based recommender systems are based on hand-crafted features, hyper-parameters, and deep neural network architectures. In addition, most existing deep recommender systems are vulnerable to adversarial attacks.

In this tutorial, we aim to give a comprehensive survey on the recent progress of advanced techniques in solving the above problems in deep recommender systems, including Graph Neural Networks (GNNs), Deep Reinforcement Learning (DRL), and Automated Machine Learning (AutoML). Meanwhile, we will introduce adversarial attacks for recommender systems. In this way, we expect researchers from the three fields to get an in-depth understanding and accurate insight into the spaces, stimulate more ideas and discussions, and promote technologies in recommendations.

Tutorial Syllabus

The topics of this tutorial include (but are not limited to) the following:

  1. Introduction [Slides] [Video]
  2. Fundamentals of Deep Recommender Systems [Slides][Video]
  3. Reinforcement Learning for Recommender Systems [Slides][Video]
  4. Graph Neural Networks for Recommendations [Slides][Video]
  5. Automated Machine Learning (AutoML) for Recommendations [Slides][Video]
  6. Adversarial Attacks for Recommender Systems [Slides][Video]
  7. Deep Recommendations: Future Directions (Trustworthy RecSys) [Slides] [Video]
Videos: TBD
Link to IJCAI2021 official Website: https://ijcai-21.org/tutorials/

Presenters

Image

Wenqi Fan Hong Kong Polytechnic University

Image

Xiangyu Zhao City University of Hong Kong

Image

Dawei Yin Baidu

Image

Jiliang Tang Michigan State University

Presenters’ Biography

Dr. Wenqi Fan is currently a research assistant professor of the Department of Computing at The Hong Kong Polytechnic University (PolyU). He received his Ph.D. degree from City University of Hong Kong (CityU) in 2020. From 2018 to 2020, he was a visiting research scholar at Michigan State University, under the supervision of Dr. Jiliang Tang. His research interests are in the broad areas of machine learning and data mining, with a particular focus on recommender systems (RecSys), graph neural networks (GNNs), and adversarial attacks. He has published innovative papers in top-tier journals and conferences such as IEEE TKDE, KDD, WWW, ICDE, IJCAI, AAAI, RecSys, WSDM, COLING, and SDM.

Dr. Xiangyu Zhao is an assistant professor of the school of data science at City University of Hong Kong (CityU). His current research interests include data mining and machine learning, especially (1) Reinforcement Learning, AutoML, and their applications in Information Retrieval (recommendation, computational advertising and search); (2) Urban Computing and Spatio-Temporal Data Analysis. He has published more than 20 papers in top conferences (e.g., KDD, WWW, SIGIR, AAAI, ICDE, CIKM, ICDM, WSDM, RecSys) and journals (e.g., SIGKDD, SIGWeb, EPL, APS). His research received Criteo Research Award, Bytedance Research Award, Top 100 Chinese New Stars in Artificial Intelligence and MSU Dissertation Fellowship. He serves as the organizers of DRL4KDD@KD'19, DRL4IR@SIGIR'20, 2nd DRL4KD@WWW'21, 2nd DRL4IR@SIGIR'21, and a lead tutor at WWW'21 and IJCAI'21.

Dr. Dawei Yin is Engineering Director at Baidu inc.. He is managing the search science team at Baidu, leading Baidu's science efforts of web search, question answering, video search, image search, news search, app search, etc.. Previously, he was Senior Director, managing the recommendation engineering team at JD.com between 2016 and 2020. Prior to JD.com, he was Senior Research Manager at Yahoo Labs, leading relevance science team and in charge of Core Search Relevance of Yahoo Search. He obtained Ph.D. (2013), M.S. (2010) from Lehigh University and B.S. (2006) from Shandong University. From 2007 to 2008, he was an M.Phil. student in The University of Hong Kong. His research interests include data mining, applied machine learning, information retrieval and recommender system. He published more than 80 research papers in premium conferences and journals, and was the recipients of WSDM2016 Best Paper Award, KDD2016 Best Paper Award, WSDM2018 Best Student Paper Award, and ICHI 2019 Best Paper Honorable Mention. He is one of the tutors of Information Discovery in E-commerce at SIGIR 2018.

Prof. Jiliang Tang is an associate professor (assistant professor, 2016-2021) in the computer science and engineering department at Michigan State University since Fall@2016. Before that, he was a research scientist in Yahoo Research. He got his PhD from Arizona State University in 2015 under Dr. Huan Liu and MS and BE from Beijing Institute of Technology in 2010 and 2008, respectively. His research interests include social computing, data mining and machine learning and their applications in education. He was the recipient of 2021 IEEE Big Data Security Junior Research Award, 2020 ACM SIGKDD Rising Star Award, 2020 Distinguished Withrow Research Award, 2019 NSF Career Award, and 7 best paper awards (or runner-ups) including WSDM2018 and KDD2016. His dissertation won the 2015 KDD Best Dissertation runner up and Dean's Dissertation Award. He serves as conference organizers (e.g., KDD, SIGIR, WSDM and SDM) and journal editors (e.g., TKDD and ACM Books). He has published his research in highly ranked journals and top conference proceedings, which have received tens of thousands of citations with h-index 61 (Google Scholar) and extensive media coverage.