
Prof. Antoni B. Chan
Professor
Associate Head, Dept. of Computer Science
Deputy Director, Multimedia Engineering Research Centre (MERC)
BSc MEng Cornell, PhD UC San Diego
SrMIEEE
Video, Image, and Sound Analysis Lab (VISAL)
Department of Computer Science
City University of Hong Kong
Office: Room AC1-G7311, Yeung Kin Man Academic Building (lift 7)
Phone: +852 3442 6509
Fax: +852 3442 0503
Email: abchan at cityu dot edu dot hk
Bio
Dr. Antoni Chan is a Professor at the City University of Hong Kong in the Department of Computer Science. Before joining CityU, he was a postdoctoral researcher in the Department of Electrical and Computer Engineering at the University of California, San Diego (UC San Diego). He received the Ph.D. degree from UC San Diego in 2008 studying in the Statistical and Visual Computing Lab (SVCL). He received the B.Sc. and M.Eng. in Electrical Engineering from Cornell University in 2000 and 2001. From 2001 to 2003, he was a Visiting Scientist in the Computer Vision and Image Analysis lab at Cornell. In 2005, he was a summer intern at Google in New York City. In 2012, he was the recipient of an Early Career Award from the Research Grants Council of the Hong Kong SAR, China.
Research Interests [more]
Computer Vision, Surveillance, Machine Learning, Pattern Recognition, Computer Audition, Music Information Retrieval, Eye Gaze Analysis
dynamic textures, motion segmentation, motion analysis, semantic image annotation, image retrieval, crowd counting, probabilistic graphical models, support vector machines, Bayesian regression, Gaussian processes, semantic music annotation and retrieval, music segmentation, feature extraction.
- For more information about my current research projects, please visit my lab website.
- Opportunities for graduate students and research assistants! If you are interested in joining the lab, please check this information. Outstanding non-HK students may also consider applying for the HK PhD fellowship.
- My collaborator has a postdoc position available on Explainable AI (XAI).
Recent Publications [more]
Crowd Counting in the Frequency Domain.Weibo Shu, Jia Wan, Kay Chen Tan, Sam Kwong, and Antoni B. Chan,
In:
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR),
to appear 2022.
Understanding children's attention to traumatic dental injuries using eye-tracking.Vanessa Y. Cho, Janet H. Hsiao, Antoni B. Chan, Hien C. Ngo, Nigel M. King, and Robert P. Anthonappa,
Dental Traumatology,
to appear 2022.
Eye movement analysis of children's attention for midline diastema.
Vanessa Y. Cho, Janet H. Hsiao, Antoni B. Chan, Hien C. Ngo, Nigel M. King, and Robert P. Anthonappa,
Scientific Reports, to appear 2022.
Understanding children’s attention to dental caries through eye-tracking.Vanessa Y. Cho, Janet H. Hsiao, Antoni B. Chan, Hien C. Ngo, Nigel M. King, and Robert P. Anthonappa,
Caries Research,
to appear 2022.
Accelerating Monte Carlo Bayesian Prediction via Approximating Predictive Uncertainty over the Simplex.Yufei Cui, Wuguannan Yao, Qiao Li, Antoni B. Chan, and Chun Xue,
IEEE Transactions on Neural Networks and Learning Systems (TNNLS),
33(4):1492-1506,
Apr 2022 (online 2020).
System and Method for Optimizing A User Interface and A System and Method for Manipulating A User's Interaction with An Interface.
Ying Cao, Xufang Pang, Antoni B. Chan, and Rynson WH Lau,
US Patent US11275596B2, March 2022.
On Distinctive Image Captioning via Comparing
and Reweighting.Jiuniu Wang, Wenjia Xu, Qingzhong Wang, and Antoni B. Chan,
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI),
to appear 2022.
Kernel-based Density Map Generation for Dense Object Counting.Jia Wan, Qingzhong Wang, and Antoni B. Chan,
IEEE Trans. Pattern Analysis and Machine Intelligence (TPAMI),
44(3):1357-1370,
Mar 2022.
On Diversity in Image Captioning: Metrics and Methods.Qingzhong Wang, Jia Wan, and Antoni B. Chan,
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI),
44(2):1035-1049,
Feb 2022.
The effects of attentional and interpretation biases on later pain outcomes among younger and older adults: A prospective study.Frederick H.F. Chan, Hin Suen, Antoni B. Chan, Janet H. Hsiao, and Tom J. Barry,
European Journal of Pain,
26(1):181-196,
Jan 2022.
Understanding the collinear masking effect in visual search through eye tracking.Janet H. Hsiao, Antoni B. Chan, Jeehye An, Su-Ling Yeh, and Jingling Li,
Psychonomic Bulliten & Review,
28(6):1933-1943,
Dec 2021.
Selected Publications [more]
On Diversity in Image Captioning: Metrics and Methods.Qingzhong Wang, Jia Wan, and Antoni B. Chan,
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI),
44(2):1035-1049,
Feb 2022.
Incorporating Side Information by Adaptive Convolution.Di Kang, Debarun Dhar, and Antoni B. Chan,
International Journal of Computer Vision (IJCV),
128:2897-2918,
July 2020.
Density-Preserving Hierarchical EM Algorithm: Simplifying Gaussian Mixture Models for Approximate Inference.Lei Yu, Tianyu Yang, and Antoni B. Chan,
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI),
41(6):1323-1337,
June 2019.
Beyond Counting: Comparisons of Density Maps for Crowd Analysis Tasks - Counting, Detection, and Tracking.Di Kang, Zheng Ma, and Antoni B. Chan,
IEEE Trans. on Circuits and Systems for Video Technology (TCSVT),
29(5):1408-1422,
May 2019.
Eye Movement Patterns in Face Recognition are Associated with Cognitive Decline in Older Adults.Cynthia Y.H. Chan, Antoni B. Chan, Tatia M.C. Lee, and Janet H. Hsiao,
Psychonomic Bulletin & Review,
25(6):2200-2207,
Dec 2018.
Maximum-Margin Structured Learning with Deep Networks for 3D Human Pose Estimation.Sijin Li, Weichen Zhang, and Antoni B. Chan,
International Journal of Computer Vision (IJCV),
122(1):149-168,
March 2017.
Counting People Crossing a Line using Integer Programming and Local Features.Zheng Ma and Antoni B. Chan,
IEEE Trans. on Circuits and Systems for Video Technology (TCSVT),
26(10):1955-1969,
Oct 2016. [
appendix]
Understanding eye movements in face recognition using hidden Markov models.Tim Chuk, Antoni B. Chan, and Janet H. Hsiao,
Journal of Vision,
14(11):8,
Sep 2014.
Clustering hidden Markov models with variational HEM.Emanuele Coviello, Antoni B. Chan, and Gert R.G. Lanckriet,
Journal of Machine Learning Research (JMLR),
15(2):697-747,
Feb 2014. [
code]
Clustering Dynamic Textures with the Hierarchical EM Algorithm for Modeling Video.Adeel Mumtaz, Emanuele Coviello, Gert R.G. Lanckriet, and Antoni B. Chan,
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI),
35(7):1606-1621,
Jul 2013. [
appendix]
Counting People with Low-Level Features and Bayesian Regression.Antoni B. Chan and Nuno Vasconcelos,
IEEE Trans. on Image Processing (TIP),
21(4):2170-2177,
May 2012.
Layered dynamic textures.Antoni B. Chan and Nuno Vasconcelos,
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI),
31(10):1862-1879,
Oct 2009.
Modeling, clustering, and segmenting video with mixtures of dynamic textures.Antoni B. Chan and Nuno Vasconcelos,
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI),
30(5):909-926,
May 2008.
Modeling music as a dynamic texture.Luke Barrington, Antoni B. Chan, and Gert R.G. Lanckriet,
IEEE Trans. on Audio, Speech and Language Processing (TASLP),
18(3):602-612,
Mar 2010.
Supervised learning of semantic classes for image annotation and retrieval.Gustavo Carneiro, Antoni B. Chan, Pedro J. Moreno, and Nuno Vasconcelos,
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI),
29(3):394-410,
Mar 2007.
Google Scholar
Microsoft Academic
orcid.org/0000-0002-2886-2513
Scopus ID: 14015159100
Recent Project Pages [more]
Hierarchical Learning of Hidden Markov Models with Clustering Regularization We propose a novel tree structure variational Bayesian method to learn the individual model and group model simultaneously by treating the group models as the parents of individual models, so that the individual model is learned from observations and regularized by its parents, and conversely, the parent model will be optimized to best represent its children.
Chinese White Dolphin Detection in the Wild To reduce the human experts’ workload and improve the observation
accuracy, in this paper, we develop a practical system to detect Chinese White Dolphins in the wild automatically.
Recent Datasets and Code [more]
Dolphin-14k: Chinese White Dolphin detection dataset
A dataset consisting of Chinese White Dolphin (CWD) and distractors for detection tasks.
Crowd counting: Zero-shot cross-domain counting
Generalized loss function for crowd counting.

CVCS: Cross-View Cross-Scene Multi-View Crowd Counting Dataset
Synthetic dataset for cross-view cross-scene multi-view counting. The dataset contains 31 scenes, each with about ~100 camera views. For each scene, we capture 100 multi-view images of crowds.
Crowd counting: Generalized loss function
Generalized loss function for crowd counting.

Fine-Grained Crowd Counting Dataset
Dataset for fine-grained crowd counting, which differentiates a crowd into categories based on the low-level behavior attributes of the individuals (e.g. standing/sitting or violent behavior) and then counts the number of people in each category.

Teaching
- CS 4487 – Machine Learning (undergraduate) — 2015A-2018A.
- CS 5487 – Machine Learning: Principles & Practice (postgraduate) — 2012A-2022B.
- CS 5489 – Machine Learning: Algorithms & Applications (postgraduate) — 2020B-2021A.
- CS 6487 – Topics in Machine Learning (postgraduate) — 2019B.
- GE 2326 – Probability in Action: From the Unfinished Game to the Modern World — 2015B-2017B.
- GE 1319 – Interdisciplinary Research for Smart Professionals — 2013B-2017B.
- CS 5301 – Computer Programming — 2012A-2014A.
- CS 2363 – Computer Programming — 2009A-2011A.
- CS 3306 (B) – Contemporary Programming Methods in Java — 2010B.
- CS 4380 (B) – Web 2.0 Technologies — 2011B, 2012B.
- Final Year Project Coordinator
- Research Mentoring Scheme Coordinator
- MSCS Project and Guided Study Coordinator
- Multimedia Subject Group leader
- BScCM Deputy Programme Leader
Service
- Action Editor, Transactions on Machine Learning Research (2022-now)
- Senior Area Editor, IEEE Signal Processing Letters (2016-2020)
- Associate Editor, IEEE Signal Processing Letters (2014-2016)
- Conference Area Chair
- CVPR – 2020
- ICCV – 2015, 2017, 2019, 2021
- ECCV – 2022
- NeurIPS – 2020, 2021, 2022
- ICML – 2021, 2022
- ICLR – 2021, 2022
- ICPR – 2020
- Pacific Graphics – 2018
- Conference Senior PC
- AAAI – 2021, 2022
- IJCAI – 2019-20
- Conference Program Committees
- CVPR – 2012-2019, 2021, 2022
- ICCV – 2011, 2013
- ECCV – 2012, 2014, 2016, 2018
- ACCV – 2011, 2014, 2016
- ICML – 2012, 2013, 2014, 2015, 2018, 2019, 2020
- NIPS – 2015, 2017, 2018, 2019
- ICLR – 2022
- Siggraph (tertiary)- 2018
- Journal Reviewing
- IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI)
- IEEE Trans. on Image Processing (TIP)
- Intl. Journal Computer Vision (IJCV)
- IEEE Trans. on Circuits and Systems for Video Technology (TCSVT)
- IEEE Trans. on Neural Networks (TNN)
- IEEE Trans. on Multimedia
- IEEE Trans. Intelligent Transportation Systems
Awards and Honors
- Top 2% Most Highly Cited Researchers (Ioannidis et al. 2019. Plos Biology)
- The President’s Award, City University of Hong Kong, 2016.
- Early Career Award, Research Grants Council of Hong Kong, 2012.
- NSF IGERT Fellowship: Vision and Learning in Humans and Machines, UCSD, 2006-07.
- Outstanding Teaching Assistant Award, ECE Department, UCSD, 2005-06.
- Office of the President Award, UCSD, 2003.
- Henry G. White Scholorship, Cornell University, 2001.
- Knauss M. Engineering Scholorship, Cornell University, 2001.
- GTE Fellowship, Cornell University, 2001.
Mailing Address:
Prof. Antoni Chan,
Department of Computer Science,
City University of Hong Kong,
Tat Chee Avenue,
Kowloon Tong, Hong Kong.
IEEE Copyright Notice
©IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.