Computer Laboratory

Petar Veličković

Hello, and welcome to one of my homes on the web (my personally hosted blog being a less formal one)!

I am currently working as a Research Assistant in Computational Biology within the Artificial Intelligence Group of the Computer Laboratory, where I am working on developing machine learning algorithms on complex networks, and their applications to bioinformatics.

Apart from that I'm also a PhD student within the group, supervised by Dr Pietro Liò (with Dr Thomas Sauerwald as my second adviser) and affiliated with Trinity College.

I hold a BA degree in Computer Science from the University of Cambridge, having completed the Computer Science Tripos in 2015.

I am a proud recipient of the Computer Laboratory Wiseman Award for 2017, for my contribution to the work of the Department (through supervision of coursework and student projects, and developing and running practical lab sessions).

My Erdős number is 4, and can be derived in the following way: Paul Erdős Nathan Linial Ran El-Yaniv Yoshua Bengio Petar Veličković.

Publications

Cucurull, G., Wagstyl, K., Casanova, A., Veličković, P., Jakobsen, E., Romero, A., Evans, A. and Bengio, Y. (2017) Graph Convolutional Neural Networks for Cortical Mesh Segmentation. BigNeuro Workshop at the 31st Annual Conference on Neural Information Processing Systems (NIPS 2017).

Peychev, M., Veličković, P. and Liò, P. (2017) Quantifying the Effects of Enforcing Disentanglement on Variational Autoencoders. Workshop on Learning Disentangled Representations at the 31st Annual Conference on Neural Information Processing Systems (NIPS 2017).

Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P. and Bengio, Y. (2017) Graph Attention Networks. [arXiv preprint]

Veličković, P., Karazija, L., Lane, ND., Bhattacharya, S., Liberis, E., Liò, P., Chieh, A., Bellahsen, O. and Vegreville, M. (2017) Cross-modal recurrent models for human weight objective prediction from multimodal time-series data. Workshop on Machine Learning for Health at the 31st Annual Conference on Neural Information Processing Systems (NIPS ML4H 2017). [arXiv preprint]

Liberis, E., Veličković, P., Sormanni, P., Vendruscolo, M. and Liò, P. (2017) Paratope Prediction using Convolutional and Recurrent Neural Networks. [bioRxiv preprint]

Veličković, P., Bellahsen, O., Chieh, A., Lane, ND., Bhattacharya, S., Liò, P., Vegreville, M. and Roitmann, E. (2017) Predicting the outcome of user-defined weight goals using data from consumer-grade connected devices. ObesityWeek 2017.

Cangea, C., Veličković, P. and Liò, P. (2017) XFlow: 1D-2D Cross-modal Deep Neural Networks for Audiovisual Classification. Workshop on Computational Models for Crossmodal Learning (CMCML) at The 7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics (IEEE ICDL-EPIROB 2017). [arXiv preprint] [poster]
This work has also been presented at the ARM Research Summit 2017.

Veličković, P., Lane, ND., Bhattacharya, S., Chieh, A., Bellahsen, O. and Vegreville, M. (2017) Scaling health analytics to millions without compromising privacy using deep distributed behaviour models. The 11th EAI International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth 2017).

Veličković, P., Wang, D., Lane, ND. and Liò, P. (2016) X-CNN: Cross-modal convolutional neural networks for sparse datasets. The 7th IEEE Symposium Series on Computational Intelligence (IEEE SSCI 2016), doi:10.1109/SSCI.2016.7849978 [arXiv preprint] [slides] [poster]
This work has also been presented at the ARM Research Summit 2016, the ARM-Cambridge Research Showcase and the Fourth Edinburgh Deep Learning Workshop.

Veličković, P., Ivašković, A., Lau, S. and Stanojević, M. (2016) Viral: Real-world competing process simulations on multiplex networks. The 1st Belgrade Bioinformatics Conference (BelBi 2016).

Veličković, P. and Liò, P. (2016) muxstep: an open-source C++ multiplex HMM library for making inferences on multiple data types. Bioinformatics, doi:10.1093/bioinformatics/btw196

Veličković, P. and Liò, P. (2015) Molecular multiplex network inference using Gaussian mixture hidden Markov models. Journal of Complex Networks, doi:10.1093/comnet/cnv029

Software

facejack: a Python application highlighting the perils of deploying neural networks as components of secure authentication systems, leveraging adversarial learning as an attack vector. Third prize at Hack Cambridge Recurse.

Viral: Java-based client-server application that facilitates real-life simulations of epidemics (and other spreading processes) in modern society, using a multilayer network back-end. One of the seven finalist projects at Hack Cambridge.

muxstep: an open-sourced generalised C++ library implementation of the Multiplex (GM)HMM model proposed in previous research, designed to be immediately useful out-of-the-box as well as easily extendable for specific user needs.

Lecturing

Thus far, I have held five formal lectures to undergraduate and postgraduate students. I enjoy lecturing, and would definitely be interested in further opportunities within this scope.

Be nice to your neurons: Initialisation, Normalisation, Optimisation and Regularisation. Introduction to Deep Learning (COMPGI23), University College London, 14 November 2017.

Unsupervised methods: Diving deep into autoencoders. Introduction to Deep Learning (COMPGI23), University College London, 10 October 2017.

A trip down long short-term memory lane. Research Students Lecture Series, 21 February 2017.

Exactly solving TSP using the Simplex algorithm (with Thomas Sauerwald). Advanced Algorithms, 13 May 2016, 17 May 2017.

Furthermore, I have been in charge of designing the practical session on neural networks for the MPhil course on Machine Learning and Algorithms for Data Mining (L42).

Talks

Demystifying deep learning. London Data Science Summit, 20 October 2017. Royal Statistical Society
Also presented at the DIAL Seminar Series, 17 May 2017. Institute for Manufacturing, University of Cambridge

How to get a neural network to do what you want: Loss function engineering. Trinity College Engineering Society Talk Series, 3 March 2017. Winstanley Lecture Theatre, Trinity College, Cambridge

How to Win a Hackathon. Hackers at Cambridge Events, 2 March 2017. Computer Laboratory, University of Cambridge

Reinforcement learning fundamentals. Nokia Tech Talk Series, 11 October 2016. Nokia Technologies Cambridge

Exploring large-scale reinforcement learning tasks? Exploit deep learning.. Cambridge Coding Academy Evening Tech Talk Series, 20 September 2016. Google Campus London

AlphaGo: Superhuman artificial intelligence in exponentially growing spaces. Cambridge Coding Academy Evening Tech Talk Series, 25 August 2016. THECUBE London

How to make a (GameBoy) emulator?. Cambridge Coding Academy Summer School, 13 July 2016. Computer Laboratory, University of Cambridge

Deep reinforcement learning: DQN and extensions. NVIDIA Deep Learning Day, 30 June 2016. New Museums Site, University of Cambridge

Competitive programming. Computational Biology Group Meeting, 5 May 2016. Computer Laboratory, University of Cambridge

Viral: Realne simulacije konkurentnih procesa nad multipleks mrežama (with Andrej Ivašković). Bioinformatics Seminar, 6 April 2016. Faculty of Mathematics, University of Belgrade

Multiplex network inference (using hidden Markov models). Computational Biology Group Meeting, 11 February 2016. Computer Laboratory, University of Cambridge

Supervisions

I currently supervise, have supervised, or will be supervising, the project work of the following students (with completed dissertations, where possible, available for download by anyone with a Raven account):

  • Benjamin Day (2016) Combining Machine Learning & Multilayer Network Theory. Natural Sciences Tripos Part III Computational Project (co-supervised*). Project mark 91/100
  • Ioana Bica (2017) Comparative Analysis of Neural Network Architectures for Epigenetics Inference. Computer Science Tripos Part II Project Dissertation. Project mark 73/100
  • Momchil Peychev (2017) Experimental Study on the Properties of Disentangled Autoencoders. Computer Science Tripos Part II Project Dissertation. Project mark 82/100
  • Tudor Petru Ţiplea (2017) An end-to-end control policy system for the GameBoy platform. Computer Science Tripos Part II Project Dissertation. Project mark 87/100
    (Highly commended dissertation)
  • Edgaras Liberis (2017) Antibody Binding Residue Prediction. Computer Science Tripos Part III Project Dissertation (co-supervised*). Project mark 86/100
  • Laurynas Karazija (2017) Automatic inference of cross-modal connection topologies for X-CNNs. Computer Science Tripos Part III Project Dissertation (co-supervised*). Project mark 89/100 (Dr John Maheswaran Prize for a Highly Commended Project Report)
  • Cătălina Cangea (2017) 1D-2D Cross-modality for deep audiovisual classification. MPhil in Advanced Computer Science Project Dissertation (co-supervised*). Project mark 84/100
  • Andreea-Ioana Deac (2018) Neural architectures for end-to-end paratope prediction. Computer Science Tripos Part II Project Dissertation.
  • Miloš Stanojević (2018) Neural network hyperparameter optimisation on small validation sets. Computer Science Tripos Part III Project Dissertation (co-supervised*).
  • Nathaniel McAleese-Park (2018) Cross-modal learning for the joint understanding of 2D and 3D data. Computer Science Tripos Part III Project Dissertation (co-supervised*).
  • Emil Maid (2018) Artificial neural networks modelled with Boolean algebra. MPhil in Advanced Computer Science Project Dissertation (co-supervised*).

*for "co-supervised" projects, my name has not been listed as one of the official supervisor(s) (primarily due to constraints on eligibility for supervisors of Master's level projects). I have, however, made a significant contribution to the supervision of these projects, and will be listed as a co-author on any relevant subsequent publications.

I currently supervise, have supervised, or will be supervising, the following courses:

As a product of preparing these supervisions, I have also created a set of example sheets and auxiliary materials. I'll leave them here, so that they can be found more easily.

Work experience

I have attained substantial work experience spanning a wide variety of Computer Science fields, through five summer internships and other placements during my undergraduate and PhD degrees:

  • 2017: I have been a visiting researcher at the Montréal Institute for Learning Algorithms (MILA) over the summer, working with Dr Adriana Romero and Prof Yoshua Bengio.
  • 2016: I have worked as a research associate at Nokia Bell Labs, as part of a continued (and ongoing) collaboration with Dr Nic Lane. The result of this work is the submission of four (so far!) papers relevant to the scope of my PhD, with three being already accepted for publication.
  • 2015: I have worked as a software developer intern at Jane Street. This allowed me to experience first-hand one of the major real-world uses of functional programming, and particularly how it's used for efficient quantitative trading. I have worked directly on trading-specific critical systems, as well as on infrastructure and standard library development (contributing directly to Jane Street's Core standard library), primarily in OCaml. My work was highly commended.
  • 2014: I have worked on the Altera-sponsored summer placement at the Computer Laboratory's Computer Architecture Group, under the supervision of Prof Simon Moore. I have worked in parallel on developing debugging and tracing utilities as part of the ongoing CHERI research project, as well as developing potential future teaching resources. The projects have been successfully executed.
  • 2013: I have interned as a software engineer at Microsoft Development Center Serbia, where I was part of a four-man team in charge of creating a prototype for a brand new stress testing tool; it was my job to handle the entire implementation and present the results achieved to the test leads in the US; the project was extremely successful.

Interests

I am highly active as a machine learning educator. To this end, I collaborate heavily with Cambridge Spark, a Cambridge-based startup for continual and professional development. I contributed to their work in the following ways, ordered (roughly) chronologically:

Along with Andrej Ivašković and Miloš Stanojević, in 2015 I have kickstarted the mgcsweek seminar at the Mathematical Grammar School in Belgrade. This seminar aims to give insights into a variety of Computer Science topics, to ~20 of the most gifted high school students, for a week during each school year. Through this seminar I was given the excellent opportunity to give lectures on several topics in Computer Science I find particularly interesting:

  • Bioinformatics algorithms: analysis of DNA sequences
  • How to make a (GameBoy) emulator?
  • Computer security: authentication protocols and passwords
  • Great software disasters
  • Linear programming and the Simplex algorithm
  • IQ sampling and FM demodulation using MATLAB
  • Markov chains, PageRank and clustering
  • Multiplex network inference
  • AlphaGo: superhuman artificial intelligence in exponentially growing spaces
  • Data compression on DNA molecules
  • Anatomy of an electronic trading system
  • Neural networks
  • Deep learning workshop in Keras
  • Security in IoT and AI

Thus far the seminar has been very successful and has expanded far beyond our original conceptions, with the potential of spreading across the specialised high schools in Serbia. It was covered by the Serbian national television (RTS) twice: (mgcsweek1), (mgcsweek2), as well as by the Serbian Science Television (mgcsweek3).

I used to be an extremely avid competitive programmer (and still compete on Codeforces occasionally). Achievements I'm happy about on that front include:

I'm currently far more active as a problem setter than solver, though; since 2014 I'm a member of the Serbian Committee for Competitions in Informatics, which is responsible for organising contests on all levels from regional all the way to the Serbian Olympiad in Informatics, determining Serbia's team for the International Olympiad in Informatics.

I am also proud to be serving as the coach for all ACM-ICPC teams from Cambridge for 2017.

Aside from this, I also enjoy hackathons. I've attended seven of them so far, with Hack Cambridge being the most successful one by far (having made it into the top seven projects for two years straight, winning a 3rd prize in 2017, as well as spearheading the project that ended up becoming Viral).

Contact

Address:
Petar Veličković
Office FE14
Artificial Intelligence Group
Computer Laboratory
University of Cambridge
15 JJ Thomson Avenue
Cambridge CB3 0FD
United Kingdom

Phone: +44 (0)1223 763544

Email: petar [dot] velickovic [at] cst [dot] cam [dot] ac [dot] uk