# Petar Veličković

Hello, and welcome to one of my homes on the web (my personally hosted blog being a less formal one)!

I am currently working as a Research Assistant in Computational Biology within the Artificial Intelligence Group of the Computer Laboratory, where I am working on developing machine learning algorithms on complex networks, and their applications to bioinformatics.

Apart from that I'm also a PhD student within the group, supervised by Dr Pietro Liò (with Dr Thomas Sauerwald as my second adviser) and affiliated with Trinity College.

I hold a BA degree in Computer Science from the University of Cambridge, having completed the Computer Science Tripos in 2015.

I am a proud recipient of the Computer Laboratory Wiseman Award for 2017, for my contribution to the work of the Department (through supervision of coursework and student projects, and developing and running practical lab sessions).

My Erdős number is 4, and can be derived in the following way: Paul Erdős → Nathan Linial → Ran El-Yaniv → Yoshua Bengio → Petar Veličković.

## Publications

Cucurull, G., Wagstyl, K., Casanova, A., **Veličković, P.**, Jakobsen, E., Romero, A., Evans, A. and Bengio, Y. (2017) **Graph Convolutional Neural Networks for Cortical Mesh Segmentation**. *BigNeuro Workshop at the 31 ^{st} Annual Conference on Neural Information Processing Systems (NIPS 2017)*.

Peychev, M., **Veličković, P.** and Liò, P. (2017) **Quantifying the Effects of Enforcing Disentanglement on Variational Autoencoders**. *Workshop on Learning Disentangled Representations at the 31 ^{st} Annual Conference on Neural Information Processing Systems (NIPS 2017)*. [arXiv preprint] [poster]

**Veličković, P.**, Cucurull, G., Casanova, A., Romero, A., Liò, P. and Bengio, Y. (2017) **Graph Attention Networks**. [arXiv preprint]

**Veličković, P.**, Karazija, L., Lane, ND., Bhattacharya, S., Liberis, E., Liò, P., Chieh, A., Bellahsen, O. and Vegreville, M. (2017) **Cross-modal recurrent models for weight objective prediction from multimodal time-series data**. *Workshop on Machine Learning for Health at the 31 ^{st} Annual Conference on Neural Information Processing Systems (NIPS ML4H 2017)*. [arXiv preprint] [poster]

This work has also been presented at the 2017 NIPS Time Series Workshop and ObesityWeek 2017.

Liberis, E., **Veličković, P.**, Sormanni, P., Vendruscolo, M. and Liò, P. (2017) **Paratope Prediction using Convolutional and Recurrent Neural Networks**. [bioRxiv preprint]

Cangea, C., **Veličković, P.** and Liò, P. (2017) **XFlow: 1D-2D Cross-modal Deep Neural Networks for Audiovisual Classification**. *Workshop on Computational Models for Crossmodal Learning (CMCML) at The 7 ^{th} Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics (IEEE ICDL-EPIROB 2017)*. [arXiv preprint] [poster]

This work has also been presented at the

*ARM Research Summit 2017*.

**Veličković, P.**, Lane, ND., Bhattacharya, S., Chieh, A., Bellahsen, O. and Vegreville, M. (2017) **Scaling health analytics to millions without compromising privacy using deep distributed behaviour models**. *The 11 ^{th} EAI International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth 2017)*.

**Veličković, P.**, Wang, D., Lane, ND. and Liò, P. (2016) **X-CNN: Cross-modal convolutional neural networks for sparse datasets**. *The 7 ^{th} IEEE Symposium Series on Computational Intelligence (IEEE SSCI 2016)*, doi:10.1109/SSCI.2016.7849978 [arXiv preprint] [slides] [poster]

This work has also been presented at the

*ARM Research Summit 2016*, the

*ARM-Cambridge Research Showcase*and the

*Fourth Edinburgh Deep Learning Workshop*.

**Veličković, P.**, Ivašković, A., Lau, S. and Stanojević, M. (2016) **Viral: Real-world competing process simulations on multiplex networks**. *The 1 ^{st} Belgrade Bioinformatics Conference (BelBi 2016)*.

**Veličković, P.** and Liò, P. (2016) **muxstep: an open-source C++ multiplex HMM library for making inferences on multiple data types**. *Bioinformatics*, doi:10.1093/bioinformatics/btw196

**Veličković, P.** and Liò, P. (2015) **Molecular multiplex network inference using Gaussian mixture hidden Markov models**. *Journal of Complex Networks*, doi:10.1093/comnet/cnv029

## Software

**facejack**: a Python application highlighting the perils of deploying neural networks as components of secure authentication systems, leveraging adversarial learning as an attack vector. *Third prize at Hack Cambridge Recurse.*

**Viral**: Java-based client-server application that facilitates real-life simulations of epidemics (and other spreading processes) in modern society, using a multilayer network back-end. *One of the seven finalist projects at Hack Cambridge*.

**muxstep**: an open-sourced generalised C++ library implementation of the Multiplex (GM)HMM model proposed in previous research, designed to be immediately useful out-of-the-box as well as easily extendable for specific user needs.

## Lecturing

Thus far, I have held five formal lectures to undergraduate and postgraduate students. I enjoy lecturing, and would definitely be interested in further opportunities within this scope.

**Be nice to your neurons: Initialisation, Normalisation, Optimisation and Regularisation**. Introduction to Deep Learning (COMPGI23), *University College London*, 14 November 2017.

**Unsupervised methods: Diving deep into autoencoders**. Introduction to Deep Learning (COMPGI23), *University College London*, 10 October 2017.

**A trip down long short-term memory lane**. Research Students Lecture Series, 21 February 2017.

**Exactly solving TSP using the Simplex algorithm** (with Thomas Sauerwald). Advanced Algorithms, 13 May 2016, 17 May 2017.

Furthermore, I have been in charge of designing the practical session on neural networks for the MPhil course on Machine Learning and Algorithms for Data Mining (L42).

## Talks

**Overview of neural network architectures for graph-structured data analysis**. Computational Biology Group Meeting, 21 November 2016. *Department of Computer Science and Technology, University of Cambridge*

**Demystifying deep learning**. London Data Science Summit, 20 October 2017. *Royal Statistical Society*

Also presented at the DIAL Seminar Series, 17 May 2017. *Institute for Manufacturing, University of Cambridge*

**How to get a neural network to do what you want: Loss function engineering**. Trinity College Engineering Society Talk Series, 3 March 2017. *Winstanley Lecture Theatre, Trinity College, Cambridge*

**How to Win a Hackathon**. Hackers at Cambridge Events, 2 March 2017. *Computer Laboratory, University of Cambridge*

**Reinforcement learning fundamentals**. Nokia Tech Talk Series, 11 October 2016. *Nokia Technologies Cambridge*

**Exploring large-scale reinforcement learning tasks? Exploit deep learning.**. Cambridge Coding Academy Evening Tech Talk Series, 20 September 2016. *Google Campus London*

**AlphaGo: Superhuman artificial intelligence in exponentially growing spaces**. Cambridge Coding Academy Evening Tech Talk Series, 25 August 2016. *THECUBE London*

**How to make a (GameBoy) emulator?**. Cambridge Coding Academy Summer School, 13 July 2016. *Computer Laboratory, University of Cambridge*

**Deep reinforcement learning: DQN and extensions**. NVIDIA Deep Learning Day, 30 June 2016. *New Museums Site, University of Cambridge*

**Competitive programming**. Computational Biology Group Meeting, 5 May 2016. *Computer Laboratory, University of Cambridge*

**Viral: Realne simulacije konkurentnih procesa nad multipleks mrežama** (with Andrej Ivašković). Bioinformatics Seminar, 6 April 2016. *Faculty of Mathematics, University of Belgrade*

**Multiplex network inference (using hidden Markov models)**. Computational Biology Group Meeting, 11 February 2016. *Computer Laboratory, University of Cambridge*

## Supervisions

I currently supervise, have supervised, or will be supervising, the project work of the following students (with completed dissertations, where possible, available for download by anyone with a Raven account):

- Benjamin Day (2016)
**Combining Machine Learning & Multilayer Network Theory**.*Natural Sciences Tripos Part III Computational Project (co-supervised*). Project mark 91/100* - Ioana Bica (2017)
**Comparative Analysis of Neural Network Architectures for Epigenetics Inference**.*Computer Science Tripos Part II Project Dissertation. Project mark 73/100* - Momchil Peychev (2017)
**Experimental Study on the Properties of Disentangled Autoencoders**.*Computer Science Tripos Part II Project Dissertation. Project mark 82/100* - Tudor Petru Ţiplea (2017)
**An end-to-end control policy system for the GameBoy platform**.*Computer Science Tripos Part II Project Dissertation. Project mark 87/100***(Highly commended dissertation)** - Edgaras Liberis (2017)
**Antibody Binding Residue Prediction**.*Computer Science Tripos Part III Project Dissertation (co-supervised*). Project mark 86/100* - Laurynas Karazija (2017)
**Automatic inference of cross-modal connection topologies for X-CNNs**.*Computer Science Tripos Part III Project Dissertation (co-supervised*). Project mark 89/100***(Dr John Maheswaran Prize for a Highly Commended Project Report)** - Cătălina Cangea (2017)
**1D-2D Cross-modality for deep audiovisual classification**.*MPhil in Advanced Computer Science Project Dissertation (co-supervised*). Project mark 84/100* - Andreea-Ioana Deac (2018)
**Neural architectures for end-to-end paratope prediction**.*Computer Science Tripos Part II Project Dissertation.* - Miloš Stanojević (2018)
**Neural network hyperparameter optimisation on small validation sets**.*Computer Science Tripos Part III Project Dissertation (co-supervised*).* - Nathaniel McAleese-Park (2018)
**Cross-modal learning for the joint understanding of 2D and 3D data**.*Computer Science Tripos Part III Project Dissertation (co-supervised*).* - Emil Maid (2018)
**Artificial neural networks modelled with Boolean algebra**.*MPhil in Advanced Computer Science Project Dissertation (co-supervised*).*

*for "co-supervised" projects, my name has not been listed as one of the official supervisor(s) (primarily due to constraints on eligibility for supervisors of Master's level projects). I have, however, made a significant contribution to the supervision of these projects, and will be listed as a co-author on any relevant subsequent publications.

I currently supervise, have supervised, or will be supervising, the following courses:

- Advanced Algorithms (Easter 2016, Easter 2017)
- Algorithms (Lent 2017, Lent 2018)
- Artificial Intelligence (Easter 2018)
- Artificial Intelligence II (Lent 2016)
- Bioinformatics (Michaelmas 2016, Michaelmas 2017)
- Compiler Construction (Lent 2016, Lent 2017)
- Complexity Theory (Easter 2017, Easter 2018)
- Computation Theory (Lent 2016, Lent 2017)
- Concepts in Programming Languages (Easter 2016)
- Concurrent and Distributed Systems (Michaelmas 2016, Lent 2017)
- Databases (Lent 2016, Lent 2017)
- Discrete Mathematics (Michaelmas 2017, Lent 2018)
- Foundations of Data Science (Michaelmas 2017)
- Further Java (Michaelmas 2016)
- Logic and Proof (Lent 2017)
- Machine Learning and Bayesian Inference (Lent 2017)
- Mathematical Methods for Computer Science (Michaelmas 2016)
- Numerical Methods (Easter 2017)
- Programming in C and C++ (Michaelmas 2016)
- Quantum Computing (Michaelmas 2017)
- Security I (Easter 2016)
- Semantics of Programming Languages (Michaelmas 2016)

As a product of preparing these supervisions, I have also created a set of example sheets and auxiliary materials. I'll leave them here, so that they can be found more easily.

- Advanced Algorithms - k-best 0-1 Knapsack Problem
- Algorithms - Example Pre-Sheet
- Algorithms - Example Sheet 1
- Algorithms - Example Sheet 2
- Algorithms - Example Sheet 3
- Algorithms - Example Sheet 4
- Algorithms - Example Sheet 5
- Algorithms - Example Sheet 6
- Bioinformatics - Example Sheet 1
- Bioinformatics - Example Sheet 2
- Bioinformatics - Example Sheet 3
- Bioinformatics - Expectation Maximisation Notes
- Compiler Construction - Example Sheet 1
- Compiler Construction - Example Sheet 2
- Compiler Construction - Example Sheet 3
- Compiler Construction - Example Sheet 3++
- Compiler Construction (+ Databases) - Example Sheet 4
- Compiler Construction (+ Databases) - Example Sheet 5
- Security I - Example Sheet 1
- Security I - Example Sheet 2

## Work experience

I have attained substantial work experience spanning a wide variety of Computer Science fields, through five summer internships and other placements during my undergraduate and PhD degrees:

- 2017: I have been a visiting researcher at the Montréal Institute for Learning Algorithms (MILA) over the summer, working with Dr Adriana Romero and Prof Yoshua Bengio.
- 2016: I have worked as a research associate at Nokia Bell Labs, as part of a continued (and ongoing) collaboration with Dr Nic Lane. The result of this work is the submission of four (so far!) papers relevant to the scope of my PhD, with three being already accepted for publication.
- 2015: I have worked as a software developer intern at Jane Street. This allowed me to experience first-hand one of the major real-world uses of functional programming, and particularly how it's used for efficient quantitative trading. I have worked directly on trading-specific critical systems, as well as on infrastructure and standard library development (contributing directly to Jane Street's Core standard library), primarily in OCaml. My work was highly commended.
- 2014: I have worked on the Altera-sponsored summer placement at the Computer Laboratory's Computer Architecture Group, under the supervision of Prof Simon Moore. I have worked in parallel on developing debugging and tracing utilities as part of the ongoing CHERI research project, as well as developing potential future teaching resources. The projects have been successfully executed.
- 2013: I have interned as a software engineer at Microsoft Development Center Serbia, where I was part of a four-man team in charge of creating a prototype for a brand new stress testing tool; it was my job to handle the entire implementation and present the results achieved to the test leads in the US; the project was extremely successful.

## Interests

I am highly active as a machine learning educator. To this end, I collaborate heavily with Cambridge Spark, a Cambridge-based startup for continual and professional development. I contributed to their work in the following ways, ordered (roughly) chronologically:

- Writing an introductory tutorial series on machine learning with deep neural networks using Keras, titled "Deep learning for complete beginners":
- Recognising handwritten digits
- Convolutional neural networks with Keras
- Neural network fine-tuning techniques

- Delivering two evening tech talks in London, focussing on current machine learning trends, and accessible to the wider public (both full house events):
- AlphaGo: Superhuman artificial intelligence in exponentially growing spaces
- Exploring large-scale reinforcement learning tasks? Expoit deep learning.

- Initially tutoring, and then also helping the continual development of the Machine Learning Techniques using Python bootcamp. Thus far, I have tutored variants of it in London, Cambridge and Glasgow, to various bootcamp cohorts as well as several industry clients.
- Leading the development of the "Neural Networks and Deep Learning" module of the Applied Data Science part-time course, to be offered for the first time starting October 2017.
- Giving a talk on demystifying deep learning, as well as leading a practical workshop on neural networks and deep learning, at the London Data Science Summit 2017 organised by Cambridge Spark and the Royal Statistical Society.

Along with Andrej Ivašković and Miloš Stanojević, in 2015 I have kickstarted the mgcsweek seminar at the Mathematical Grammar School in Belgrade. This seminar aims to give insights into a variety of Computer Science topics, to ~20 of the most gifted high school students, for a week during each school year. Through this seminar I was given the excellent opportunity to give lectures on several topics in Computer Science I find particularly interesting:

- Bioinformatics algorithms: analysis of DNA sequences
- How to make a (GameBoy) emulator?
- Computer security: authentication protocols and passwords
- Great software disasters
- Linear programming and the Simplex algorithm
- IQ sampling and FM demodulation using MATLAB
- Markov chains, PageRank and clustering
- Multiplex network inference
- AlphaGo: superhuman artificial intelligence in exponentially growing spaces
- Data compression on DNA molecules
- Anatomy of an electronic trading system
- Neural networks
- Deep learning workshop in Keras
- Security in IoT and AI

Thus far the seminar has been very successful and has expanded far beyond our original conceptions, with the potential of spreading across the specialised high schools in Serbia. It was covered by the Serbian national television (RTS) twice: (mgcsweek1), (mgcsweek2), as well as by the Serbian Science Television (mgcsweek3).

I used to be an extremely avid competitive programmer (and still compete on Codeforces occasionally). Achievements I'm happy about on that front include:

- Silver medal at the ACM-ICPC Northwestern Europe Regional Contest 2016 in Bath, United Kingdom;
- Bronze medal at the ACM-ICPC Northwestern Europe Regional Contest 2014 in Linköping, Sweden;
- Ranked 5th at the Final Round of the Google Hash Code 2017 contest in Paris, France;
- Four-time finalist at the Bubble Cup contest, organised by Microsoft Development Center Serbia (in 2012, 2013, 2014 and 2016);
- Ranked 311st at the Facebook Hacker Cup 2016 Round 2 (sufficient to win a Facebook t-shirt);
- Ranked 2nd overall at Codeforces Round #169 (Div. 2);
- Third prize at the Serbian Olympiad in Informatics in 2012.

I'm currently far more active as a problem *setter* than solver, though; since 2014 I'm a member of the Serbian Committee for Competitions in Informatics, which is responsible for organising contests on all levels from regional all the way to the Serbian Olympiad in Informatics, determining Serbia's team for the International Olympiad in Informatics.

I am also proud to be serving as the coach for all ACM-ICPC teams from Cambridge for 2017. One of my teams, Me[N]ta∭ca, has won the ACM-ICPC Northwestern Europe Regional Contest 2017 (in Bath, United Kingdom), and will compete at the ACM-ICPC World Finals (in Beijing, China)!

Aside from this, I also enjoy hackathons. I've attended seven of them so far, with Hack Cambridge being the most successful one by far (having made it into the top seven projects for two years straight, winning a 3rd prize in 2017, as well as spearheading the project that ended up becoming Viral).

## Contact

**Address:**

Petar Veličković

Office FE14

Artificial Intelligence Group

Computer Laboratory

University of Cambridge

15 JJ Thomson Avenue

Cambridge CB3 0FD

United Kingdom

**Phone:** +44 (0)1223 763544

**Email:** petar [dot] velickovic [at] cst [dot] cam [dot] ac [dot] uk