SRG Seminar: “Introduction to Apache Mesos and the DataCenter Operating System” by Matt Jarvis

Abstract
Data processing paradigms are undergoing a paradigm shift as we move more and more towards real time processing. Emerging software models such as the SMACK stack are at the forefront of this change, focused on a pipeline processing model, but are also introducing new levels of operational complexity in running multiple complex distributed systems such as Spark, Kafka and Cassandra. In this talk, I’ll introduce both Apache Mesos and DC/OS as a solution to this growing problem, and describe the benefits are of running these new kinds of systems for emerging cloud native workloads.
 
Bio
Matt Jarvis is Senior Director of Community and Evangelism at Mesosphere, engaging with the communities around DC/OS and Mesos. Matt has spent more than 15 years building products and services around open source software, on everything from embedded devices to large scale distributed systems. Most recently he has been focused on the open cloud infrastructure space, and in emerging patterns for cloud native applications. 

Event details

  • When: 24th April 2018 13:00 - 14:00
  • Where: Cole 1.33b
  • Series: Systems Seminars Series
  • Format: Seminar

SRG Seminar: “On Engineering Unikernels” by Ward Jaradat

We have explored data coordination techniques that permit distributed systems to be constructed by interconnecting services. In such systems the network latency is often a problem. For example, large data volumes might have to be transmitted across the network if computation cannot be co-located close to data sources. One solution to this problem is the ability to deploy services in appropriate geographical locations and compose them together to create distributed ecosystems. Hence we seek to be able to deploy such services rapidly and dynamically enact and orchestrate them. However, this goal is hindered by the size of the deployments. Currently, virtual machine appliances that host such services on top of monolithic kernels are very large, thus are potentially slow to deploy as they may need to be transmitted across a network.

Our principles led us to take the route of re-engineering the standard software stack to create self-contained applications that are less-bloated and consequently much smaller based on Unikernels. Unikernels are compact library operating systems that enable a single application to be statically linked against a simple kernel that manages the underlying resources presented by a hypervisor. In this talk I will present Stardust – a specialised Unikernel that aims to support the deployment of application services based on the Java programming language.

Event details

  • When: 15th March 2018 13:00 - 14:00
  • Where: Cole 1.33b
  • Series: Systems Seminars Series
  • Format: Seminar

Marwan Fayed (St Andrews): Quality of Experience Fairness for Adaptive Video Streams in the Network (School Seminar)

Abstract:

“Why is my kid getting HD on their phone, while I’m stuck with SD on my 50″ TV?” This type of complaint is among the most common directed to streaming services such as Netflix and BBC. Recent studies observe that adaptive video streams, when competing behind a bottleneck link, generate flows that lead to instability, under-utilization, and unfairness. Additional measurements suggest there may also be a negative impact on users’ perceived quality of experience as a consequence. The intuitive response may be, and has been, that application-generated issues should be resolved by the application. In this presentation I shall demonstrate that fairness, by any definition, can only be solved in the network. Moreover, that in an increasingly HTTP-S world, some form of client interaction is required. In support, a new network-layer ‘QoE-fairness’ metric will be be introduced that reflects user experience. Experiments using our open-source implementation in the home environment reinforce the network-layer as the right place to attack the general problem.

Refs-

[1] http://dl.ifip.org/db/conf/networking/networking2015/1570066341.pdf
[2] https://dl.acm.org/citation.cfm?id=2940144

Speaker Bio:
Marwan Fayed joined the University of St Andrews in 2018. He received his MA from Boston University and his PhD from the University of Ottawa, in 2003 and 2009 respectively, and in between worked at Microsoft as a member of the Core Reliability Group. In 2009 he joined the University of Stirling, UK as Scottish Informatics and Computer Science Alliance (SICSA) Lecturer, alongside an appointment to ‘Theme Leader’ for networking research in Scotland, 2014-2016. His current research interests lie in wireless algorithms, as well as general network, transport, and measurement in next generation edge networks. He is a co-founder of HUBS C.i.C., an ISP focussed on rural communities, recipient of an IEEE best paper award, and a Senior Member of both the IEEE and ACM.

Event details

  • When: 17th April 2018 14:00 - 15:00
  • Where: Cole 1.33a
  • Series: School Seminar Series
  • Format: Seminar

DLS: Functional Foundations for Operating Systems

Biography: Dr. Anil Madhavapeddy is a University Lecturer at the Cambridge Computer Laboratory, and a Fellow of Pembroke College where he is Director of Studies for Computer Science. He has worked in industry (NetApp, Citrix, Intel), academia (Cambridge, Imperial, UCLA) and startups (XenSource, Unikernel Systems, Docker) over the past two decades. At Cambridge, he directs the OCaml Labs research group which delves into the intersection of functional programming and systems, and is a maintainer on many open source projects such as OpenBSD, OCaml, Xen and Docker.

Timetable
9:30: Introduction by Professor Saleem Bhatti
9:35: Lecture 1
10:35: Break with tea and coffee
11:15: Lecture 2
12:15: Lunch (not provided)
14:00: Lecture 3
15:00: Close by Professor Simon Dobson

Lecture 1: Rebuilding Operating Systems with Functional Principles
The software stacks that we deploy across computing devices in the world are based on shaky foundations. Millions of lines of C code crammed into monolithic operating system kernels, mixed with layers of scheduling logic, wrapped in a hypervisor, and served with a dose of nominal security checking on the side. In this talk, I will describe an alternative approach to constructing reliable, specialised systems with a familiar developer experience. We will use modular functional programming to build several services such as a secure web server that have no reliance on conventional operating systems, and explain how to express their logic in a high level, functional fashion. By the end of it, everyone in the audience should be able to build their own so-called unikernels!

Lecture 2: The First Billion Real Deployments of Unikernels
Unikernels offer a path to a more sane basis for driving applications on hardware, but will they ever be adopted for real? For the past fifteen years, an intrepid group of adventurers have been developing the MirageOS application stack in the OCaml programming language. Along the way, it has been deployed in many unusual industrial situations that I will describe in this talk, starting with the Docker container stack, then moving onto the Xen hypervisor that drives billions of servers worldwide. I will explain the challenges of using functional programming in industry, but also the rewards of seeing successful deployments quietly working in mission-critical areas of systems software.

Lecture 3: Programming the Next Trillion Embedded Devices
The unikernel approach of compiling highly specialised applications from high-level source code is perfectly suited to programming the trillions of embedded devices that are making their way around the world. However, this raises new challenges from a programming language perspective: how can we run on a spectrum of devices from the very tiny (with just kilobytes of RAM) to specialised hardware? I will describe the new frontier of functional metaprogramming (programs which generate more programs) that we are using to compile a single application to many heterogenous devices, and a Git-like model to coordinate across thousands of nodes. I will conclude with by motivating the need for a next-generation operating system to power new exciting applications such as augmented and virtual reality in our situated environments, and remove the need for constant centralised coordination via the Internet.

Event details

  • When: 13th February 2018 09:30 - 15:15
  • Where: Byre Theatre
  • Series: Distinguished Lectures Series, Systems Seminars Series
  • Format: Distinguished lecture

Matthew Rice (Open Rights Group): Do we need the Third Sector in the debate about technology and ethics? (School Seminar)

Abstract:

Matthew Rice, Scotland Director for the Open Rights Group, the digital rights campaigning organisation, will lead a seminar discussing the role of civil society organisations in the discourse of technology, rights, regulation, and norms. Computer Scientists sit at an important point in this debate, as individuals affected by changes in norms, but more importantly as builders of the applications and the infrastructure that reflect these norms.

The seminar will discuss the impact civil society has on changing norms and laws around the world, and why these actors matter in the space between governments, companies, and wider society. It will introduce students to the Open Rights Group, the UK’s only technology and human rights grassroots campaigning organisation on t, and its current work in the area of technology and human rights.

Digital technology has transformed the way we live and opened up limitless new ways to communicate, connect, share and learn across the world. But for all the benefits, technological developments have created new threats to our human rights. The Open Rights Group raise awareness of these threats and challenge them through public campaigns, legal actions, policy interventions and tech projects.

Event details

  • When: 1st May 2018 14:00 - 15:00
  • Where: Cole 1.33a
  • Series: School Seminar Series
  • Format: Seminar

Arnau Erola (Oxford): Corporate Insider Threat Detection (School Seminar)

Abstract:

It is widely recognised that the threat to enterprises from insider activities is increasing, and that significant costs are being incurred. Since insider threat and compromising actions can take a multitude of forms, there is a diverse experience and understanding of what insider threats are, and how to detect or prevent them. We investigate the potential for detection of insider threat activities within a large enterprise environment using monitoring tools centred around the information infrastructure. In this seminar we will review our experiences and lessons learnt from the implementation and trial of the Corporate Insider Threat Detection (CITD) tool in real organizations, not only from a technical perspective, but also from the legal and ethical aspects.

Speaker Bio:

Dr Arnau Erola is a cyber security expert with strong background in data analytics, machine learning, data mining and information privacy. He is currently a Research Fellow at the Cyber Analytics group of Oxford University, working on enterprise security, defence systems and better understanding the cyber-threat landscape. Dr Erola holds a Ph. D., M. Sc. and B.Sc. in Computer Science from the Rovira i Virgili University of Tarragona (URV). He is author of several international journal articles on online privacy, anonymity protocols and intrusion detection mechanisms.

Event details

  • When: 24th April 2018 14:00 - 15:00
  • Where: Cole 1.33a
  • Series: School Seminar Series
  • Format: Seminar

Elliott Brooks (The HUT Group): Technology at The HUT Group (School Seminar)

Abstract:

The HUT Group have a variety of engineering, UX and data science teams solving real-world customer and logistics problems. This presentation looks at a variety of solutions applied across the business, from continuous release processes to warehouse layout approaches.

Speaker Bio:

Elliott graduated from CS at St Andrews in 2016, and now works within the research and development team at THG.

Event details

  • When: 3rd April 2018 14:00 - 15:00
  • Where: Cole 1.33a
  • Series: School Seminar Series
  • Format: Seminar

Alice Miller (Glasgow): Probabilistic model checking for UAV strategy generation (School Seminar)

Abstract:

I will describe how the PRISM model checker was used to generate strategies for an Unmanned Aerial Vehicle (UAV), specifically to determine search strategies for a UAV trying to find objects within a grid, for a range of scenarios. Parameters and probabilities for our models were informed by simulation models developed in the School of Engineering’s Micro Air Systems Technologies (MAST) Laboratory. Our generated controllers can now be used within the simulation models (and ultimately in UAV controller software).

This is joint work with colleagues from the Schools of Computing Science (Gethin Norman, Ruth Hoffmann and Ruben Giaquinta) and the School of Engineering (Murray Ireland).

Speaker Bio:

Alice Miller is a Senior Lecturer in Computing Science at the University of Glasgow. She works in Formal Methods and Graph Theory, with a particular interest in Symmetry. Before working at Glasgow she worked at the Universities of Western Australia, East Anglia and Stirling.

Event details

  • When: 10th April 2018 14:00 - 15:00
  • Where: Cole 1.33a
  • Series: School Seminar Series
  • Format: Seminar