Adriana Wilde (St Andrews): Rising to challenges in assessment, feedback and encouraging gender diversity in computing (School Seminar)

Abstract

This talk is in two parts, in the first of which Adriana will focus on her experiences in assessment and feedback in large classes, and in the second part on her work in encouraging gender diversity in computer science.

The focus of the first part will be on her involvement in redesigning an undergraduate module on HCI, where the methods of assessment used were no suitable for increasingly larger classes (up to 160 students). Redesign decisions needed to preserve the validity and reliability of the assessment whilst respecting the need for timely feedback. Adriana will specifically talk about the exam and coursework, and how learning activities in the module were aligned to the assessment, through the use of PeerWise for student-authored MCQs, and the use of video for assessment to foster creativity and application of knowledge. During the talk, there will be an opportunity for discussion on the challenges then encountered.

A (shorter) second part of the talk will present her experiences in supporting women in computing, starting with a very small-scale intervention with staff and students at her previous institution, and concluding with her engagement at the Early Career Women’s Network in St Andrews.

Event details

  • When: 23rd January 2018 14:00 - 15:00
  • Where: Cole 1.33a
  • Series: School Seminar Series
  • Format: Seminar

PhD viva success: Adam Barwell

Congratulations to Adam Barwell, who successfully defended his thesis yesterday. Adam’s thesis was supervised by Professor Kevin Hammond. He is pictured with second supervisor Dr Christopher Brown, Internal examiner Dr Susmit Sarkar and external examiner Professor Susan Eisenbach from Imperial College, London.

iVoLVER receives Best Demo Jury Award at ACM ISS

The iVoLVER system, created by Gonzalo Méndez and Miguel Nacenta from the SACHI group at the School of Computer Science, University of St Andrews, received Best Demo Jury Award at the ACM Interactive Surfaces and Spaces (ACM ISS) conference last week.

ACM ISS 2017, took place in Brighton, UK and selects a different location each year, with Tokyo, Japan selected as next year’s destination. The conference is a premier venue for research that studies how people interact in smart spaces and surfaces and how to design and engineer solutions for novel interfaces.

iVoLVER is a web-based visual programming environment that enables anyone to transform visualizations that they find in-the-wild (e.g., in a poster or a newspaper) into new visualizations that are more useful for them. Congratulations to the iVoLVER team. You can try out the open source iVoLVER prototype using a browser.

An example iVoLVER interface

Best Demo Jury Award

Ott: Effective Tool Support for the Working Semanticist

ACM SIGPLAN has judged Ott: Effective Tool Support for the Working Semanticist, by Peter Sewell, Francesco Zappa Nardelli, Scott Owens, Gilles Peskine, Thomas Ridge, Susmit Sarkar, and Rok Strniša, to be the recipient of the Most Influential ICFP Paper Award for 2017. From the citation:

“Over the past ten years, ICFP researchers have benefitted tremendously from the open-source tool and the effective design space exploration that it promotes.”

n-Queens Completion is NP-Complete

Update, 2021

Over the years since we published this research, many people have approached us having solved the n queens puzzle, either for one n like 8 or 1000, or having written an algorithm to solve it for different sizes.  Unfortunately this is not a major result in Computer Science and does not make one eligible to claim the $1M Clay prize. Many have been disappointed by this so we want to clarify why  this is the case. 

It is true that work on this problem could potentially result in the award but only if some exceptionally difficult conditions are met.

  • EITHER prove mathematically that NO possible algorithm could solve the n queens completion problem in polynomial time;
  • OR prove that there is an algorithm which is guaranteed to solve every instance of the n queens completion problem in polynomial time. Note that in this case the algorithm has to work on the completion version of the problem studied in our paper, not placing queens on an empty board; the algorithm has to give the correct answer on every possible instance given to it; and there has to be a mathematical proof that the algorithm’s runtime is bounded above by some polynomial in the size of the board.  However fast a given algorithm runs when tested, this is not sufficient because there are an infinite number of possible tests available, so a mathematical proof is required.
  • AND in either case, prove this at a level that is published in a respected academic source and is widely accepted by research experts as correct.

We are delighted that our work has led so many people to be interested in the problem of solving problems like the n queens puzzle that fascinates us.  But we also apologise for any impression we gave, unintentionally, that a solution to the n queens puzzle could lead to the award of the prize except under the extremely strenuous conditions listed above.

Ian Gent, 10 May 2021

Original Post from 2017:

Ian Gent, Christopher Jefferson and Peter Nightingale have shown that a classic chess puzzle is NP-Complete. Their paper “Complexity of n-Queens Completion” was published in the Journal of Artificial Intelligence Research on August 30, 2017.

The n-Queens puzzle is a classic chess problem: given a chessboard of size n by n, can you place n queens so that no two queens attack each other?  That is, can you place the queens with no two queens are on the same row, column, or diagonal? The n-Queens puzzle has long been known to be simple to solve:  you can solve the problem for all n except 2 and 3, and solutions for all other n can be described in a few lines.  This very simplicity has led to repeated

Peter Nightingale and Ian Gent at Falkland Palace, Wednesday, 17 August 2017.
©Stuart Nicol Photography, 2017

controversy in Artificial Intelligence (AI). The n-Queens puzzle is often used as a benchmark problem, but good results on the problem can always be challenged because the problem is so simple to solve without using AI methods.

The new work follows a challenge on Facebook on New Year’s Day, 2015, when a friend of Ian’s asked him how hard n-Queens is if some queens were already placed on the board.  It turns out, this version (dating from 1850) of the puzzle is only two years younger than the more famous n-Queens problem. The picture shows Peter (left) and Ian (right) with queens on the board at positions suggested by Nauck in 1850, the squares b4 and d5.  Can you put another 6 queens on the board so that the entire board is a solution of 8-Queens?  The general version with some number of queens preplaced on an n by n board is the n-Queens Completion puzzle.

 

With queens at b4 and d5, can you place 6 more queens to get a solution to the 8-queens puzzle? ©Stuart Nicol Photography, 2017

Ian, Christopher and Peter have shown that the n-Queens puzzle is in fact hard, not simple.  It belongs to the complexity classes NP-Complete and #P-Complete. Other NP-Complete problems include the “travelling salesperson problem”, finding cliques in graphs, and many other important problems, from scheduling to circuit layout. This puts n-Queens Completion at the centre of the most important theoretical problem in computer science — it has long been known that either all NP-complete problems are easy, or none of them are. Most computer scientists believe that this means there is no efficient algorithm possible for solving this problem, compared to the very simple techniques long known for n-Queens.
The importance of this work is that it provides researchers with a benchmark that can be used for evaluating AI techniques. Moreover, it helps to explain why so many AI techniques have been used on the n-Queens puzzle. Most techniques do most of their work with some queens partially placed, using some form of (hopefully intelligent) trial and error. In fact it turns out that many researchers – in order to solve a simple problem – have solved it by turning the simple problem of n-Queens into the hard problem of n-Queens Completion.
It does seem that AI researchers should not use n-Queens as a benchmark, but the very closely related n-Queens Completion puzzle is a valid benchmark. As well as the theoretical results, the paper shows how example instances can be generated which appear to be hard in practice. Some caution is still needed, though. It does seem to be quite hard to generate hard instances of n-Queens Completion.
The University has also issued an article on the same paper, under the title “Simple” chess puzzle holds key to $1m prize

Senior Honours: Poster Presentation and Demo Session 2017

Our talented hard working SH students from CS4099: Major Software Project and CS4098: Minor Software Project presented their posters and final year software artifact to staff and students earlier this week.

As Illustrated in the above collage, the busy poster session is the perfect opportunity to discuss output from their year long project with markers, and provides time to share research ideas and reflect on the experience with their peer group. We wish them success with forthcoming exams and look forward to seeing them during June graduation celebrations.

Hot off the press: Type-Driven Development with Idris

A new book, Type-Driven Development with Idris has just been published by Manning Publications. Written by Dr Edwin Brady, the creator of Idris, Type-Driven Development with Idris teaches you how to improve the performance and accuracy of your programs by taking advantage of a state-of-the-art type system.

Type-driven development is an approach to programming that embraces types as the foundation of your code. It is based on the concept of “dependent types”, which allow you to express relationships and other assumptions directly in your code, and have these assumptions checked by the compiler. With this approach, you can define specifications early in development and write code that’s easy to maintain, test, and extend.

Dr Brady said:

“Idris arose as a result of my own research into program verification and language design with advanced type systems. After spending several years immersed in the concept of programming with dependent types, I felt there was a need for a language designed for developers and practitioners as well as researchers. By teaching the concept of type-driven development using Idris, the book aims to make state-of-the-art verification techniques accessible to software practitioners.”

The book is currently available via MANNING publications: https://www.manning.com/books/type-driven-development-with-idris. ePub and Kindle versions available from April 10th. The source code, chapter 1 and chapter 13 are available as free downloads.

Distinguished Lecture Series 2017: Dr David Manlove

On March 31st, Dr David Manlove from the University of Glasgow, delivered the semester two distinguished lectures in Lower and Upper College Hall. The overall title was algorithms for healthcare-related matching problems.

David started with an overview of complexity theory and solving hard problems. He gave examples of this in practice, for example how researchers constructed a best-possible tour around the best 20,000 pubs in the UK. The second lecture focussed on how to assign junior doctors to hospitals in the best way, a very practical problem but with interesting complexity issues. The final lecture focussed on the life-changing topic of how to set up exchanges of kidneys between healthy donors and patients needing transplants. David talked about how his expertise in algorithms has been translated into regularly finding the best possible matches which then result in real transplants taking place.

David is pictured above at various stages of the distinguished lecture series and outside College Hall with Head of School, Prof Steve Linton, Prof Ian Gent and Dr Ishbel Duncan,

Videos from the DLS can be accessed on Vimeo –
Lecture 1: https://vimeo.com/211633740
Lecture 2: https://vimeo.com/211634119
Lecture 3: https://vimeo.com/211634923

Images courtesy of Ryo Yanagida.

Team NOMAD win IDEA Explosion 2017

Congratulations to PhD students Shyam Reyal and Simone Conte , from Computer Science and Senior Scientific Officer Tomas Lebl, from Chemistry who presented NOMAD (NMR Online Management and Datastore) at IDEA Explosion 2017 and emerged victorious. Shyam delivered a five-minute elevator pitch, whilst Simone and Tomas responded to questions. Judges acknowledged that NOMAD has huge potential with researchers, and were impressed that it has been used in St Andrews for the past 5 years, with other universities now lined-up to make use of its services, fully supporting the use of the prize money to set-up a company.


Continue reading