Test Images for Wallflower Paper

Established: September 1, 1999




This page contains the test images that we used for our Wallflower paper. We tested several different background maintenance algorithms on seven different image sequences. For each test image in the sequence, the output of the algorithm was an image segmented into background and foreground pixels.

Each of the seven different test sequences represents a different, potentially problematic scenario for background maintenance. In general we used the first 100 images in each sequence for training. We then ran each algorithm on the remainder of the sequence up to a prespecified evaluation image. We compared the algorithm’s result on the evaluation image to a hand-segmented version of the evaluation image.

We have created one .zip file for each of the seven test scenarios available under the ‘Downloads’ tab below. Each .zip file contains the training images, test images, and hand-segmented evaluation image for comparison, all in BMP format. Each .zip file also contains a file called “script.txt” that gives a short description of the events in the sequence and specifies which images are used for training, testing, and evaluation.

The table below shows sample images for each of the seven test scenarios.

For questions about these test images, please contact John Krumm at Microsoft Research.


Scenario First Training Image Evaluation Image Hand-Segmented
Evaluation Image
Moved Object
Moved Object Scenario, First Training Image
Moved Object Scenario, Evaluation Image
Moved Object Scenario, Hand-Segmented Evaluation Image
Chair is moved
Time of Day
Time of Day Scenario, First Training Image
Time of Day Scenario, Evaluation Image
Time of Day Scenario, Hand-Segmented Evaluation Image
Lights gradually brighten simulating moving sun
Light Switch
Light Switch Scenario, First Training Image
Light Switch Scenario, Evaluation Image
Light Switch Scenario, Hand-Segmented Evaluation Image
Person switches on light
Waving Trees
Waving Trees Scenario, First Training Image
Waving Trees Scenario, Evaluation Image
Waving Trees Scenario, Hand-Segmented Evaluation Image
Tree moving in background
Camouflage Scenario, First Training Image
Camouflage Scenario, Evaluation Image
Camouflage Scenario, Hand-Segmented Evaluation Image
Static foreground occludes dynamic background
Bootstrapping Scenario, First Training Image
Bootstrapping Scenario, Evaluation Image
Bootstrapping Scenario, Hand-Segmented Evaluation Image
No pure background training available
Foreground Aperture
Foreground Aperture Scenario, First Training Image
Foreground Aperture Scenario, Evaluation Image
Foreground Aperture Scenario, Hand-Segmented Evaluation Image
Trained on sleeping person who wakes up