You can download the challenge set consisting of 47 liver segmentations, as well as 10 partial liver segmentation that have to be completed.
Please register/login to download the testing data
The provided liver segmentations are part of the training data from the "VISCERAL Organ Segmentation and Landmark Detection Challenge" at the IEEE International Symposium on Biomedical Imaging (ISBI) in May 1st, 2014 in Beijing, China. For more information on the ongoing VISCERAL Anatomy Benchmark series, please visit www.visceral.eu (which should also be acknowledged by citation, footnote, or other suitable means in any publication using any part of its dataset).
Please reference the Virtual Skeleton Database in your work as:
View online | plain text | as END | as RIS | as BibTex | Mendeley | CiteULike
The evaluation system for the Shape Symposium Challenge is now online.
To submit your liver reconstructions, please follow the instructions on this page!
Below are a few important administrative information:
The reconstruction will be evaluated according to the following criteria:
For every point of the first mesh, its distance to the closest point on the second triangle mesh is computed. The average over all points is returned. The average distance will be evaluated symmetrically, i.e. from the ground truth to the reconstruction, and from the reconstruction to the ground truth. The returned value is the average of the evaluation in both directions.
The lower the value, the better the reconstruction.
For every point of the reconstructed triangle mesh, its distance to the closest point on the ground truth mesh is computed. Also, for every point of the ground truth triangle mesh, its distance to the closest point on the reconstructed mesh is computed. The maximum over all values is returned.
The lower the value, the better the reconstruction.
Both metrics are implemented as part of the Scalismo library. The source code is available here
so please make sure that your reconstructions are correctly aligned with the provided incomplete data to obtain meaningful values.
For each submitted reconstructed mesh, both metrics are evaluated : - Average mesh distance - Hausdorff mesh distance
ranking of the participant according to their performance (e.g. if there are 10 participants, the best performing algorithm gets 1 point and the worst performing algorithm gets 10 point). Each participant is therefore ranked 20 times. The final ranking will be the average of the individual rankings.
Reconstructions are to be submitted as triangle meshes, in the STL file format
1. You have to name your results exactly like this template NAMESPACE.description.vsdid.stl
: For case 79 use VSD.shape2015_case_079.87048.stl
. Here's the list for all cases:
VSD.shape2015_case_079.87048.stl
VSD.shape2015_case_082.87049.stl
VSD.shape2015_case_085.87050.stl
VSD.shape2015_case_132.87041.stl
VSD.shape2015_case_133.87042.stl
VSD.shape2015_case_134.87043.stl
VSD.shape2015_case_135.87044.stl
VSD.shape2015_case_136.87045.stl
VSD.shape2015_case_337.87046.stl
VSD.shape2015_case_340.87047.stl
2. Upload your files using the Upload & Evaluation page
3. Multiple versions: To keep track ouf your versions, you can change the description part in the filename.
A 1st version:
VSD.case_079_v1.87048.stl
and a modified 2nd version:
VSD.case_079_v2.87048.stl
4. Additional information for the template definition
namespace
string
required
static
value: VSD
description:
string
optional
user defined
no special character except undersocores `_` or dashes `-`
example: shape2015_case_079
vsdid (of the partials image)
integer
required
static per case
example: 07048
extension:
string
required
static
value: .stl