Missing annotations
Objects or regions with no label, which look like false positives later.
Synthex Annotation Quality Audit
Explore structured annotation quality review workflows to identify suspicious labels, segmentation inconsistencies and cases requiring expert attention.
Built with these teams in mind
Proposed offering. The explorer is illustrative; no files are uploaded or analysed on this website.
Common problems
Objects or regions with no label, which look like false positives later.
Right region, wrong class.
Masks or boxes that differ in how tightly they follow edges.
Experts who disagree, with no record of how it was resolved.
The same object labelled twice, inflating counts.
Conventions that drift between batches or annotators.
Missing or wrong metadata: source, annotator, version, split.
Audit workflow
The proposed audit workflow. Automated checks narrow the search; people make the decisions.
STEP 01
Agree the task, classes, conventions and quality expectations.
STEP 02
Check class definitions, label formats and metadata fields.
STEP 03
Geometry, overlap, duplication, class and metadata checks.
STEP 04
Rank cases by how likely their labels are to be wrong.
STEP 05
Route flagged cases to qualified reviewers with clear criteria.
STEP 06
Summarise findings, patterns and their likely impact.
STEP 07
Prioritised corrective actions and convention updates.
Interactive annotation explorer
Choose an annotation issue to see an illustrative input, its overlay, the highlighted problem, the reason for review and a suggested action. Educational example only: nothing is uploaded or analysed.
Illustrative Annotation Audit — Not a Live Analysis
Illustrative Demonstration01Input image
02Annotation overlay
03Highlighted issue
Reason for review
A second region with a similar appearance to the labelled finding has no annotation, so a model trained on it learns to ignore such regions — and a correct prediction there would later count as a false positive.
Example check: Candidate-region check against labelled structures
Recommended action
Send to expert review: confirm whether the region should be labelled, then correct the mask and record the decision.
A qualified reviewer makes the final decision.
Educational illustration with an original schematic drawing. No images are uploaded, stored or analysed, and the flags are written for this example rather than produced by software.
Deliverables
Potential deliverables, agreed during scoping.
Overall findings, patterns and their likely effect on training and evaluation.
Representative cases for each issue type, with explanations.
Flagged cases grouped and ranked for expert review.
Agreement and convention checks across annotators and batches.
Prioritised fixes and guideline updates.
Annotation Quality Audit
Describe your dataset, label types and the problems you suspect. We will discuss how an audit could be scoped — without you sharing any data through this website.
Please do not send datasets, images or patient information through the website.