Hi, thank you for releasing the VSCD benchmark and code!
I am evaluating a scene change detection method on the released synthetic
test set and would like to reproduce the “Object changes” breakdown in
Table 3 using exactly the same grouping as the paper.
Using the default directed pairs (0→1, 1→2, 2→3, 3→4, 4→0), the downloaded
test set contains 44 layouts and 220 video pairs.
I found object-presence/deletion text files for only these four layouts:
- Modern Hotel Room
- Neoclassical Living 01
- Vintage Room
- Wabi Sabi Living 03
These files allow us to derive appearance/disappearance counts for 20
default video pairs, but I could not find equivalent metadata for the
remaining layouts.
Could you please clarify:
-
Does the “Object changes” breakdown in Table 3 cover all 220 synthetic
test pairs, or only a subset? If a subset was used, could you share its
pair list and the number of pairs in each group?
-
Could you share the per-pair changed-instance counts, or simply the
official Low/Mid/High group assignments used for Table 3?
A CSV with the following fields would be sufficient:
layout, reference_scene, query_scene, changed_instance_count, object_change_bin
-
Can the O/X presence tables in the released text files be used directly
to reproduce these counts? In particular, how are relocated objects and
objects consisting of multiple mesh components counted?
I understand the thresholds in Table 5 are:
Low: <5, Mid: 5–15, High: >15 changed instances.
If this metadata or a grouping script is already available, a pointer to
its location would be greatly appreciated.
Thank you for your help!
Hi, thank you for releasing the VSCD benchmark and code!
I am evaluating a scene change detection method on the released synthetic
test set and would like to reproduce the “Object changes” breakdown in
Table 3 using exactly the same grouping as the paper.
Using the default directed pairs (0→1, 1→2, 2→3, 3→4, 4→0), the downloaded
test set contains 44 layouts and 220 video pairs.
I found object-presence/deletion text files for only these four layouts:
These files allow us to derive appearance/disappearance counts for 20
default video pairs, but I could not find equivalent metadata for the
remaining layouts.
Could you please clarify:
Does the “Object changes” breakdown in Table 3 cover all 220 synthetic
test pairs, or only a subset? If a subset was used, could you share its
pair list and the number of pairs in each group?
Could you share the per-pair changed-instance counts, or simply the
official Low/Mid/High group assignments used for Table 3?
A CSV with the following fields would be sufficient:
layout, reference_scene, query_scene, changed_instance_count, object_change_binCan the O/X presence tables in the released text files be used directly
to reproduce these counts? In particular, how are relocated objects and
objects consisting of multiple mesh components counted?
I understand the thresholds in Table 5 are:
Low: <5, Mid: 5–15, High: >15 changed instances.
If this metadata or a grouping script is already available, a pointer to
its location would be greatly appreciated.
Thank you for your help!