video
stringlengths
41
50
conversations
listlengths
2
2
type
stringclasses
2 values
question_type
stringclasses
7 values
question_type_detail
stringclasses
9 values
source
stringclasses
3 values
question
stringlengths
126
444
ground_truth
stringclasses
748 values
scannet_videos_128f/train/scene0642_00_128f.mp4
[ { "from": "human", "value": "<image>These are frames of a video.\nWhat will be the first-time appearance order of the following categories in the video: nightstand, mirror, chair, tv?\nOptions:\nA. nightstand, tv, chair, mirror\nB. tv, chair, nightstand, mirror\nC. nightstand, mirror, chair, tv\nD. nightsta...
mc
appearance_order
appearance_order
scannet
<image>These are frames of a video. What will be the first-time appearance order of the following categories in the video: nightstand, mirror, chair, tv? Options: A. nightstand, tv, chair, mirror B. tv, chair, nightstand, mirror C. nightstand, mirror, chair, tv D. nightstand, chair, tv, mirror Answer with the option's letter from the given choices directly.
B
scannet_videos_128f/train/scene0270_01_128f.mp4
[ { "from": "human", "value": "<image>These are frames of a video.\nWhat will be the first-time appearance order of the following categories in the video: towel, microwave, pillow, door?\nOptions:\nA. pillow, door, microwave, towel\nB. towel, microwave, pillow, door\nC. microwave, pillow, towel, door\nD. pill...
mc
appearance_order
appearance_order
scannet
<image>These are frames of a video. What will be the first-time appearance order of the following categories in the video: towel, microwave, pillow, door? Options: A. pillow, door, microwave, towel B. towel, microwave, pillow, door C. microwave, pillow, towel, door D. pillow, towel, microwave, door Answer with the option's letter from the given choices directly.
A
scannet_videos_128f/train/scene0311_00_128f.mp4
[ { "from": "human", "value": "<image>These are frames of a video.\nWhat will be the first-time appearance order of the following categories in the video: trash bin, counter, table, clock?\nOptions:\nA. trash bin, counter, table, clock\nB. counter, trash bin, table, clock\nC. table, trash bin, counter, clock\...
mc
appearance_order
appearance_order
scannet
<image>These are frames of a video. What will be the first-time appearance order of the following categories in the video: trash bin, counter, table, clock? Options: A. trash bin, counter, table, clock B. counter, trash bin, table, clock C. table, trash bin, counter, clock D. clock, trash bin, counter, table Answer with the option's letter from the given choices directly.
C
scannet_videos_128f/train/scene0642_00_128f.mp4
[ { "from": "human", "value": "<image>These are frames of a video.\nWhat will be the first-time appearance order of the following categories in the video: lamp, nightstand, towel, chair?\nOptions:\nA. towel, chair, nightstand, lamp\nB. lamp, nightstand, towel, chair\nC. nightstand, chair, towel, lamp\nD. chai...
mc
appearance_order
appearance_order
scannet
<image>These are frames of a video. What will be the first-time appearance order of the following categories in the video: lamp, nightstand, towel, chair? Options: A. towel, chair, nightstand, lamp B. lamp, nightstand, towel, chair C. nightstand, chair, towel, lamp D. chair, lamp, nightstand, towel Answer with the option's letter from the given choices directly.
D
scannet_videos_128f/train/scene0024_01_128f.mp4
[ { "from": "human", "value": "<image>These are frames of a video.\nWhat will be the first-time appearance order of the following categories in the video: table, radiator, plant, chair?\nOptions:\nA. plant, chair, table, radiator\nB. table, chair, plant, radiator\nC. table, radiator, plant, chair\nD. chair, p...
mc
appearance_order
appearance_order
scannet
<image>These are frames of a video. What will be the first-time appearance order of the following categories in the video: table, radiator, plant, chair? Options: A. plant, chair, table, radiator B. table, chair, plant, radiator C. table, radiator, plant, chair D. chair, plant, radiator, table Answer with the option's letter from the given choices directly.
A
scannet_videos_128f/train/scene0327_00_128f.mp4
[ { "from": "human", "value": "<image>These are frames of a video.\nWhat will be the first-time appearance order of the following categories in the video: refrigerator, telephone, counter, trash bin?\nOptions:\nA. refrigerator, counter, trash bin, telephone\nB. telephone, refrigerator, trash bin, counter\nC. ...
mc
appearance_order
appearance_order
scannet
<image>These are frames of a video. What will be the first-time appearance order of the following categories in the video: refrigerator, telephone, counter, trash bin? Options: A. refrigerator, counter, trash bin, telephone B. telephone, refrigerator, trash bin, counter C. refrigerator, counter, telephone, trash bin D. refrigerator, telephone, counter, trash bin Answer with the option's letter from the given choices directly.
C
scannet_videos_128f/train/scene0677_00_128f.mp4
[ { "from": "human", "value": "<image>These are frames of a video.\nWhat will be the first-time appearance order of the following categories in the video: tv, lamp, door, bed?\nOptions:\nA. lamp, door, bed, tv\nB. tv, lamp, door, bed\nC. bed, door, lamp, tv\nD. bed, lamp, tv, door\nAnswer with the option's le...
mc
appearance_order
appearance_order
scannet
<image>These are frames of a video. What will be the first-time appearance order of the following categories in the video: tv, lamp, door, bed? Options: A. lamp, door, bed, tv B. tv, lamp, door, bed C. bed, door, lamp, tv D. bed, lamp, tv, door Answer with the option's letter from the given choices directly.
D
scannet_videos_128f/train/scene0642_00_128f.mp4
[ { "from": "human", "value": "<image>These are frames of a video.\nWhat will be the first-time appearance order of the following categories in the video: lamp, nightstand, mirror, trash bin?\nOptions:\nA. lamp, nightstand, mirror, trash bin\nB. mirror, lamp, nightstand, trash bin\nC. trash bin, lamp, nightst...
mc
appearance_order
appearance_order
scannet
<image>These are frames of a video. What will be the first-time appearance order of the following categories in the video: lamp, nightstand, mirror, trash bin? Options: A. lamp, nightstand, mirror, trash bin B. mirror, lamp, nightstand, trash bin C. trash bin, lamp, nightstand, mirror D. nightstand, lamp, mirror, trash bin Answer with the option's letter from the given choices directly.
C
scannet_videos_128f/train/scene0209_02_128f.mp4
[ { "from": "human", "value": "<image>These are frames of a video.\nWhat will be the first-time appearance order of the following categories in the video: nightstand, backpack, tv, pillow?\nOptions:\nA. tv, pillow, backpack, nightstand\nB. tv, nightstand, backpack, pillow\nC. nightstand, backpack, tv, pillow\...
mc
appearance_order
appearance_order
scannet
<image>These are frames of a video. What will be the first-time appearance order of the following categories in the video: nightstand, backpack, tv, pillow? Options: A. tv, pillow, backpack, nightstand B. tv, nightstand, backpack, pillow C. nightstand, backpack, tv, pillow D. tv, pillow, nightstand, backpack Answer with the option's letter from the given choices directly.
D
scannet_videos_128f/train/scene0166_00_128f.mp4
[ { "from": "human", "value": "<image>These are frames of a video.\nWhat will be the first-time appearance order of the following categories in the video: lamp, printer, pillow, door?\nOptions:\nA. lamp, printer, pillow, door\nB. pillow, printer, lamp, door\nC. lamp, door, pillow, printer\nD. lamp, printer, d...
mc
appearance_order
appearance_order
scannet
<image>These are frames of a video. What will be the first-time appearance order of the following categories in the video: lamp, printer, pillow, door? Options: A. lamp, printer, pillow, door B. pillow, printer, lamp, door C. lamp, door, pillow, printer D. lamp, printer, door, pillow Answer with the option's letter from the given choices directly.
D