OSF | Crepe Dataset Wiki
https://osf.io/d5k38/wiki/home/
! Home " Menu −
View
∠
Compare
' View Wiki Version: (Current) Kyuhwa Lee: 2017-05-18 18:27:13+00:00 UTC
% Project Wiki Pa… & Home (/d5k…
Crêpe Dataset
Summary The Crêpe Dataset provides 6 different types of structured cooking activity videos in 1920x1080 resolution. Each cooking activity is represented as a sequence of different action components. Notable features of this dataset includes: Structured activities as a sequence of component actions. Multiple activities running in parallel. Inclusion of distractors that are not relevant to defined activities. Every frame is annotated with bounding boxes, agent types, agent occlusion and action labels. We provide the following human-labeled annotations: Bounding box of every person Person type (action performer or distractor) Occlusion against another person Action label Activity label Here's a sample processed video superimposed with bounding boxes and action recognition likelihoods:
1 of 4
8/18/17, 3:27 PM
OSF | Crepe Dataset Wiki
https://osf.io/d5k38/wiki/home/
Sample processed video #4082
Actions 1. cut 2. flip 3. fold 4. grate 5. pour 6. spread 7. sprinkle 8. stir 9. transfer
Activities
2 of 4
1. Lemon and sugar
2. Nutella and banana with chocholate
3. Cheese and ham
stir
stir
stir
pour
pour
pour
spread
spread
spread
flip
cut
cut
pour
flip
grate
transfer
flip
grate
transfer
fold
fold
4. Cheese and ham with parsley
5. Goat cheese and spinach
6. Goat cheese and spinach with nutmeg
stir
stir
stir
pour
pour
pour
spread
spread
spread
cut
cut
cut
8/18/17, 3:27 PM
OSF | Crepe Dataset Wiki
https://osf.io/d5k38/wiki/home/
1. Lemon and sugar
2. Nutella and banana with chocholate
3. Cheese and ham
grate
flip
flip
cut
transfer
transfer
flip
fold
sprinkle
transfer
fold
sprinkle fold Please see Annotation folder for complete information.
Citation If you publish using our data set, we would appreciate if you cite: K. Lee, D. Ognibene, H. J. Chang, T. K. Kim and Y. Demiris, "STARE: SpatioTemporal Attention Relocation for Multiple Structured Activities Detection," in IEEE Transactions on Image Processing, vol. 24, no. 12, pp. 5916-5927, Dec. 2015. For questions and comments, please contact Kyuhwa Lee: lee.kyuh_at_gmail.com
The Crêpe dataset creation was funded by EPSRC Network on Vision and Language, under grant scheme Pump-Priming V&L Research 2013-1.
3 of 4
8/18/17, 3:27 PM
OSF | Crepe Dataset Wiki
https://osf.io/d5k38/wiki/home/
OSF
Center for Open Science
Socialize
Explore (https://osf.io /explore /activity/) Contact (mailto:contac
[email protected]) FAQ/Guides (https://osf.io /support) API (https://api.os f.io/v2/docs/) Source Code (https://github .com /CenterForOp enScience /osf.io)
Home (http://cos.io) Reproducibility Project: Psychology (https://osf.io/ezcuj/wiki/home/) Reproducibility Project: Cancer Biology (https://osf.io/e81xl/wiki/home/) TOP Guidelines (http://cos.io/top/) Donate (https://www.crowdrise.com /donate/charity/centerforopenscience)
( (http://twitter.com /OSFramework) ) (https://www.facebook.com
*
/CenterForOpenScience/) (https://groups.google.com /forum/#!forum /openscienceframework) (https://www.github.com
+
+
/centerforopenscience) (https://plus.google.com /b/104751442909573665859)
Copyright © 2011-2017 Center for Open Science (https://cos.io/) | Terms of Use (https://github.com /CenterForOpenScience/centerforopenscience.org/blob/master/TERMS_OF_USE.md) | Privacy Policy (https://github.com/CenterForOpenScience/centerforopenscience.org/blob/master/PRIVACY_POLICY.md)
4 of 4
8/18/17, 3:27 PM
