Handwriting Movement Sonification for the Rehabilitation of ... - HAL

Handwriting Movement Sonification for the Rehabilitation of Dysgraphia J´er´emy Danna, Jean-Luc Velay, Vietminh Paz-Villagr´an, Annabelle Capel, C´eline Petroz, Charles Gondre, Etienne Thoret, Mitsuko Aramaki, Solvi Ystad, Richard Kronland-Martinet

To cite this version: J´er´emy Danna, Jean-Luc Velay, Vietminh Paz-Villagr´an, Annabelle Capel, C´eline Petroz, et al.. Handwriting Movement Sonification for the Rehabilitation of Dysgraphia. 10th International Symposium on Computer Music Multidisciplinary Research (CMMR) - Sound, Music & Motion - 15 - 18 oct. 2013 - Marseille, France, Oct 2013, Marseille, France. pp.200-208, 2013.

HAL Id: hal-00874974 https://hal.archives-ouvertes.fr/hal-00874974 Submitted on 20 Oct 2013

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.

L’archive ouverte pluridisciplinaire HAL, est destin´ee au d´epˆot et `a la diffusion de documents scientifiques de niveau recherche, publi´es ou non, ´emanant des ´etablissements d’enseignement et de recherche fran¸cais ou ´etrangers, des laboratoires publics ou priv´es.

Proc. of the 10th International Symposium on Computer Music Multidisciplinary Research, Marseille, France, October 15-18, 2013

!"#$%&'('#)*+,-./.#(*0,#'1'2"(',#*1,&*(3.* 4.3"5'6'("(',#*,1*789)&":3'"* !"##"$%&'('$)*+",$%-&'$."/0)1++"234#$)&'$5"6*+$78'$.9:3;/$58'$'$?@;3*:$ A>'$73"B"C1'$D>'$EF:"='$G>'$H3;#+"#=0D"3:1#*:$I>$$ &

$ $-"J;3":;13*$=*$K*L3;FM1*#M*F$5;2#1:1N*F'$ODI$P(Q&'$5KIG$–$71R0D"3F*1++*$O#1N*3F1:9$ ( $S3"1#$T$-"#2L"2*$I*F*"3M@$U#F:1:L:*'$-.-'$5KIG$–$71R0D"3F*1++*$O#1N*3F1:9$ 8$ !96"3:*B*#:$=VW3:@;6@;#1*'$X"ML+:9$=*$D9=*M1#*'$71R0D"3F*1++*$O#1N*3F1:9$ > $Laboratoire de Mécanique et d’Acoustique, UPR 7051, CNRS$ [email protected]$

;59(&"2(*D;:;3$M;#:3;+'$G;L#=F'$I*"+0:1B*$Y**=J"MC'$!,F23"6@1"$

?***@#(&,$A2(',#* ?@*$ B;:;3$ +*"3#1#2$ ;Y$ @"#=Z31:1#2$ 1F$ J;:@$ +;#2$ "#=$ =*B"#=1#2[$ G*N*3"+$ @L#=3*=$ @;L3F$;Y$63"M:1M*$"3*$#*M*FF"3,$:;$+*"3#$@;Z$:;$M;#:3;+$:@1F$Y1#*$2*F:L3*[$?@*$"J1+1:,$:;$ M;#:3;+$23"6@1M$ B;N*B*#:F$M+*"3+,$1B6"M:F$;#$:@*$ \L"+1:,$ ;Y$ Z31:1#2[$ O#Y;3:L#":*+,'$ J*:Z**#$ &]^$ "#=$ 8>^$ ;Y$ M@1+=3*#$ Y"1+$ 1#$ @"#=Z31:1#2$ +*"3#1#2$ "#=$ =1F6+",$ @"#=Z31:1#2$=1YY1ML+:1*F$_&'$(`[$?@*F*$M@1+=3*#$"3*$M;#F1=*3*=$"F$6;;3$Z31:*3$;3$Z1:@$"$ =,F23"6@1"[$ a*3*'$ Z*$ "=;6:$ :@*$ M+"FF1M$ =*Y1#1:1;#$ ;Y$ =,F23"6@1"'$ #"B*+,'$ "$ +*"3#1#2$ =1F"J1+1:,$ :@":$ M;#M*3#F$ :@*$ B*M@"#1M"+$ @"#=Z31:1#2$ FC1++'$ L#3*+":*=$ :;$ 3*"=1#2$ ;3$ F6*++1#2$"J1+1:1*F$_&`[$$ ?@*$ B"b;31:,$ ;Y$ M@1+=3*#$ "3*$ =1"2#;F*=$ Z1:@$ =,F23"6@1"$ =L*$ :;$ :@*13$ 1++*21J+*$ Z31:1#2$ :@":$ 1B6"M:F$ ;#$ :@*13$ "M"=*B1M$ FLMM*FF[$ U#$ ;:@*3$ Z;3=F'$ @"#=Z31:1#2$ 1F$ *N"+L":*=$B"1#+,$;#$:@*$J"F1F$;Y$"#$"#"+,F1F$;Y$:@*$@"#=Z31:1#2$63;=LM:'$1[*['$:@*$F:":1M$ :3"M*$ ;#$ :@*$ 6"6*3'$ 3":@*3$ :@"#$ :@*$ @"#=Z31:1#2$ 63;M*FF'$ #"B*+,$ :@*$ B;N*B*#:$ :@":$ 63;=LM*F$:@*$:3"M*[$The main problem is that some children with dysgraphia succeed in writing a word correctly, whereas the movement they make to produce it is not fluent. Because the most frequent complaint in children with dysgraphia concerns their legibility, these children are neither easy to diagnose nor easy to rehabilitate.

CMMR2013 - 200

Proc. of the 10th International Symposium on Computer Music Multidisciplinary Research, Marseille, France, October 15-18, 2013

!"##"$*:$"+[$ $

I#$M+"FF1M$63;:;M;+F$Y;3$=,F23"6@1"$3*@"J1+1:":1;#'$:@*$:@*3"61F:$M;33*M:F$:@*$child’s  B;N*B*#:F$LF1#2$:@*$63;=LM*=$:3"M*[$U#$!"#"$%&"'#$"(%:*3BF'$:@*,$LF*$FL66+*B*#:"3,$ Y**=J"MC$ J"F*=$ ;#$ :@*$ C#;Z+*=2*$ ;Y$ 3*FL+:F$ cHId$ _8`[$ GL66+*B*#:"3,$ Y**=J"MC$ M"#$ "+F;$1#Y;3B$LF$"J;L:$:@*$ Z31:1#2$ B;N*B*#:'$1#$;:@*3$Z;3=F'$"J;L:$:@*$ C#;Z+*=2*$;Y$ 6*3Y;3B"#M*$ cH.d[$ 5;#:3"3,$ :;$ HI$ Z@1M@$ 1F$ 1#*N1:"J+,$ 63;N1=*=$ "Y:*3$ :@*$ 6*3Y;3B"#M*'$ H.$ M"#$ J*$ 63;N1=*=$ *1:@*3$ "Y:*3$ ;3$ =L31#2$ :@*$ 6*3Y;3B"#M*[$ e*$ M@;F*$ :@*$+"::*3$;6:1;#$"#=$FL66+1*=$M@1+=3*#$Z1:@$=,F23"6@1"$Z1:@$3*"+0:1B*$FL66+*B*#:"3,$ Y**=J"MC$ =L31#2$ :@*$ *R*ML:1;#$ ;Y$ @"#=Z31:1#2$ B;N*B*#:$ 1#$ ;3=*3$ :;$ 1B63;N*$ :@*13$ 3*@"J1+1:":1;#[$$ $7+:@;L2@$:@*$LF*$;Y$FL66+*B*#:"3,$Y**=J"MC$:;$1B63;N*$@"#=Z31:1#2$B;N*B*#:F$ 1F$ #;:$ "$ #;N*+$ 1=*"$ _>`'$ :@*$ =*N*+;6B*#:$ ;Y$ #*Z$ :*M@#;+;21*F$ 1#$ :@*$ Y1*+=$ ;Y$ )$*+,"'"-.&/$ "#=$ 01-*'23"-+1#4$% 5'#4$*&#."'$ c*[2[$ 23"6@1M$ :"J+*:F$ ;3$ @"6:1M$ =*N1M*Fd$@"F$1B63;N*=$:@1F$:*M@#1\L*$J,$63;N1=1#2$:@*$Z31:*3$Z1:@$3*"+0:1B*$M;B6L:*30 "FF1F:*=$Y**=J"MC[$)"31;LF$M":*2;31/":1;#F$"3*$6;FF1J+*'$=*6*#=1#2$;#$ Z@*#$:@*,$"3*$ 3*M*1N*=$ c=L31#2$ ;3$ "Y:*3$ :@*$ 6*3Y;3B"#M*d'$ :@*13$ M;#:*#:F$ c*[2[$ F6":1"+'$ C1#*B":1M'$ =,#"B1M'$;3$J"F*=$;#$BLFML+"3$"M:1N1:,d$"#=$:@*13$B;="+1:,$cN1FL"+'$63;631;M*6:1N*$;3$ "L=1:;3,d[$$ ?