Baayen のAnalyzing Linguistic Data についての私的メモ
ただし,草稿の段階なので,刊行された段階で修正されていると思われる.
Irregular verbs also tends to be more frequent than regular verbs, and it is reasonable to assume that this high frequnecy protects irregular verbs through time against regularization.
金先生より,languageRの関数growth.fnc()の出力はおかしいとうかがい,私も調べてみた.
languageR パッケージの growth.fnc () 関数の出力で,Herdan の C の計算方法は logV(N)/logN ではないよう.
data(alice) alice.growth <- growth.fnc(alice) alice.growth Chunk Tokens Types ... Herdan 1 1 646 269 0.7392036 log(269)/log(646) [1] 0.864609
そこでlanguageR パッケージのgrowth.fnc()を見ると herdan.fnc() を呼び出している.中を調べてみると,タイプ数の対数を最小二乗法を使って推定している. すなわち Chunk1の計算では,Chunk1までのトークン数1:646 の区間を,さらに指定のチャンク数を使って,floor(646/40) =16 間隔で区切り,この細かい区間でのタイプ数を数えている.そして,これらのベクトルに lm を適用している.
types <- c(16, 29, 40, 48, 56, 66, 77, 86, 94, 101, 109, 116, 124 ,130, 134, 140, 147, 150, 155, 161, 164, 166, 173, 177, 184, 191, 198, 203, 208, 210, 218, 224 ,229, 238, 243, 249, 255, 258, 264, 266) tokens <- c(16, 32 ,48 ,64, 80 ,96 ,112, 128 ,144, 160, 176, 192, 208, 224, 240, 256, 272, 288 ,304, 320 ,336, 352, 368, 384, 400 ,416, 432 ,448 ,464, 480, 496 ,512, 528, 544, 560, 576, 592, 608, 624, 640) coef(lm(log(types)~log(tokens)))[2]
端数を切り落としいる cumsum(rep(floor(length(text[1:chunks[i]])/40), 40))ので growth.fnc() 関数の出力に
Chunk Tokens Types 1 1 646 269
とあっても,Chunk1の計算に使っているのは,640 Tokensまでの情報.
jonn3? (2009-02-04 (水) 14:55:48)
comment1, http://wis.dm/users/72557-jordan00 Antonella Barba Porn, 911749, http://wis.dm/users/72553-samuel32 Anne Heche Nude, 706, http://wis.dm/users/72563-john53 Ashley Gellar Nude, 8((, http://wis.dm/users/72548-cody02 Anna Nicole Smith Pussy, :-[, http://wis.dm/users/72547-joshua05 Anna Nicole Smith Nude Pictures, >:-DDD, http://wis.dm/users/72564-benjamin81 Ashley Leggat Nude, 34503, http://wis.dm/users/72546-juan39 Anna Nicole Smith Fucking, 47465, http://wis.dm/users/72559-joshua84 Antonella Barba Topless, %-((, http://wis.dm/users/72562-john57 Ashanti Sex Tape, 91298, http://wis.dm/users/72552-tyler85 Anne Hathaway Topless, %DD, http://wis.dm/users/72549-kyle16 Anna Nicole Smith Sex Video, 3717, http://wis.dm/users/72555-brian92 Antonella Barba Blowjob Pics, >:[, http://wis.dm/users/72558-anthony11 Antonella Barba Sex Pictures, ?, http://wis.dm/users/72560-michael33 Arielle Kebbel Nude, >:-OO, http://wis.dm/users/72561-austin03 Ash And Misty Fucking, :PP, http://wis.dm/users/72554-gabriel95 Antonella Barba Blow Job, %]]], http://wis.dm/users/72550-christian91 Anna Paquin Nude, 8DD, http://wis.dm/users/72556-cameron01 Antonella Barba Blowjob Pictures, bkpl, http://wis.dm/users/72565-jordan85 Ashley Massaro Nude, >:-(, http://wis.dm/users/72551-matthew09 Anne Hathaway Nude, DD,
jonn3? (2009-02-04 (水) 14:31:41)
comment1, http://wis.dm/users/72537-gabriel61 Anime Porn Games, %((, http://wis.dm/users/72533-christopher84 Animals Fucking Girls, 8-], http://wis.dm/users/72528-joseph68 Animal Sex Stories Archive, 59388, http://wis.dm/users/72543-eric79 Anna Faris Nude, =(, http://wis.dm/users/72527-andrew99 Animal Sex Porn, 60933, http://wis.dm/users/72544-daniel75 Anna Kournikova Nude, xxcfd, http://wis.dm/users/72526-joshua11 Animal Sex Pictures, >:-(((, http://wis.dm/users/72539-samuel22 Anime Sex Games, 3263, http://wis.dm/users/72542-michael95 Anna Benson Nude, 0825, http://wis.dm/users/72532-zachary90 Animals And Women And Sex, =(, http://wis.dm/users/72529-benjamin21 Animal Sex Stories, 8-), http://wis.dm/users/72535-matthew87 Animated Sex Positions, kydsdj, http://wis.dm/users/72538-hunter75 Anime Porn On Demand, 0507, http://wis.dm/users/72541-gabriel99 Ann Hathaway Nude, 013, http://wis.dm/users/72540-thomas29 Ann Coulter Nude, bquwq, http://wis.dm/users/72534-justin56 Animals Fucking Women, yrwane, http://wis.dm/users/72530-robert48 Animal Sex With Women, 497418, http://wis.dm/users/72545-brandon04 Anna Nicole Nude, ubwurx, http://wis.dm/users/72536-samuel79 Anime Hentai Games, 637884, http://wis.dm/users/72531-gabriel09 Animal Sex Xxx, mndwi,
jonn1? (2009-02-04 (水) 14:07:16)
comment1, http://wis.dm/users/72517-brandon29 Anger Management For Teens, knvf, http://wis.dm/users/72513-joseph82 Angelina Jolie Sex Video, 34720, http://wis.dm/users/72523-kevin79 Animal Sex Free Galleries, 8-OO, http://wis.dm/users/72508-noah12 Andrea Rincon Nude, bzkfii, http://wis.dm/users/72507-zachary43 Andrea Lowell Nude Pics, 3649, http://wis.dm/users/72524-samuel91 Animal Sex Galleries, 287, http://wis.dm/users/72506-thomas52 Amy Winehouse Nude, 753, http://wis.dm/users/72522-connor84 Animal Sex Clips, qruvcd, http://wis.dm/users/72519-noah73 Angie Everhart Nude, :[[[, http://wis.dm/users/72512-eric70 Angelina Jolie Sex Scene, =-], http://wis.dm/users/72509-james04 Android 18 Hentai, :-D, http://wis.dm/users/72515-kyle50 Angels Smoking Fetish Site, 0837, http://wis.dm/users/72518-daniel52 Angie Dickinson Nude, yto, http://wis.dm/users/72521-brian77 Animal Loving Farm Girls, 513, http://wis.dm/users/72520-noah67 Angie Harmon Nude, 9095, http://wis.dm/users/72514-dylan05 Angelina Jolie Topless, %-(((, http://wis.dm/users/72510-jordan19 Anette Dawn Videos, 168, http://wis.dm/users/72516-christopher57 Angels Ultimate Smoking Fetish Site, 8), http://wis.dm/users/72525-samuel84 Animal Sex Movies, grdx, http://wis.dm/users/72511-austin42 Angeles City Bar Girls, 875552,
jonn2? (2009-02-04 (水) 13:42:46)
comment6, http://wis.dm/users/72496-nicholas52 American Indian Porn, :[, http://wis.dm/users/72492-cameron22 American Girl Dolls, 682773, http://wis.dm/users/72487-matthew15 Amateur Boys Euroboys, >:[, http://wis.dm/users/72503-hunter42 Amy Dumas Nude, hqe, http://wis.dm/users/72486-david47 Amanda Tapping Nude, ojy, http://wis.dm/users/72504-logan35 Amy Smart Naked, axuk, http://wis.dm/users/72485-noah74 Amanda Tapping Naked, 3853, http://wis.dm/users/72498-william13 American Pie The Naked Mile, 2199, http://wis.dm/users/72502-brian62 Amsterdam Sex Cams, sjytt, http://wis.dm/users/72491-kyle48 American Girl Doll, :-((, http://wis.dm/users/72488-nicholas27 Amateur Swinging Couples Homepages, :[[[, http://wis.dm/users/72494-william92 American Idol Nude Pictures, xoo, http://wis.dm/users/72497-gabriel71 American Pie Naked Mile, =OO, http://wis.dm/users/72501-alexander50 Amg And Porn, 822, http://wis.dm/users/72499-jose19 Americas Funniest Home Videos, 8PPP, http://wis.dm/users/72493-michael55 American Idol Nude Pics, >:-((, http://wis.dm/users/72489-robert43 Amatuer Porn Videos, 129, http://wis.dm/users/72495-benjamin59 American Idol Topless, =-[[, http://wis.dm/users/72505-cameron95 Amy Smart Nude, sip, http://wis.dm/users/72490-kyle02 American Girl Doll Clothes, cfxf,
jonn2? (2009-02-04 (水) 13:19:13)
comment5, http://wis.dm/users/72475-austin89 Alyssa Milano Naked, 117, http://wis.dm/users/72471-david12 Alt Sex Stories Text, =OO, http://wis.dm/users/72482-daniel33 Amanda Bynes Topless, derabt, http://wis.dm/users/72466-eric59 Alphaville Forever Young, 94513, http://wis.dm/users/72465-logan43 Alone Sex Dog, 344914, http://wis.dm/users/72483-dylan06 Amanda Peet Nude, 350105, http://wis.dm/users/72464-william28 Allysa Milano Nude, knrbdi, http://wis.dm/users/72477-michael46 Amanda Beard Nude Photos, 8-), http://wis.dm/users/72481-jonathan86 Amanda Bynes Boobs, 2730, http://wis.dm/users/72470-alexander38 Alt Sex Stories Text Repository, =O, http://wis.dm/users/72467-william14 Als Scan Girls, 4831, http://wis.dm/users/72473-cameron03 Alycia Lane Bikini, 093, http://wis.dm/users/72476-anthony95 Alyssa Milano Topless, gkfy, http://wis.dm/users/72478-brian24 Amanda Beard Nude Pics, jselyy, http://wis.dm/users/72480-nathan47 Amanda Beard Nude Pictures, =OOO, http://wis.dm/users/72472-william90 Alt Sex Story Repository, ryog, http://wis.dm/users/72468-cameron19 Alt Sex Stories Moderated, :, http://wis.dm/users/72484-nicholas74 Amanda Seyfried Nude, ?, http://wis.dm/users/72474-ethan24 Alyssa Doll Videos, 87707, http://wis.dm/users/72469-samuel72 Alt Sex Stories Repository, >:DDD,
jonn1? (2009-02-04 (水) 12:53:47)
comment6, http://wis.dm/users/72455-john54 Alicia Silverstone Nude, 8084, http://wis.dm/users/72451-cody37 Alexondra Lee Nude, >:-], http://wis.dm/users/72461-ryan09 Allison Williams Sex Tape, 436250, http://wis.dm/users/72446-david34 Alessandra Ambrosio Nude, :OO, http://wis.dm/users/72445-robert30 Alcoholics Anonymous Videos, 1379, http://wis.dm/users/72462-ryan55 Allme Sex Stories, hhllo, http://wis.dm/users/72444-michael96 Ahmo Hight Nude, oawdo, http://wis.dm/users/72460-jose74 Allison Mack Nude, )), http://wis.dm/users/72457-kyle73 All Natural Boobs, mmczeg, http://wis.dm/users/72450-samuel54 Alexis Laree Nude, fhhles, http://wis.dm/users/72447-brandon66 Alexa Vega Nude, 34870, http://wis.dm/users/72453-logan86 Alice Taglioni Nude Photos, %-))), http://wis.dm/users/72456-aaron58 All Dat Ass, fuomx, http://wis.dm/users/72458-austin85 All Sexy Celebs, rca, http://wis.dm/users/72459-zachary86 Alley Baggett Nude, =[[, http://wis.dm/users/72452-cody70 Ali Lohan Bikini, =), http://wis.dm/users/72448-aaron22 Alexis Bledel Fakes Nude, 34779, http://wis.dm/users/72463-juan68 Ally Sheedy Nude, 9182, http://wis.dm/users/72454-brandon49 Alicia Keys Nude, :-DD, http://wis.dm/users/72449-john94 Alexis Bledel Nude, jnnxdo,
jonn1? (2009-02-04 (水) 12:29:26)
comment5, http://wis.dm/users/72435-jonathan13 Adult Frind Finder, 7599, http://wis.dm/users/72431-joseph13 Adult Dating Services, 7037, http://wis.dm/users/72426-michael22 Adult Braces Colorado, 6857, http://wis.dm/users/72441-jonathan09 Adult Swim Games, >:-(((, http://wis.dm/users/72425-ethan03 Adult Braces Aurora, mszy, http://wis.dm/users/72442-jordan79 Adult Video Sharing, 18783, http://wis.dm/users/72424-james71 Adult Baby Girls Diapered, 21323, http://wis.dm/users/72440-james01 Adult Stocking Stuffers, %-OO, http://wis.dm/users/72437-connor22 Adult Party Themes, %-P, http://wis.dm/users/72430-samuel53 Adult Content Guba, 94123, http://wis.dm/users/72427-samuel04 Adult Buffet Thumbnail Gallery Post, 3276, http://wis.dm/users/72433-ryan84 Adult Film Stars, >:-O, http://wis.dm/users/72436-jose70 Adult Graf Porn Sex, 627597, http://wis.dm/users/72438-christian32 Adult Sex Toys, pwrm, http://wis.dm/users/72439-nicholas67 Adult Smacked Bottoms, 9803, http://wis.dm/users/72432-joshua40 Adult Dungeon Equipment, >:-((, http://wis.dm/users/72428-kevin34 Adult Children Of Alcoholics, hfdlt, http://wis.dm/users/72443-christian38 Adult Yiffy Art, %(, http://wis.dm/users/72434-david02 Adult Footed Pajamas, upk, http://wis.dm/users/72429-nicholas99 Adult Cloth Diapers, 8311,
jonn2? (2009-02-04 (水) 12:05:18)
comment4, http://wis.dm/users/72415-noah90 Abbie Jane Swogger Nude Pics, 9895, http://wis.dm/users/72411-jacob99 6 Girls Hogtied, cfhve, http://wis.dm/users/72421-juan37 Adrianne Curry Naked, >:)), http://wis.dm/users/72406-thomas92 2 Girls 1cup, 3892, http://wis.dm/users/72404-dylan45 2 Girls 1 Finger, 25023, http://wis.dm/users/72422-nathan01 Adrianne Curry Nude, %-PP, http://wis.dm/users/72403-connor10 2 Girls 1 Finger Video, kwlzd, http://wis.dm/users/72420-tyler52 Adams Gay Dorm, klhby, http://wis.dm/users/72417-christian69 Abby Winters Sample Videos, hbxjyy, http://wis.dm/users/72410-christopher06 4 Girls Fingerpaint, 865067, http://wis.dm/users/72407-jonathan16 2 Girls One Finger, =[[[, http://wis.dm/users/72413-michael86 8th Street Latinas Sample Videos, 5964, http://wis.dm/users/72416-adam14 Abbie Jane Swogger Nude, 8-[[[, http://wis.dm/users/72418-kevin08 Abi Titmuss Naked, gcdrez, http://wis.dm/users/72419-dylan66 Abi Titmuss Sex Tape, wjmb, http://wis.dm/users/72412-cody12 89 Free Porn, itjfq, http://wis.dm/users/72408-noah63 247 Sex Tv, epinm, http://wis.dm/users/72414-jonathan48 Aaml Music Videos, 45425, http://wis.dm/users/72423-aaron18 Adult Amateur Home Vids, 5906, http://wis.dm/users/72409-dylan39 4 Girls Finger Paint, 9016,
jonn1? (2009-02-03 (火) 12:51:37)
comment5, http://wis.dm/users/72395-zachary50 Origami Blow Up Box, snmil, http://wis.dm/users/72399-tyler92 Pamala Anderson Nude, 4840, http://wis.dm/users/72394-eric03 Orgasm Girl Walkthrough, mhgmdv, http://wis.dm/users/72400-christian94 Pamala Anderson Sex Tape, 8-OO, http://wis.dm/users/72393-james48 One Piece Hentai Nami Gallery, >:-(, http://wis.dm/users/72392-thomas76 Olivia Wilde Nude, =(, http://wis.dm/users/72397-connor33 Paddling High School Girls Punishment, 748067,
jonn1? (2009-02-03 (火) 12:28:20)
comment4, http://wis.dm/users/72388-jose80 Oblivion Nude Mod, 068, http://wis.dm/users/72385-luis52 Nudes A Poppin, 446, http://wis.dm/users/72389-adam64 Older Sexy Women, iwo, http://wis.dm/users/72391-logan44 Olivia Munn Nude, 3479, http://wis.dm/users/72390-hunter54 Olivia Mojica Sex Tape, , http://wis.dm/users/72386-andrew60 Nudist Nudism Beach Girls, 8-(, http://wis.dm/users/72383-john93 Nude Women Bodybuilders, :-OO,
jonn1? (2009-02-03 (火) 12:04:22)
comment5, http://wis.dm/users/72378-robert96 Nude Male Wrestlers, nnqocf, http://wis.dm/users/72375-connor32 Nude Family Photos, biou, http://wis.dm/users/72379-david65 Nude Phun Girls, 428781, http://wis.dm/users/72381-matthew82 Nude Sports Stars, sbvim, http://wis.dm/users/72380-anthony77 Nude Pictures Of Vanessa Hudgens, %[[, http://wis.dm/users/72373-michael71 Not Another Teen Movie Clips, yetme, http://wis.dm/users/72376-noah16 Nude Female Wrestlers, 250, http://wis.dm/users/72372-nathan02 Norwegian Teen Anal, hfb, http://wis.dm/users/72377-ethan82 Nude Glamour Pierced Nipples, bgk,
jonn3? (2009-02-03 (火) 11:41:27)
comment1, http://wis.dm/users/72395-zachary50 Origami Blow Up Box, 8(((, http://wis.dm/users/72400-christian94 Pamala Anderson Sex Tape, zmgdt, http://wis.dm/users/72396-benjamin62 Outlaw Star Hentai, 60592, http://wis.dm/users/72392-thomas76 Olivia Wilde Nude, zdrljn, http://wis.dm/users/72397-connor33 Paddling High School Girls Punishment, >:-]]],
jonn1? (2009-02-03 (火) 11:17:35)
comment6, http://wis.dm/users/72388-jose80 Oblivion Nude Mod, onnf, http://wis.dm/users/72385-luis52 Nudes A Poppin, 0067, http://wis.dm/users/72389-adam64 Older Sexy Women, pul, http://wis.dm/users/72391-logan44 Olivia Munn Nude, vwj, http://wis.dm/users/72384-austin33 Nude Young Teens With Pigtails, 75277, http://wis.dm/users/72390-hunter54 Olivia Mojica Sex Tape, %[[, http://wis.dm/users/72383-john93 Nude Women Bodybuilders, qqf, http://wis.dm/users/72387-connor65 Nudist Young Girl 10, 996879,
jonn2? (2009-02-03 (火) 10:53:44)
comment1, http://wis.dm/users/72378-robert96 Nude Male Wrestlers, 8-[, http://wis.dm/users/72375-connor32 Nude Family Photos, =-]], http://wis.dm/users/72379-david65 Nude Phun Girls, 8-DD, http://wis.dm/users/72381-matthew82 Nude Sports Stars, :-[, http://wis.dm/users/72374-joshua14 Nude Beaches Pictures, tuzvb, http://wis.dm/users/72380-anthony77 Nude Pictures Of Vanessa Hudgens, >:[[, http://wis.dm/users/72376-noah16 Nude Female Wrestlers, jaypgb, http://wis.dm/users/72373-michael71 Not Another Teen Movie Clips, 14729, http://wis.dm/users/72377-ethan82 Nude Glamour Pierced Nipples, ztjgv,
jonn2? (2009-02-03 (火) 10:30:45)
comment1, http://wis.dm/users/72398-tyler82 Pamala Anderson Naked, 81919, http://wis.dm/users/72395-zachary50 Origami Blow Up Box, :-[[[, http://wis.dm/users/72399-tyler92 Pamala Anderson Nude, 8[[, http://wis.dm/users/72394-eric03 Orgasm Girl Walkthrough, xrl, http://wis.dm/users/72400-christian94 Pamala Anderson Sex Tape, 4796, http://wis.dm/users/72393-james48 One Piece Hentai Nami Gallery, yksyns, http://wis.dm/users/72396-benjamin62 Outlaw Star Hentai, ljoi, http://wis.dm/users/72392-thomas76 Olivia Wilde Nude, 8-((, http://wis.dm/users/72397-connor33 Paddling High School Girls Punishment, 342,
jonn2? (2009-02-03 (火) 10:07:19)
comment3, http://wis.dm/users/72388-jose80 Oblivion Nude Mod, 3046, http://wis.dm/users/72385-luis52 Nudes A Poppin, opq, http://wis.dm/users/72389-adam64 Older Sexy Women, uae, http://wis.dm/users/72391-logan44 Olivia Munn Nude, 911994, http://wis.dm/users/72384-austin33 Nude Young Teens With Pigtails, 818, http://wis.dm/users/72390-hunter54 Olivia Mojica Sex Tape, 655685, http://wis.dm/users/72386-andrew60 Nudist Nudism Beach Girls, 206, http://wis.dm/users/72383-john93 Nude Women Bodybuilders, >:-DDD, http://wis.dm/users/72382-nathan52 Nude Vanessa Hudgens, >:-]]], http://wis.dm/users/72387-connor65 Nudist Young Girl 10, inn,
jonn3? (2009-02-03 (火) 09:43:24)
comment1, http://wis.dm/users/72378-robert96 Nude Male Wrestlers, =D, http://wis.dm/users/72375-connor32 Nude Family Photos, mwhld, http://wis.dm/users/72379-david65 Nude Phun Girls, 000544, http://wis.dm/users/72381-matthew82 Nude Sports Stars, >:-*1, http://wis.dm/users/72377-ethan82 Nude Glamour Pierced Nipples, :-[,
ddhvuc? (2009-01-27 (火) 16:32:28)
pyT1zf <a href="http://udxkxohceisi.com/">udxkxohceisi</a>, [url=http://tbcvdrcotgyu.com/]tbcvdrcotgyu[/url], [link=http://rjrvggskkgnc.com/]rjrvggskkgnc[/link], http://gmpjyxqzvuah.com/
, http://wis.dm/users/72374-joshua14 Nude Beaches Pictures, 8OOO, http://wis.dm/users/72380-anthony77 Nude Pictures Of Vanessa Hudgens, 86193, http://wis.dm/users/72376-noah16 Nude Female Wrestlers, 7694, http://wis.dm/users/72373-michael71 Not Another Teen Movie Clips, %-O, http://wis.dm/users/72372-nathan02 Norwegian Teen Anal, 8-