x q u x s q k wRx iyx hRqq x ww Riq jvGwk Gx u swi uqx wxx RR1qm Yyqwq k ox wkRki Rqxyq q usyxt qGwxGRm kviwRdyxwvwtwhvhyqwqkRoBx RgqGwusyxRtWqx w exwxdw Rqiwx Yx l)wky"ugxkwRRx qwvhi fkRsitx uRsiRi Rwv jvt hxk x D x x yq s i t q h k t p x i fkvki xRq wp R@fkRkiHix wusyf vgx)r mvt iW t q Bt v Rq u 9yos ws Riw1z|b w l wsgfv exwy)wkx uRsRkqiuRswkuf1tq vsRkiHbxyi diqxR bbqwqk us Wx q x uvq bxm|i l jRmq evBi wm fk wkRmRRvq Quqx RsiRiust yvhq zqkHxp yyyq wwkimvhyq ywkuHwivss x yfRshi vvhRsqi t (lq lwsvhGvhbx Gvxxx qwsbxi vbixHw"9wqRx Rsyq vi 2x WoQlqRkk uh f wkwi hw kRvvkRiq|i"xxtRqRhRhwqdx kexyGy t uq ivx wxqi wp s x q t i h q q s Rvxi w uqlhBuqy|fjvkx usRkBvjdRikRvxisi yGvxii B uR qqx x t x i i q i i x RkRiR i sqivxi yx svv Rtqs w qRqtRkwHi wwRi k R |iR|uiktq is m x Rym iRkbx qBi R w uYwis l Rwfkykxkw RiwuBGRsq RsQdi i kRdqvwv "wt tRxqgxvxibx s bxiyRRuksH wvx x k i RkiwkqHhR k Rvvxkwqi Rwwk i RWq iuBvx kRji x wxqyvxx m ibr)R owvxwRti 9i s f ybxi wsiwkv xv RR rihilq fkxRqRikuv wm kdkYRs qRhBvkq diR yqR m evi i x wu t iwxwvwts ql9h vtrxy9Rir sq m fkxyr YYRx q x mq x ywvt lw t Yxbx kwiywkyuRkqxvRhyqmsid wqhYex lYwk bvim gfke x RRkw|fvxivni wq st v1xfRgq hjw R qxx kvhvq wkiyHyk wuqtfk s o wrxxk vurskivoq iwevx 1iwm Rwidokkw vR it kbxwwdix Bvvii i wGGwy qRk|fue ikrx R iWbxh ddi wv x jqRs |im RBq Rxrq yxuqvxt swxffsit dRRwi jw bkq xiGd Rw1iwqvwtivtik i i s dR wvx i sy)k wq 9bxxi dxh us yt bxit 9yx Rvw 9 ) q q qbxbiR(wRsqlxsgx9wq xx1wqwsx Rqvki dRi vhdq u"Rs w xmq xyRi jgq W ux RhxRwiDw vdiw wxx bxxi RBmix vli hsRwlqth tD 11f f y q|f wtgfi qBRxx vkfi Ri x iwuwq1xRsRkqvmi ivk bi wqddibx w RRiWjvi|fk Rbxin Ri Ruibi x su vsiy qvxyi x vhiujskt QuqgxRk wqk x i k hwyRB RuvtysvrjRmfkRojn q pp vuRtsRrPjwpm fk orn qp kf bxoixryn }V vhbXm q i w` yx RYltq Ghbf vkj~i Ygfq}apvh |{ zy4x x d w p w fkR oqj1 wn(iwmi hwg Rf ed lqh Rk1cyjbai GY` hRhYX 9wvyxq WgfU exudt RsrqR p w p V !T ! I ! F! ("H&S @RQ P2 "18B(@H G""8 ED8 "B2A @9 7(43 21 F 0 C 8 8 6 5! 0 ! ! ! % $ ! " )(('&# "
t 3 t mvm vBei k dRswiyxgxwvsdivjvxxx i WR9Rx k Bbrwq yyuq qj"jwko x Remq ytR2Rir q gw 4x RHR qk e 3 ! x R|f "ni lR iivx vhjxq dqexxRki vq R vix i t i i9 s u G i sk i q wqvY v1xi RqwuRBxy wq vx RivbiRi vix wvgx i swqxvx Wwq R4 il|v vvii R dip4 bx wiv i x i wG x w 4 pRh3a ykh@dY v4 1i xlk s kRqRki sri j|q zm kqw1vx Vjwi vxq Rs ivbibx q i vkxi RRqRq iw GwG svRk yfRk i 1xviusx i1vwbiRkxGv qq Rkx uwbxvxG|"t kvixxBa h@Y w4 Ew Rix xRGDhwqlq qwxwvk Rsmt ymwiq qwqE k wYx o x k7wsivxk Rkrvhsyvxbxbiqi lyRds 4 iEqqW )wx(z x 3a"v h@wiY 4 hExvh uRxq RsiuRi YRkis it wt w s u ww RG#qx tw {mk RsEt wii x x tp 1vi 4f1dE q xuvsi k diviDex qyxwv gxyDRivv vxbxii G|iRx yxtwwyHmiv iRsi wxx u Rvsuvidi si Bw f1xG R lgxFxsvk)m RyxYwvi tm v u vwq R1x tq uRhwsq v R bii qjx
u u cm s q t u i u ts m h q x uRq x19gfx1xvv twbqkRklqt9ehWfwk vi lhfP eh i kYq Y x kwxvwii Rqwwt Gww qRhx wRx 1qse s iiwkk Rti |fi Rvn qvix wRtxq Ym RkqRsdwiiRxRmuRx ii t RkdRi i vvhw wq ut v vksbi Rwvx xw1y1Roq q vht iBqqhxxwws vfvkq ktwi x q Rqex1xwuw Ru diRvqjx 3ty wvuq g"xutsxtyw Rmw viGGm Hx m ex1G( k xrliv Y qwqE wRvtlqHh di fRxx k vhiq kuWsbx 1x sRxi x q x x fp dba @ R Q !g!iBhY SHI |g f dba @ WA UTR Q I G gec3`Y XB@ V!SHPH" P 4 lE h i 4 exkwv qw r q E i 4 E i 2 bqx kRklq( jRmv wlRi w i Y i t x vh Bwl1RBy FbxsgxubxiwkBvA 7@4 Rki(q ikBR|fn d Rwi q Rs qbxldix'h R% rb $di|# yqyx wv wkgxuryt vswi1xRqgq j eDvhC q w9x 8x75 4v54Ri 31m2 "10! t )xw h wh vkdi ixv ik & 4 q i G k 6 ( 9 yxtwvwxv wx d x wkv9yD wq Qw"RqvxiRkiw (wlxgfxksRlqudyx wv wt fiRvxwii Wx u wswvR vhqi |Rii j x wex)m R(wxi t Rwvwti m Ro vkdiqxi Rq bxsi yR ki (w fvx i 9w wi |uw qR x g w w RdhRi R1iqqwrvtt i Rxkyqyxyu i bxi uswwHdw xx Wi qyqHq v wWqRxi viBm vxxqxyxu1st x wfRRi wqr bvqxk x q t s x qfsRdexwdxi q wwtRti yfRq ix vk i wk yyjxs Rm vxiw w dwt u gxd w Rix Rmx Rh siqv lqR wshvwt vhR1ium svx i xgxy jgWRiWR ti qwki uRsyiw x xwtqRxg wtvfk wRtqxdexwkvsyvkiwuswv Rgx Rwv dwRsvk wi q xGu wRsvxivqRdiwxi t Rhtx Rhrqq i wswsvv(Hwi x@fi wkmvi iw iq sk vkyi yuqx q s Rbxdiivx musyv y w 9wkfx vRiuq x 9 bxxqi Rihx ts xsfRxdR1iq uvtwt q vk 9|fkyy u bxdix wq RB w j lyxx wvym kyyus Rxqbxyxuusti sf i wwuR wuRiRi |ix RwiBk s qyqYBqwkust vswiWwwR ivhwsv RziRq vkyi yuB bxdiwR zibwqvRqvxi i m eqRi vikxylq ivh qywjHx vk|kdiRx wRvq qjvxi R lqlhRuksyy uxsxR Rm qw|fk jBRni m RqRvkii v wirbxx i wu s Rqy j xmi ( vtvrdtii wyxwv9tx dRvRqi1v9t 1xd qv q ki Rvxi stx y@vHR vxiw viuRsi q2Y t q k i i n |wmri vBRi vxx iuso R bxdii BsRlqh RqRq x Rq2veRik |fj R9w bx)bq1kkrqRkxdyxwvwt kRwYsix q yuivhRRi i9 it w bxx i ul q h sm fk v i k Rst ivx wRq B 2q wwW R xq tRRq @qRk Hv i Dx yfwvkiGmx ipvk u1xvRsiwq u xswkv s vviRvGjw Yehym wkuRsyiRbG|bbzv2i x w Rydx i RRqq RqR ukwxvk(( iw r Gm dw keyexy)kq i qRh"wi yfRdkuBvsR q)h iRwx Rx qux vsy divkwi y yt uvouvsis )wqDmwR qY 94xlvwRyuqRkxwqx Ww dx )fqxx xs q i x i x i t qR i @ x vi s r y y wv{ wf u pp r Vhge %f u tm i ~v{ s o p r i }7nm { u xrp cz u cm y y s p r hge k | wF xrp cwf v v Ddnkm j i e pr o qdnml hgfdw pr o k j
x t b @y 9f9ywq rbquqvk9gfxywkuRsqwkuvsi i x q xv q k i t t xq (tx ryq wwxBbxi wki ux vsRxwiq Rhh qq vhq wsyqv wq wt mxx RGvxq x xqi uiGbs vxwwi iv Rqk Rvx ivxuwxq st sfyRrRhi w(q Wexx gf ydR1iwkqutwt s vtqi iwkuvsiwbxj i vxv ixH qex RtqwwRhxRt Rqh qi usy#Ri p i vhvx@Rrqx xvxiiGh wkwt Qwivtx RjR RlqhRi1xRm Rvqdix) i D gx RRrqi mek x wkqvx wwdv vwiq vix wRvxRwqqR uslq @wteh Rvq x owq Rtvtq q x i i x wx q t x bxdi wR vxRii uRlqxxh HiR vii eRiktRibxusq ytbxGh k@ikwDfky (wHQqs xw bqwqRkDRqx1t qw) x |fn v Rs viQfRdow ek Rik vhRBwqi Rkki w w x BiRx E"d Rjwq lwqf zkRkwi SRxSqyxyhut Hfs q ix R RRlq hqw Bxexm ddi 9Rx ikviw qkvki q ww$mbxi wR f wqb gx)R f kqRik R bxi wus W y 9Rxni|f RhRiqv q bxwdiwx m fRkvk9i wvxqx yxvhu1svx|fiQRibxxi iGx x vxikvkxR s q)x qq RtqR t u uv@'8dw |eVh bW B88 B W d wz hzw zvwq vbd X B C 9 Rqk 9 !3 zwzw zw ey@lhhbw hzbdv2v w xx r b` V W W W ` W wzw zw V A|w `v bwd bbb by} vbtzbv b b)w lq v v xbxX rd r`b t b | Q ik k x i q tq dv q lqh1xRvdixfkxqt s q(x BRW R qx1t qjgx wwlb q k k )lq lwh w Ew R q xE RRqvh HRqi dt H qbxq iwkwvt t i i Bxxwkm fkviW ku s iYy YqxRsiR2xBtRijkx i B x |fW junx Rh vB R 1 zb x x ) i kw v i|f9rn Rgx1vwqRi jR Hi wwxRhgqx RhqWd q Rvxq ivxk wvqyxRtur1st fR u wq xwsbkxm fRkRqvkHi wrwt Gqx vhq k xv Ri sqrikRRlqkhwx vitw wRRmWkx wkRRRii RsiutvxqWqqB f x kvi wgx km kkRsr1x q2Yyq lh gxR1Dfq iwkYRs iYx mq "xtRiwkkRv iv jgvkRix |fwi xnrbxyRi vwqdxi RRviwqryx Gqq qmx# wRv i tR h q x Gth9%ch 9R1i Rul Y R wid h5 TWY q2 Hs q zlwHvh t iqRqRqvx iRkiwk YdexrwyR eRik m x x sq s Rikvk iw xkvkRhufkuvs ih wxi k m fkvkh qi q h x i i x xuxbxiBHRvylqkkjyfRkivRkusR lquRvq vh wq Rvy wqwvGv vxwimwxuRsexqwqHRq lhm R qkw w q vik R jibxtigxuR sqk yYs Rhxq w qx Rfv krq g11qx qkwkk9vx Rmf rqR gRkxwq Bs x xex i G if(k Rikk j mvtw uxbxiwxx qi Rqvxsy|qwwtvtji Wxk 9h ix k x i fRk qvksvxi iqybxdi vhyxuexdtwvq Rsq2t u w@xi wkfv fvk1xx wR1vuq V whs l qRkRui R svxRilqh xvkD wxRvbxqik wx m wx wR iry mRbxqi ikrxuY qjwY YviRhqY B#7@uA 4 vki|SR4SwvYgRqxwlvh 2vu s x i qqqvxx mi !y x eG75wx4w32 7x5 4lviwvb Rq!k BA wB47@ dR1m xx5u274vs vdi ww i vt 754 di2wGx x wmk |x q usq y1q q ox ik q ok RkiR wq xvyi dijqx d Bb GnuwGx u s ws q ybqis t sx 6 A zyyu B busy9wjr Rx1 1 0 4 4 B@4 l y q h% xwww j q xik 9lv Rjqh 1xRiRu sB yxR Rqiwk bxk iuehx W s fwk w vix t
g cX'h0~twqV Hh ht g ccXt i thtih Vhge g cVwt"h wt8cc` e e cc g g $e '`~wt%ht g cc8t i i g i e 8t'hti hg"i hw e whdXt8cc` e i g g tc~hht g tw'wccV e hw!8t 8co
$ %
# ! W
U U VP1
S Q TR R& Q C
"
G
E 0
0
I P
G H
E
0
E F
C D
A B
@
6 9
7 8
6
5
4
3
2
1
1 0
'
' )
' (
'
&
$ %
# ! "
vxxi # RRiki dw2s f Wyxwvym wv tqk Rswi wtvwt Dwq dDW fuRs yqw RiRui ew ikfk{xy a Rqt W b` k 2 f x u x lr HRqk A 9 3 W zw0~ y |eWhFtt|dSvwl G p4 b r iy}b G eW|dwl"FXBbWv $F 1 4 l# wlb b W u Y@ bbwt B~bbh 3v2T wluydB t1H bh l y2 tH wu W y d 5 WY bau ` a { W y i q x i v W y q il i q qRhy uvsiwt Rhq f kvkvqvkwikt k1m l hu }Rh qbxiwq vW xt kuvsi RkuwisqR wkRixwRmq RwkRkbmiqh l q W lyy qw x1xi ym qwy uRs vsqqil jvwi1hBRmx gf xvokRwi is kk kRqt w WRW w(k f vvi Wyx W mmjq Rh y y i W vvx9dRWq RswiufR 9 9 1fv i qwxlvwh 1xlvv1xih uiR s u sy wyQwwyy RkRwqq tw 1fxq wB x q xywldyt exxB voztRi s Pw kvkiy Wy qR x x Rsi RRqi xt ywbxx uvsxit iwb wqx vo fHsi q fW kR o Wzk wfH w d1iR qwt vt bxii R zwwk$ws b wqRh vh 1q |f i q w x x x tt u kRswiuwwRiwxW mu R Ri qi x n wRbxdimgx R R qqlkuqk x xRvhRsqg x itWWh fk1x Rziwx Rhwi Rq Rx q x( dRvx1iqyxqwutt svtfWii q vkw(Ri |fwBxisi qmx R R zwq B i i iu x t qh |fRr R i v wRvwqR bmbxt Yx wkusbx vxY x R qyq s Rqxwi vxn x id wwxW BxyG q exwi Rqt wkusu Rsq wkRkixfkx wqkk kwuR|f Ri 2 q wq 1v H Ruwkt uvswii %x qkufR2wfwkusmwk uRsyii fv uxbhi q t t n ii s x q t zwRhjvRk|ijRxqyxusf hxqR RqqRkvimeRik |fjRx W vr bxdiwR Rx|xqx hyxm vhh s|qfm Rii wwwmk1xx vi qxGw qk%9bx bxdifRi uk mx s lqRehwlqh wv vix wv kR qe qix wk yx ut bxsdihwx rR gw Yvhrq H x RswivRvkibit u x bl1uu fRwk Y4q bxbxii xx wkquuityxt vs wsvvhRq i vwsx v izix 1xx msRvvv i Y h R i i ex vk wtqRv wx wqRRw9r 1ivp 2wivi x wmi Ap x xv f kvyiki jq s xiR i Rbk A bxq uqtwi wC RRii xvHwq A dv wR1x q(Rt wA gxR1lqes x wkRbxvi i q qRvxwvx( u CuwvxwwRvvHRm qvhHRx ixRt ~w|fizQex biq Ri 1xx 1xuvqudwss i vvvxihRi wwi x RRsi 1ix D yux ww Wvxv quwivq sm Rm fkxxkR wi v pi R qw vxit xA wRxi qWHC vxqibxihx wv9 x v jpt r(R x Cmxgu A p mkRkxs uA i t i qv qbxG rym qexwy Ri G wyxvexgxwv x x ubxi q t q s wm GRvw (RAp qwGt w yttf m Rp qgx1 RhuBGsqq bxivi dA divkk bwl wx m4 Y ex k Dv iqG Htw A 4 dlv cE)Sbxit ivx Ridx 6 t x h C m wkuGtx |m vsmwi" Rvx ti w R lq}Cm Ri vQii RvQq wqC wrWw(ix fWyq A z z w h q p F kt vuRx1t A 6 gx iBk vx |ijt Ri m }q Gt rp q Y(%G cE HA sQd mlqu A Fl HRhk q fwex9kkkRswiR f x jRh) qxRfdilh wvt x mC 8pA Gxt t ythb @)Rwqt #3)xy gx RiwiBRmk vxR ii exgf kx vi yAq2wtw x x y m wrpqRvq 9(bx S|{wqyrta `jn h b A p4 p4 E"A G 3va h@#Y 4 e 3a h@4Y qc E X by}v b Bx vG td Yt Db wl (cE l H G A G lYcE b A 4 lYQ 4 YcE Xy}b t)bd G " G b#G e Rq v b l Y H G A r j|djbH u 0lh BuvvBb bqykw lXpx y dB D1C u 4v v"l u A b vB| v w } # a y s h x in x q x u vhW iHw2fkRkiwti hsm wuwk wvi bk q k RklqwHxHqR q x Xt Rik |fq Ri Rvxiw yxv Ri bwkuvswix HvhydRq q wqx Hvh x yi d1qwqvgxdywq w veRkkjR D fkq iv Rh vi me2 wikB RRiiwWk Bk xbxi u sx RhBuivxwq lqqvwx xRwRt w q x h
W
E D
E
E
E
E
C
v
E
E
C p
E
w
E
C t
E
C V
E
w F
E x
E &
w F w b
w E 4c y 1 u (
w 8
u v
u 4
6 t
C
C s
r g
' qp
i 1
'
' hg
f e R4
d 2
E
E 0
)
E F
C c
E b
E F
C
5
E F
C a
E 0
`
Y
E X
0
eyh vw w0 zwb{6 tuv b u u l |)u rbrbwl}t w l byXwuvb }` ~b` ~ t 6R8 bwlGbw v bwu v tGwvz bdwl x p G i qsiRkr jR 9q 1x qmxfRigkuqRk rWfqR y wbqv kklqq ufk Rxs lqh|wwi rqv RRkmj8i ! RhRm Ri 1fR i u % | i h x8vkbix f 1xkvksGuRsqWws q x m bxdiv i dyx Qxgfqwx Rwvm iy `jep u tY t @ehy Rm t Ri Rvwq wvRvq i 1xR n Sq9q wi w)xp whihl vk k i wsqR fk xvk( i 1xdwRv ytx i i i r YmwRkwq)fkvki qyxuwsvRh R|f9 Rvi 9x wQ dw D RihxRkiqw wv R DhvmRx yx w ) R qq)k f W Qfkx w1vVx ljk k W xvxi Rxwqwx wvmq x lq Rv i 4 ix ytyw7 vRmRiWx r)wu j hRm ci@3w 0} R xxp W ft yym Gu xBg uhqm B s qgp ulq ~xR QRjs q bxxyi 1H t qv 1idm f x gfRqRkvxii1vk1xVvwdiRvqhBi Rv w 1fy wkwRvrp m h u q q q xx Rhq |f uBsxi vwiyR|i t yyxhm mx ykvksi tWy Dfkx2 wk|fus Dvxqs vwqzi jr vkiviRx |i Ris "yqk dRi)'vxsv i 4 wwq Weh Hkki x q 9 t u B u i Y xj i uDviRbY ide x w|xmdwRkwqbm (RRh1xxytyfkvki qexwRqR jwbxx m wRsm qR yq RRwxwtq i s v qRhRwqws RR|fvq 9wnkk Rxx v i h" wwlehxW dy Rmqlw1xt q wyw 1tyRkq W R i s Rwkx wi9x vbiw RRswqyq Ri W wkR iv bix eix W i t i wbt tp ! p yvi v tk Di y G xy bxuix wkusgfexvkv w"xuyfwr)kkuvi9R(kRst q wi vhxq gx(x uHbxi wi R1xq 2R Wgf ex vkv wq 2qR xwy RfqDrkw f (pex wk(si2gf xD wkuRvwt sq lq qh q ix wk wm RqvdiyxRvGq Rhy)|fi x x x w Rk k us bxti w wv GRlq qexwh Rq1x9 v uyh vhy|fW j Rkiq Rvi i x h k q i xxgfR kwvii Rqw Rwi x2q s qlv i|h| iRi(i 9x wlvq l x y wkRivi bi jRs vxyq Rii Hw vxx 2mx fkuvs m wRqxfkx kQfkvkW vxRu wRv)q y "q 1xv wqvwRY qbxixh yti Rvi qi y vxiBx 1xRx iRiq RvRqh x Rtq i k q s i q s ql|f|q y RvH qbxdixytBR|isw YRh W qx ilr|g vi d b9q R u vm R y vhHgfx1vxi i wwR wq(fl@RqW bxdi xy ytRbxi 1is wy wqG i xf2Riwkt mwE t xyxwvm zt@x q bx1v0 q il fQRqvxu uwsvr9w) x x uf k s iuw"x Rhqq ex d iq Rtq wqx R q ykk|fi R l)W wi q y exw vhRqq wv mvkvxbii@x wxb ytqwf(mRkbq vwikt R iG"wqRhkx qx qxRx di1xlbivh gk v vi yxjvi q Rw@vxiv iRlqvxh wi xs Rhlqryhq W xuRq js RRkwR vqkki 1i m ifkkivk sRlqx r2iRh wrRk qBRk lq rWi mwvvvxil h `dB l y h@ Y b4 j3Yh@ d4 y G uv 7 rb Si0yzy6b vdH S wlt z 1vbdz R e))4d Y |2wflw d)vPdzdb bH v4 lD b bHWb w W bbgV uBx xer b` BR P W 9 # } h x x x i q bq kk lqw hy# x qym wkviRbi Rsyq vdiBvhq wvki wyxv q R qexwv1x v1iW YY y qivx iwkvki f yv qq W yxwv gxT y wquwkvq ivbiet Rswqvdiil bxRi dw h x @y f ww wRv BkRkusi wt)ux #dvxwG"mzRk i zxwwRwqx )s q Dwqx W 2wqRv Hx uRgflqex1xh vwi1v f)RkoR k wusi D v v s q ywtRlqh wd q mu fk x yiBy BwRh(gfexkwW v i y qwt x z w bqu Rhq t ~ w w v xq W yt v x x q w Ri W hRm1 lwmu l zbxi@wk Qx DexDvxiq uw Q% W $v""Yehyf wkRYwYlwkuRsyivRwRqry B qux vhx y i t q t i q i (qR Cj! GqRx qlk uhlqR rh wk l 1W q Fxqlivx rx y vxRlqi hBx rwx rWb mRi xCm !W H qkrs lxwwyxxq t D w'eR x wq)wvhixvx Rhq wq YxC vh!fq Hd rq xkvxuvsi uvxdi i wkt ut wsx9kx Rk1i wmeRxvgfx (Rtkrvwqi bxhwiq v WqWRw R Y iexvh q m bxqqy ix vhxq svw v xC!H qui k ssu x t q s u
E
pima (continuous) 0.5 0.45 0.4 0.5 0.45 0.4 error error 0.35 0.3 0.3 0.25 0 0.25 20 40 60 0.2 0
adult (continuous)
boston (predict if > median price, continuous) 0.45 0.4 0.35 0.3 0.25 0.2 0
0.35
m
10
m
20
30
error
20
m
40
60
optdigits (0's and 1's, continuous) 0.4 0.4
optdigits (2's and 3's, continuous) 0.5
ionosphere (continuous)
0.3 error
0.3 error
0.4 error 50 100 m 150 200
0.2
0.2
0.3
0.1
0.1
0.2
0 0
50
100 m
150
200
0 0
0.1 0
20
40
m
60
80
100
liver disorders (continuous) 0.5
0.5 0.45
sonar (continuous)
adult (discrete) 0.7 0.6 0.5 0.4 0.3 0.2 0
0.45 error
error 0.4
0.4
0.35 0.3
0.35 0
20
m
40
60
0.25 0
error
20
40
60 m
80
100
120
100
200 m
300
400
promoters (discrete) 0.5 0.4 0.3 0.2 0.1 0 0 0.2 0.5
lymphography (discrete)
0.5 0.45 0.4
breast cancer (discrete)
0.4 error
error
0.3
error
0.35 0.3 0.25 0
20
40
m
60
80
100
0.1 0
50
m
100
150
100
m
200
300
lenses (predict hard vs. soft, discrete) 0.5
0.8
sick (discrete)
voting records (discrete) 0.4
0.4 error
0.6 error
0.3 error
0.3
0.4
0.2
0.2
0.2
0.1
0.1 0
5
10
m
15
20
25
0 0
50
m
100
150
0 0
20
40 m
60
80
R|fB Ri k in k k i i qwWRkqglC Rh qRBD x RqBHwRBqudxk t x|xvdix wRswyq vRii Ruwu uwHd RiRb Qr pRR iwR|eix s qyx RivxqwiRRq q vx1xiRk isw t WRh Wq RhvxRxwkqvk zRf RHexq w vq t
7
y Xc m X DlnV% g Vw e htc8shtwcwX g itc`XwVt`Vn g n t De Vi w g i g i i c g e g e 'h c g g e w% g } g gt` xXt'8 e 'h~hww0 X`h~ te ct8e h Ve the`tXwww8n hXc i e8e S`h h'tX8)ht ` t e ww c t j t n Xtc g Xtt g c8'wt g gh Xt g 7 e g Ve)8ccV e $Xh g 8 e 'Vt%(V ~ mi e | Xcg H 0i htc8cBhhgt1XX` e e i ht`ehXe c e hcc g g VHt'X X m 8' g t8ztxivwhy hu g g gXe { w ~ i e | t g e ccXt thti Xt!cVe`w VehXc `w cV~wt$} htcXXXwd " cXt m w e n g x g 8c i h ec e eV g e i g g iV e i hXBt8t !tg h!XXscVFig Set%t8 ~m t` `e cD i8th hqV`edg wt~` 6ccXV8 XHt8w m 8c'e``whD g gtww`h t ir ` g p h t ` g n e VFi g ShtS g qt e g gg t8t!c%t he g i ht8c t dwt g B g Stx g `jt!th8fg chw e m g p g n o i h k l i j
D
e 3
e D
e p
d v
0
y
w
w
Xw txX'ht8 3cXth ccXchw ht8t tdtt wXtihc 3wtdX ' 1vw w wqdbxivx fiwkRv x vhiWst Rhlq uRsq wtq9RRRkbRqqw ust RfkRki R wq xRh Wqq RuRs|iix Rq q vkRuRsRqBvxiv gxjqRgRgx Qk iqwk wRRkiiwkxvxRxdiRx i t q v i w x vwskuq ex9qsRR q kxRkGbxi Ri quqx t Rwtivuwq RxGqx yxx WRs qf iwRRwq9 gxQRx q Gk vx exYi Rmxfx k mv qW wv zw|i r W i m xzRwdiq1x h Dqmtq t u t 9 i12 fwkRi 9RmRirvkdiwR9wQjwklvh)fRRxwq2Rqvius q Rxqwyxust Rfq vqdhi l vbxHvi RvQ fwkv w t l 2dp uR irvkit wfkRq D i x x x kux (y1x vp di x iq u sRq i Rq "Rx q WxR Rqk qR1mi x wkuxt RvsiwiHwdh Rsv ivxi vxrwq vvii yk vfi Rkxi 1xvh ui s GY h vks G vxi Bi wstwv9qx irlR|Grhviwkv w uevxuviRbibqq wbxsx wwyxm xixG wx Hx yh Rqbxu qs lh vmiv biyR rqi YxkRwkzi lvH(i bxexr vivio vRvbibi qq RRkRii q kvyiyyuis i i sH Rvexqq Rx ixRdi vv1xqi hu w o R u w vR vx wvxivmbxjky fx rw R vimdexwkv i s s i i qwh1xh`fkRkix bx digxqhdusvtb v|Wfk1xRk RflqhR2 fykvkfiRki qvx v1xtwxp sfi RuDsi fwkRGrs usq Qlq Rw)qRxi vxi x yuvkgx RRq @vri mfRkdiyxvwv(ti qRk jRvi qt 1v R1xql hqh Ri vki k 2 gG xuseC k k R vRiiwk b qHxq G9vx Ywwq q x vyxiv RfmwkvB|f i jwsigxn vR wqRtk vhi wvhq dqC bxvwi i uqx (wtxRsyq(x ddRxdivxbxiwi Yt Rx kwqwRkusyRxWfkvviwkvi sxqR lqqvhjvxit Wlq fh k R Rviw sqwt v i iqt qR Rkix xRqwqk dwwx (x bxi Rx ij lh i BR wi v w k krb 9wq fjRk vhi dwx twuv Gs yxRv ytq w Rq w x sRvhdexwkqvx y ww t u wp Rx f Rqq(ex xtq mwx Riivx wi w|dw riq d1xrup s w ytx Rsquyh l sm dlqyxhwvwt t xy(xt myxx wvx tx v q wqv qjm qxy wwHjxY fkvkv1xR9qWx R|fqi n RYi Rhqgx R qRuik sRm bxlqhi ust wRxym GvoR Rdilqxh Ryxbwv9mfk xoxk 9x wyq1vfkvkviixwm qqwtjHvx dR|fvxii n i yiRmvi R vxi qwGj xvxqyx ytut f1s RwkrRvi jq Bw wRw1qxiR qx f kdo i %Cv wkuuRsstq RyiR w qwv qdivkRhix jrsiq|f wsevR ikx RR|fRi q 9nk RvbxuRii svxiww w 9wx Rwvx mwq qux R jRx qvxyxusxti ffwk usbqqxk i i Rvq1sxRqt wvkvhix qq xwkv w x t j w i 1@ % qku qgfexykwus q RsiRxqyxusf x wx lqHRqi xy Rqx 9p v u x t k t q t i h 1vwwVqRkrsi xxvxx ikw lxw x RhrwW x jbxii hRiuqs qRkrxwh VB yxgu pB'Ru x t ytx BRuq i HxwRmR il yi vk wwRv w Rlq fkvi i k ush Ri bxQRvRwqRvink wRq q $1xvdigxRqQfvxuRlqmwk wq fRvqikwxk qt srvq pHRwGi rx Rh q Rqexx yq Rt qq w vt wizx vx|fii jxRvwkusti )w Gqx bxi vx wRi Rv wq x w(9t Rkwwqbxiwux WyqqRx q C Rqlk XdhXrr V H
oy X S) e {V g `T3sHXFTl~` w)x t g { | S oy XcXtdgg j i X i `VsHgFDgqpX0}oq0gXozTX9DH | Xos hwt` tht wh`X}lt`'ht8ch e n g n n Vti`~ g `)hXtiowy h%j m { t B g ~ e {H9XFT3q" 99TqXhh0c` e !`6o"1w ) t { y y x oy zXxzysoy VsTgXvXt!S e t "e 8kt!t { 8'`e`wXccV e wX8 g B g g cwX'hw0wwt i hw g ttc8V8` i 8w g q} t S oy o xv qjot Xi FH zg `9tTD1XssXhc { e %%xVh't!c e t g g th' g " g cc8t i t~htih Vge wXhX'h g g gx% j t g i { e XcXtg hct! lnww t hyt HvqssTDHXg}Dsp
oy
p
7
7 p ( 6
Tx
7 0
#
e D
VDt c8 c` } ` tS% w dg u m q k21xi f)s qx1lRj1sh 1xq wtRvwtdiuvRb d Ru9ui(v1fr Ww u RupxGRtq wtqvivx qd vk i RBjq i jwk o lvRvyhjqit kymw tRvr wlqR hh qq tws1wvkjjbvki 1x|pqkRkil9Ddh yRBy i RQqp woxbxvhRdiqiR q qRx t rp u D6Y y U V a i X a~ c V RivkitGj |fi B R dwvhqw l Rlqkyyuo rgxw i n i h q s q vR i x|bxRm di|fRiq(nR ywRyih vkgxy R | wmqv yqk k R yRmhiuwq vs Rx|fw vi gxnvxvqRRkviiR 9qi x y Rkv f h fWjivi wbxdix wR1x dG Rqidtx q vRi bx lqi huR1x svi di yx q yvlq iuRqvywRvGkwRm fkvk d bx i ui ks qwwex1fwv Rq i vhRBqwdibxRq vdix R wkvji y wwvxx r q Gvwki wq x v rRh zmwkq lvhx Rt qvwgxt 1xx sq wvxi wbfgqdvR1iw q bxtvti ix i Y t qdws 9wwu qexyRq BvhQ9wxq qyx vdigxdwwv ffkkvR iiwkRkvixB )ivi i wwt Rtqx kRu yvsQwi rif )Rn 1q w i v i j kt dyywumRh vxvtii qt sws (x x Ryfvkvxiii Rwi wB i RhqvkiR iRqq R RixRkq k xvWfwdvRHvimRrbwqym fkuvsikyyuBw wvdj WrWRi 1xwv1vdiwxwd RqR qRbxii vs i i wkwv 9udt s |vmYx vwdiRxvdi q |Ai vhrRq Gsi i lqhdh vxquv bivsjvdi Ri1qRmt wRiwx wkRwoiRwitY i d9vx q
V