Register now to access 7 million high quality study materials (What's Course Hero?) Course Hero is the premier provider of high quality online educational resources. With millions of study documents, online tutors, digital flashcards and free courseware, Course Hero is helping students learn more efficiently and effectively. Whether you're interested in exploring new subjects or mastering key topics for your next exam, Course Hero has the tools you need to achieve your goals.

7 Pages

Lecture24

Course: CSI 661, Fall 2009
School: SUNY Albany
Rating:

Word Count: 415

Document Preview

Review: Sending Models and Data Given the Models Models/Explanation/Theories are combination of random variables. Need to send random variables and their parameters Need to send structure between random variables (next lecture) Then send data given the model Best model minimizes length in bits of sending model and then data given model. CSI 661 - Uncertainty in A.I. Lecture 24 1 Review: Discrete Random Variable...

Register Now

Unformatted Document Excerpt

Coursehero >> New York >> SUNY Albany >> CSI 661

Course Hero has millions of student submitted documents similar to the one
below including study guides, practice problems, reference materials, practice exams, textbook help and tutor support.

Course Hero has millions of student submitted documents similar to the one below including study guides, practice problems, reference materials, practice exams, textbook help and tutor support.
Review: Sending Models and Data Given the Models Models/Explanation/Theories are combination of random variables. Need to send random variables and their parameters Need to send structure between random variables (next lecture) Then send data given the model Best model minimizes length in bits of sending model and then data given model. CSI 661 - Uncertainty in A.I. Lecture 24 1 Review: Discrete Random Variable Encoding - 1 Non-combinatorial approach Create a Huffman code-book. One code word for each individual state/source code symbol Assign code word lengths according to log(P(X=i) Number of bits to send model/dictionary (code-book) M M - 1 N n[m] ln + 1 - ln( M - 1)!- ( n[m]) ln 2 12 N m =1 Number of bits to send data given model is N.H[X] CSI 661 - Uncertainty in A.I. Lecture 24 2 Review: Discrete Random Variable Encoding - 2 Combintorial Approach Create a Huffman code-book. One code-word for each possible combintorial sequence the events log(S) bits to send one of S equally likely events, Number of bits to send model log M N ! n[m]! m =1 Number of bits to send data log N + M -1CM -1 CSI 661 - Uncertainty in A.I. Lecture 24 3 Continuous Random Variables Number of &quot;events&quot; for continuous data is infinte. But data is actually x AOM/2 Num. bits to specify data given model log(AOM.f(x|)) as f(.) is a pdf, d = m / v But the parameters of the model are also continuous values CSI 661 - Uncertainty in A.I. Lecture 24 4 Discretizing the Parameter Space Need to discretize parameter space into cells AOPV If cell mid-point is the parameter to encode/decode data, coding scheme is highly dependent on apriori specified trivial coding details. Instead measure expected (average) message length using all the parameter values within the cell CSI 661 - Uncertainty in A.I. Lecture 24 5 AOPV Original MML Formulation Message length calculation for normal dist. N Range = log + log + f ( xi ).AOM AOPV AOPV i =1 Range Range ...

Find millions of documents on Course Hero - Study Guides, Lecture Notes, Reference Materials, Practice Exams and more. Course Hero has millions of course specific materials providing students with the best way to expand their education.

Below is a small sample set of documents:

SUNY Albany - CSI - 661
Recap Lecture 11 Simulate a particle of systems at equilibrium Know particle positions and energy function At each time step have a snap shot of particle positions and energy Particles correspond to random variables P(s)=1/Z.Exp(-E(s) / T), Z=S
SUNY Albany - CSI - 635
41 40 39 39 38 38 37 37 36 36 34 34 34 34 33 3332 31 31 30 30 29 29 28 28 28 27 26 25 25 25 2424 24 23 22 22 22 21 21 20 18 16 14 13 14 17 1820 20 17 10 22 26 23 22 21 20 20 19 16 15 11 1211 10 15 17 15 18 13 16 19 19 20 21 21 21 22 2223 23 23 2
SUNY Albany - CSI - 635
0 0 0 0 0 0 0 10 45 49 41 53 54 11 0 03 9 4 0 0 0 18 64 67 48 23 26 26 27 22 50 3 4 8 13 26 33 31 31 26 23 21 30 29 28 3456 24 0 1 5 18 12 7 4 29 59 60 48 48 50 4651 53 57 58 57 41 43 45 49 43 47 50 49 43 19 1724 37 37 36 35 35 34 40 43 40 40 36
SUNY Albany - CSI - 635
35 35 34 34 33 33 32 31 30 29 29 28 27 27 26 2625 24 23 23 22 22 22 21 21 20 19 19 18 17 17 1616 15 14 5 0 0 0 0 0 0 0 0 0 0 0 25 3 0 0 0 0 0 0 0 0 0 0 0 0 1 00 0 0 0 0 0 0 0 0 0 0 0 0 0 0 00 2 5 10 13 16 16 16 18 18 18 18 19 19 19 2020 20 20 2
SUNY Albany - CSI - 635
33 33 33 33 32 32 32 31 31 30 30 29 29 28 28 2727 26 26 26 24 24 24 24 23 22 23 22 22 21 21 2020 19 19 19 18 18 18 18 17 17 17 17 18 21 22 2222 18 16 11 20 22 19 19 20 19 19 18 18 17 17 1614 13 14 16 19 19 20 20 20 21 21 22 22 22 23 2324 22 23 2
SUNY Albany - CSI - 635
44 43 42 42 42 41 40 39 39 38 38 37 37 36 35 3535 34 34 33 32 32 31 31 30 29 29 28 28 28 27 2726 26 25 25 25 24 23 22 22 20 18 16 15 15 19 2021 23 19 12 24 29 26 24 23 22 21 20 18 16 13 1312 12 16 18 16 19 14 17 20 21 21 22 23 24 24 2424 24 25 2
SUNY Albany - CSI - 635
21 21 21 20 20 20 20 19 19 19 18 17 17 17 16 1615 15 15 14 14 13 13 13 13 13 12 12 11 11 11 1110 10 10 9 9 9 8 8 8 7 5 4 3 3 4 66 7 9 5 1 8 12 11 9 8 7 7 7 5 3 22 1 0 4 6 5 6 3 5 7 8 8 9 9 9 1010 10 10 10 10 11 12 11 12 13 13 13 14 14 14 1414 1
SUNY Albany - ACC - 522
Department of Accounting &amp; Law State University of New York at AlbanyAcc 522. Statistical Methods for Business Decisions Fall, 2001J Gangolly Homework 1 (Due September 15, 2001. email submission only)Unix Shell Scripting for Data Preprocessing
SUNY Albany - EA - 7279
Chapter 6 Political Economy- We start by viewing the government as a mechanism that maximizes citizens' self interests. Does this mechanism that is guided only by the selfish wants of citizens, unrealistic as it may be, lead to efficiency? - More r
SUNY Albany - AH - 681
Arrays Chapter7 2007 Pearson Addison-Wesley. All rights reservedArrays Arrays are objects that help us organize large amounts of information Chapter 7 focuses on: array declaration and use bounds checking and capacity arrays that stor
Uni. Westminster - BDB - 0211
Sheet1 Presynaptic Nerve terminal dimensions Myelin[0] = 50 um Myelin[1] = 100 um Myelin[2] = 500 um Myelin[3] = 1000 um Myelin[4] = 1500 um Myelin[5] = 1500 um Myelin[6] = 1500 um Myelin[7] = 1500 um Myelin[8] = 1500 um Myelin[9] = 1500 um Total Mye
SUNY Albany - RH - 962349
History of Europe, Prehistory to the Colonisation of the New World, Lecture NotesCaveat emptor: These lectures have sometimes been written and typed in haste so I hope they aren't too poorly written and too confusing. Additionally, since I grew up,
Uni. Westminster - AJ - 1208
1. A negative factor Coke faces is the social movement towards healthy beverages. Coke has not taken advantage of this social movement and therefore has seen negative results. First, consumers are now flocking towards new beverages such as: coffees,
Uni. Westminster - AJ - 1208
Amanda Johanson October 27, 2004Jeanne Gray will continue to represent Fairfield in the Miss Anystate competition after a compromise involving publicity shots and a bikini was reached with the pageant committee last night. Gray met with the members
Uni. Westminster - AJ - 1208
Amanda Johanson 12-30 10-13-04Today, a 15-year-old freshman at Central High School has died. Todd White collapsed this morning while running during basketball practice. After efforts to revive him failed, White was pronounced dead at Central Valley
Uni. Westminster - AJ - 1208
Amanda Johanson Debate: Economics Opposed to adopting policies to encourage savings in order to foster economic growth Economic Result of Mandating Savings Basic idea of the consumption function: C=Y C Savings 1 Savings 2 C1 or C2 E=C+I+GY2 Y1Y
Seattle - WEB - 340
PROF. KEN SHAH CAPM in Plain English What is Risk? SEATTLE UNIVERSITY New information arrives in the market, and prices of securities change. There are broadly two types of information market-specific (economy-wide) information and security
Seattle - MKTG - 553
More Gadgets Hit Shelves, But Many Are Half-BakedBy PUI-WING TAMStaff Reporter of THE WALL STREET JOURNALSean Mills, eager to have the newest gadgetry, decided to plunk down \$500 for a combined phone and hand-held computer. He liked its versatili
Seattle - MBA - 500
Seattle University Albers School of Business and Economics MBA 500: Introductory Business Statistics Winter 2003 Monday 5:35 p.m. in Bellevue Instructor Greg Ellis Office: Phone: Fax: E-mail: Home Page: Office Hours: Pigott 530 (206) 296-5737 (206) 2
Seattle - MBA - 500
Final Exam MBA 500 Professor EllisFall 2002Please answer all of the following 4 questions. You have 2 hours to complete the exam. To facilitate the receipt of partial credit, please write legibly and show your work. Point values for each question
Seattle - MGMT - 591
CONFIDENTIALITY AGREEMENTIN CONSIDERATION OF my being selected for and being permitted to participate in a consulting project while a student at Seattle University's Albers School of Business and Economics for the provision of advice and assistance
Uni. Westminster - EPT - 0512
Buddhism Questions Meditation Erik, these are my answers to your questions. They may well differ from what other's would say. What is meditation? Meditation is a type of mental training. The Indian (Pali) word &quot;bhavana&quot; which is often translated as m
Seattle - PSYC - 120
Module 7 Infancy and ChildhoodExploring iin Modules, Module 7Physical Development Brain Development Maturation and Infant Memory Motor DevelopmentExploring iin Modules, Module 7Cerebral Cortex SectionsExploring iin Modules, Module 7Co
Seattle - PSYC - 120
Module 1 The History &amp; Scope of PsychologyMyers in Modules, Module 1Psychology's Big IssuesMyers in Modules, Module 1Psychology's PerspectivesMyers in Modules, Module 1Psychology's SubfieldsMyers in Modules, Module 1Studying Psycholog
Seattle - PSYC - 120
Module 6 Developmental Issues, Prenatal Development, and the NewbornExploring in Modules, Module 6ConceptionExploring in Modules, Module 6Introduction to Two Major Developmental Issues Continuity and Stages Stability and ChangeExploring i
Seattle - PSYC - 120
Module 2 Research Strategies: How Psychologists Ask and Answer QuestionsExploring in Modules, Module 2The Scientific MethodExploring in Modules, Module 2Description The Case Study The Survey Wording Effects Sampling Naturalistic Observa
Seattle - PSYC - 120
Module 9 AdulthoodExploring in Modules, Module 9Physical Changes Physical Changes in Middle Adulthood Physical Changes in Later Life Sensory Abilities Health Dementia and Alzheimer's DiseaseExploring in Modules, Module 9The Aging Senses
Uni. Westminster - KDF - 0316
Process Paper-Family Assessment and Care Plan 1 Running head: NURSING PROCESS PAPER FAMILY ASSESSMENT AND CARE PLANNursing Process Paper Family Assessment and Care Plan Kevin Foy Westminster CollegeIn partial fulfillment of the requirements for
Concordia Chicago - CSPP - 524
Lecture 3Introduction to Dynamic Web Content Generation: * The Java Servlet API * Java Serves Pages (JSP)Overview Brief HTTP review Web servers and dynamic content generation Servlets The container Servlet API Advanced issues Multithreading
Seattle - BIOL - 491
The observation:&quot;Since in [certain] cases the males have acquired their present structure, not from being better fitted to survive in the struggle for existence, but from having gained an advantage over other males, and from having transmitted this
Concordia Chicago - STAT - 220
cityincomeCity11City11City11City11City11City11City11City11City11City11City11City11City11City11City11City11City11City11City11City11City11City11City11City11City11City11City11City11City11City1
Concordia Chicago - STAT - 220
timegroup1ILEC1ILEC1ILEC1ILEC2ILEC2ILEC1ILEC1ILEC1ILEC1ILEC2ILEC2ILEC1ILEC1ILEC1ILEC1ILEC2ILEC2ILEC1ILEC1ILEC1ILEC1ILEC2ILEC3ILEC1ILEC1ILEC1ILEC1ILEC2ILEC3ILEC1ILEC1ILEC1ILEC1ILEC2
Concordia Chicago - STAT - 220
obsbfedenergy1BF44992BF46203BF44694BF44855BF46606BF45887BF46758BF45179BF464910BF420911BF440412BF473813BF462814BF460915BF461716BF470417BF455818BF465319BF454820BF549021BF539522BF54022
Concordia Chicago - STAT - 220
varietylengthbihai47.12bihai46.75bihai46.81bihai47.12bihai46.67bihai47.43bihai46.44bihai46.64bihai48.07bihai48.34bihai48.15bihai50.26bihai50.12bihai46.34bihai46.94bihai48.36red41.9red42.01red41.93red43.09red
Concordia Chicago - STAT - 234
nameavgscorelastroundroundsgreenspcteventsmoneyputtsdrivingavgputtsbirdieavgholespereaglebirdieconversionparbreakerdrivingaccuracyVijay Singh68.7870.002257.752078140639293.51.7535.05132.035.528.862.4Phil Mickelson69.01
Concordia Chicago - STAT - 234
rainfalltreatment1202.60unseeded830.10unseeded372.40unseeded345.50unseeded321.20unseeded244.30unseeded163.00unseeded147.80unseeded95.00unseeded87.00unseeded81.20unseeded68.50unseeded47.30unseeded41.10unseeded36.60unseed
Concordia Chicago - STAT - 234
yearstoressupercenters20021647106620011736888200018017211999186956419981921441199719603441996199523919951985147199419507219931848341992171410199115689199013906198912593
Concordia Chicago - STAT - 234
reductdiet8fish12fish10fish14fish2fish0fish0fish-6reg0reg1reg2reg-3reg-4reg2reg
Concordia Chicago - STAT - 234
time30 17 65 8 38 35 4 19 7 14 12 4 5 4 2 7 5 12 50 33 10 15 2 10 1 5 30 41 21 31 1 18 12 5 24 7 6 31 1 3 2 22 1 30 2
Seattle - BIOL - 491
Does evolution tick like a clock or not?yes, it does !the classic case in which molecular-clock based estimates of divergence times proved superior to the original fossil data was the human-chimp split.early paleontological studies kept suggest
Seattle - CHEM - 232
Visualizing Proteins.As polymers of amino acids. amino acid ball-and-. 3 letter abbreviationsBovine insulin. single letter abbreviationsMyoglobin comparisonsAll structural and functional aspects are governed by amino acid sequence. As
Seattle - CHEM - 232
CHEM 232 04/03/03Typical chemical shifts in proton nmr spectra Structure RCH3 R2CH2 R3CH ArCH3 R2NCH3 R2CHOR R2CHCl RC(=O)CHR2 RCHCR=CR2 RC=CH ArH RC(=O)H RCCH R2NH ROH ArOH RCO2H chemical shift (ppm) 0.8 - 1.2 1.1 - 1.5 ~1.5 2.2 - 2.5 2.2 - 2.6 3.2
Seattle - CHEM - 232
4/22/03 CHEMISTRY 232 FUNDAMENTALS OF ORGANIC CHEMISTRY II Quiz 3 Name _KEY_ 1. (4 pts) Designate each of the following groups as either an activator or deactivator and as an o,p or meta director in reference to electrophilic aromatic substitution. G
Seattle - CHEM - 232
CHEM 232 04/01/03 Important IR Absorption BandsBand Frequency ( cm1) (position) 35503200Type of Bond OHIntensity/Characteristics strong, broad band
Seattle - CHEM - 232
CHEM 231 04/11/03Methodology for solving organic synthesis problems. A synthesis problem usually takes the form of &quot; How would you synthesize X (any compound) from Y (some starting material)?&quot; or &quot;Synthesize X from any organic compound of four ca
Seattle - CHEM - 232
Helpful Study Guides Tables/charts of methods of preparation of each functional group Star charts for reactions of each functional group Concept maps Reaction triangles Lists of Nucleophiles Electrophiles Reducing agents Oxidizing agents Reactio
Seattle - CHEM - 232
5/20/03 EXAM II CHEMISTRY 232 FUNDAMENTALS OF ORGANIC CHEMISTRY II Name _KEY_ (1-10, 5 pts each) CIRCLE the correct answer for each of the following. 1) Which compound would be the strongest acid? a) Cl2CHCH2CH2COOH b) ClCH2CHClCH2COOH c) CH3CCl2CH2C
Seattle - CHEM - 232
05/20/03 Learning objectives as determined in class on 05/22/03 Chem 232 - Fundamentals of Organic Chemistry II Fessenden and Fessenden Chapters 23-26 BIOorganic compounds Following review of this material, the student should: Understand and
Seattle - CHEM - 232
CHEM 232 Fundamentals of Organic Chemistry II Fessenden and Fessenden Chapter 11 Aromaticity and Benzene: Electrophilic aromatic substitution Following review of this material, the student should: be able to use IUPAC nomenclature to name
Seattle - CHEM - 232
04/08/03 Quiz 1 CHEMISTRY 232 FUNDAMENTALS OF ORGANIC CHEMISTRY II Name _ 1) (6 pts) The following structure is that of tetrahydrocannabinol (THC), the principal psychoactive component of marijuana. List the wavenumber (cm1) of the characteristic
Seattle - MKTG - 456
Seattle University INTERNATIONAL MARKETING FALL 2005 Instructor: Class Meets: Contact Me: Text (Required): MKTG 456-01Dr. Peter Raven, Associate Professor, Marketing Dept. Tuesday/Thursday, 10-12:05 Pigott 101 Office: Pigott 423 Hours: T/ 1:30-3:30
Seattle - ACCT - 230
vti_encoding:SR|utf8-nl vti_timelastmodified:TR|07 Feb 2000 05:36:48 -0000 vti_extenderversion:SR|4.0.2.4022 vti_cacheddtm:TX|07 Feb 2000 05:36:48 -0000 vti_filesize:IR|21504 vti_cachedlinkinfo:VX| vti_cachedsvcrellinks:VX| vti_cachedtitle:SR|QUIZ #1
Seattle - ACCT - 230
vti_encoding:SR|utf8-nl vti_timelastmodified:TR|26 Jan 2000 09:07:12 -0000 vti_extenderversion:SR|4.0.2.2717 vti_cacheddtm:TX|26 Jan 2000 09:07:12 -0000 vti_filesize:IR|21504 vti_cachedlinkinfo:VX| vti_cachedsvcrellinks:VX| vti_cachedtitle:SR|CHECK F
Seattle - ACCT - 230
vti_encoding:SR|utf8-nl vti_timelastmodified:TR|27 Sep 1999 17:53:52 -0000 vti_extenderversion:SR|4.0.2.4022 vti_cacheddtm:TX|27 Sep 1999 17:53:52 -0000 vti_filesize:IR|20480 vti_cachedlinkinfo:VX| vti_cachedsvcrellinks:VX| vti_cachedtitle:SR|QUIZ #1
Seattle - ACCT - 230
vti_encoding:SR|utf8-nl vti_timelastmodified:TR|15 Feb 2000 06:06:18 -0000 vti_extenderversion:SR|4.0.2.4022 vti_cacheddtm:TX|15 Feb 2000 06:06:18 -0000 vti_filesize:IR|22016 vti_cachedlinkinfo:VX| vti_cachedsvcrellinks:VX| vti_cachedtitle:SR|QUIZ #1
Seattle - CSSE - 515
Seattle University CSSE-515 Software Project ManagementSubject: References: Project Planning PCH Project Charter RAA Risk and Asset Assesment 02/14/00Date:_ _ REV SU PLN Page 11.0 1.1INTRODUCTION PurposeThis is the instruction for producin
Seattle - CSSE - 103
Case ManagingCase managing is tailoring assistance to each individual's needs until an employment result is achieved. It involves a systematic approach to support cost-effective service delivery and the tracking of results. Case managing refers to c
Seattle - CSSE - 103
Sleepy Hollow Parks and Recreation Now offers - EXTENDED HOURS for your convenience!Saturday, 8am-noon Tuesday-Thursday, 8am-7pm Monday and Friday, 8am-5pm
Seattle - CHAPTER - 103
Sleepy Hollow Parks and Recreation Now offers - EXTENDED HOURS for your convenience!Saturday, 8am-noon Tuesday-Thursday, 8am-7pm Monday and Friday, 8am-5pm
Concordia Chicago - ECON - 345
Bargaining in Marriage, Sorting in the Marriage Market, and the Incentives to Accumulate Human CapitalShelly Lundberg University of Washington and Robert A. Pollak Washington University in St. Louis May 22, 20081Three Ways in which the Prosp
Concordia Chicago - ASTRO - 119
PHY SCI 119a Homework #3 posted out 10.18.05 due Monday, 10.24.05 1. Show that, when an electron orbits a nucleus in an hydrogen atom, the photon emitted when the electron changes orbit has wavelength 1/=R[(1/n1)2-(1/n2)2]. The argument is due to Boh