Math/Stat 431 Introduction to the Theory of Probability - Lecture 3

Fall 2016, Lecture 3

Meetings: MWF, 12:05-12:55 PM Van Vleck B123
Instructor: David Anderson
Office: 617 Van Vleck.
Office Hours: Wednesday 3:30 - 4:30pm, and by appointment.
E-mail:anderson@math.wisc.edu

This is the course homepage that also serves as the syllabus for the course. Here you will find our weekly schedule, and updates on scheduling matters. The Mathematics Department also has a general information page on this course.

I will use the class email list to send out corrections, announcements, etc.  Please check your wisc.edu email regularly.

Course description

Math 431 provides an introduction to the theory of probability, the part of mathematics that studies random phenomena. We model simple random experiments mathematically and learn techniques for studying these models. Topics covered include the axioms of probability, random variables, the most important discrete and continuous probability distributions, expectations, moment generating functions, conditional probability and conditional expectations, multivariate distributions, Markov's and Chebyshev's inequalities, laws of large numbers, and the central limit theorem.

431 is not a course in statistics. Statistics is a discipline mainly concerned with analyzing and representing data. Probability theory forms the mathematical foundation of statistics, but the two disciplines are separate.

From a broad intellectual perspective, probability is one of the core areas of mathematics with its own distinct style of reasoning. Among the other core areas are analysis, algebra, geometry/topology, logic and numerical analysis.

To go beyond 431 in probability you should take next 521 -- Analysis, and after that one or both of these: 632 Introduction to Stochastic Processes and 635 Introduction to Brownian Motion and Stochastic Calculus Those who would like a proof based introduction to probability could consider taking  Math 531 - Probability Theory (531 requires a proof based course as a prerequisite). 

Where is probability used?

Probability theory is used ubiquitously throughout the sciences and industry.  For example, in biology many models of cellular phenomena are now modeled probabilistically as opposed to deterministically (this is the subject area that got me interested in probability). As for industry, many models used by insurance companies are probabilistic in nature (see: actuarial science). Also, many of the models used by the finance industry are also probabilistic in nature (google "Black-Scholes" to see an example). Thus, those wishing to go into finance need to have a solid understanding of probability.

Prerequisites

To be technically prepared for Math 431 one needs to be comfortable with the language of sets and calculus, including multivariable calculus, and be ready for abstract reasoning. Basic techniques of counting is also useful, but we will review these along the way. Probability theory can seem very hard in the beginning, even after success in past math courses.   It is imperative that you be willing to put in the required effort.

Textbook

The course follows lecture notes by David Anderson, Timo Seppäläinen, and Benedek Valkó.  These will be provided to the students at no cost.  The textbook can be found at the Learn@UW website.  The following textbooks can be used as a resource for extra practice problems. They have been placed on reserve at the math library (floor B2 of Van Vleck).
Learn@UW

We will use the Learn@UW website of the course to post homework assignments and solutions. The lecture notes will also be posted there.

Piazza
We will be using Piazza for class discussion.  The system is catered to getting you help fast and efficiently from classmates and myself.  Rather than emailing math questions to me, I encourage you to post your questions on Piazza.  If you have any problems or feedback for the developers, email team@piazza.com.

Find our class Piazza page here.

Evaluation

Course grades will be based on homework and quizzes (15%),  two midterm exams (2x25%), and a comprehensive final exam (35%).  Your lowest quiz grade will be dropped. Midterm exams will be in the evenings on the following dates: No calculators, cell phones, or other gadgets will be permitted in exams and quizzes, only pencils, pens and paper.
The final grades will be determined according to the following scale: 
A: [100,89), AB: [89,87), B: [87,76), BC: [76,74), C: [74,62), D: [62,50), F: [50,0]. 
There will be no curving in the class, but the instructor reserves the right to modify the final grade lines.

Bonus problems will be provided on the homework assignments.  Successful completion of these more challenging problems can lead to a few extra percentage points being added to your final grade.

Quizzes

To help prepare for the midterm exams we will have short in-class quizzes during the first few weeks. You will be able to find the quiz dates below.

The purpose of the quizzes is to give you practice answering probabilistic questions in a timed environment. We will have these quizzes until I decide they are no longer needed.  No makeup quizzes will be given, instead you may drop your lowest quiz score. 

Homework

Homework assignments will be posted on the Learn@UW site of the course. Weekly homework assignments are due Fridays at the beginning of the class. Note that there is a (short) homework assignment due on the first Friday (September 9).

Instructions for homework

Succeeding in this course: This course will be more difficult than previous math courses, although I strongly believe it will be more rewarding for those that put in the necessary effort. To succeed you should read the sections of the text before each lecture and then again after. You should work together in small groups and discuss the material.  (You may use Piazza to put a group together.) Such discussions are an invaluable way to learn the material. After working in the groups, you should carefully and clearly write-up your solutions making sure you actually understand the material. If, even after completing a homework assignment, you feel you still do not fully understand the material as well as you could (perhaps because you could not follow the discussion in your working group well), you should do more problems.

Weekly schedule

Here is a tentative weekly schedule, to be adjusted as we go. The numbers refer to sections in lecture notes that can be found at the Learn@UW website.

Week
Monday
Wednesday
Friday
1 9/6-9/9

Appendix B:  Set notation.
Appendix C: counting 
1.1: sample spaces and probabilities
1.2 equally likely outcomes
HW 1 due.
1.2 equally likely outcomes.
2 9/12-9/16
1.2 Finish equally likely outcomes.
1.3 Infinitely many outcomes
Quiz #1.
1.3 Infinitely many outcomes.
1.4 Consequences of the rules of probability.
HW 2 due.
1.4 Consequences of the rules of probability.
1.5 Random variables.
3 9/19-9/23
1.5 Random variables.
2.1 Conditional probability.
Quiz #2.
2.1 Conditional probability
HW 3 due.
2.2 Bayes' formula
2.3 Independence.
4 9/26-9/30
2.3 Independence
2.4 Independent trials
Quiz #3.
2.4 Independent trials
2.5 Further topics
HW 4 due.
2.5 Further topics
5 10/3-10/7
3.1 Distributions of random variables Quiz #4.
3.2 Expectations and variance.
HW 5 due.
3.2 Expectations and variance.
6 10/10-10/14
3.2 Expectations and variance.
Exam 1 on Thursday evening.
Some review.
3.2 Expectations and variance (finish)
3.3 Gaussian distribution.
4.1 Normal approximation of the binomial.
7 10/17-10/21
4.1 Normal approximation of the binomial. 4.1 Normal approximation of the binomial.
HW 6 due.
4.1 Normal approximation of the binomial.
4.2 Poisson approximation.
8 10/24-28
4.2 Poisson approximation.
4.2 Poisson approximation.
4.3 Exponential distribution.
HW 7 due.
4.3 Exponential distribution.
5.1 Moment generating functions
9 10/31-11/4
5.1 Moment generating functions
5.2 Distribution of a function of a random variable.
HW 8 due.
6.1 Joint distribution of discrete random variables.
10 11/7-11/11
6.1 Joint distribution of discrete random variables.
6.2 Jointly continuous random variables.
6.2 Jointly continuous random variables.
6.3 Expectation of a function of several random variables.
HW 9 due.
Quiz #5
6.2 Jointly continuous random variables.
7.1 Sums of independent random variables.
11 11/14-11/18
7.1 Sums of independent random variables.
7.1 Sums of independent random variables.
7.2 Exchangeable random variables.
7.2 Exchangeable random variables.
8.1 Linearity of expectation

12 11/21-11/25
HW 10 due.
8.1 Linearity of expectation
8.2 Expectation and independence
8.3 Convolution with moment generating functions.
8.4 Covariance and correlation.
No class due to Thanksgiving.

13 11/28-12/2
8.4 Covariance and correlation. Exam 2 in evening.
8.4 Covariance and correlation.
8.4 Finish covariance and correlation.
9.1 Estimating tail probabilities (Markov and Chebyshev inequalities)
14 12/5-12/9
9.2 Law of large numbers
9.3 Central limit theorem.
10.1 Conditional distribution of discrete random variables HW 11 due.
10.1 Conditional distribution of discrete random variables
15 12/12-12/14
10.2 Conditional distribution for jointly continuous random variables 10.3 Further examples


The Math Club provides interesting lectures and other math-related events. Everybody is welcome.