STATS 3Y03 -- Probability and Statistics for Engineering
Winter Semester 2019
Organizational Information
- Course Website
. (This course is NOT on Avenue to Learn. Please do not go looking for it there or ask me why you cannot find it there!)
- Section: C01.
- Lectures: Weekly on Tuesdays, Wednesdays, Fridays 09:30 - 10:20 (TSH/B128).
- Lecture notes: For the handwritten notes made on screen during the lectures, please see Schedule of Lectures below.
- Tutorials: There are no tutorials for this course.
- Assignments: These are to be completed online, by the stated deadlines, through the Course Website
.
- Midterms and Final Examination: For details, please see the Course Website
.
- Office hours: Fridays 10:30-11:30.
- Email: You are welcome to email me any time with questions about the class or the material covered. If you have to email me in connection with this class for any reason, you MUST include the course code (3Y03) in the subject line of your email, otherwise I will probably not see the mail (and, if I do, will not necessarily know to which class you are referring).
Course News and Announcements
For news about the course, it is your responsibility to check the Course Website
regularly.
Schedule of Lectures
Summaries of lectures and notes from class will be posted here as the semester progresses. Lecture notes will typically be posted all together once a week, but may be posted earlier if certain topics relate to an assignment with an earlier deadline.
The lecture notes below are typically augmented versions of what was presented on screen during class; the augmentations are principally to be found in the form of extra comments (and corrections) written in light blue. Please send me an email if you ever find any mistakes or there are glitches in the documents.
You are strongly advised to go through these notes alongside your own notes carefully to make sure that you understand everything that was discussed!
- Lecture 1
(Tues 8 January 2019) -- Introduction to course, including introduction to the Course Website
. Introduction to the role of Statistics and Probability Theory. 2-1 Sample spaces.
- Lecture 2
(Wed 9 January 2019) -- More on 2-1: Events (distributive laws, De Morgan's laws), start of counting techniques (multiplication rule).
- Lecture 3
(Fri 11 January 2019) -- More on 2-1: Further counting techniques (k-permutations, permutations of similar objects, r-combinations).
- Lecture 4
(Tues 15 January 2019) -- 2-2: Definition of probability, randomness, axioms of probability; 2-3: Addition Rule for probability.
- Lecture 5
(Wed 16 January 2019) -- More on 2-3: Addition Rule for probability; 2-4: Conditional probability; 2-5: More on conditional probability, Total Probability Rule.
- Lecture 6
(Fri 18 January 2019) -- More on 2-5: More on conditional probability; 2-6: Independence of events. (Thanks to Dr Hoppe for these notes.)
- Lecture 7
(Tues 22 January 2019) -- 2-8, 3-1: Random variables (in particular discrete random variables); 3-2: Probability mass functions (pmf); 3-3 Cumulative distribution functions (cdf).
- Lecture 8
(Wed 23 January 2019) -- More on 3-2, 3-3 (Probability mass functions and cumulative distribution functions); 3-4 Mean and Variance of a discrete random variable.
- Lecture 9
(Fri 25 January 2019) -- More on 3-4 Expected Value of a function of a discrete random variable; 3-6: Binomial distribution (definition, mean and variance).
- Lecture 10
(Tues 29 January 2019) -- 3-7: Geometric and Negative Binomial distributions; 3-8: Hypergeometric distribution. (The slides that Dr McNicholas used during the lecture can be found by logging on to the Course Website
).
- Lecture 11
(Wed 23 January 2019) -- 3-9: Poisson distribution. *** UP TO THIS POINT IS THE SYLLABUS FOR MIDTERM TEST 1. *** 4-1: Continuous random variables.
- Lecture 12
(Fri 1 February 2019) -- 4-2 Probability density functions (pdf); 4-3: Cumulative distribution functions; 4-4: Mean and variance of a continuous random variable (definition).
- Lecture 13
(Tues 5 February 2019) -- More on 4-4: Mean and variance of a continuous random variable; 4-6: Normal distribution.
- Lecture 14
(Fri 8 February 2019) -- More on 4-6: Normal distribution; 4-7: Normal approximation to the binomial distribution.
- Lecture 15
(Wed 13 February 2019) -- 4-8: Exponential distribution; 5-1 Two random variables (5-1.1 joint probability distribution functions).
- Lecture 16
(Fri 15 February 2019) -- More on 5-1 Two random variables (5-1.2 marginal distribution functions, 5-1.4 independence of random variables); 5-2 Covariance and correlation of two random variables; 5-4 linear functions of random variables. Here
is a document full of worked examples for the topics covered in Lecture 16 that you should work through independently. Please note the Important Fact about linear combinations of Normally distributed random variables on pp. 7-8 which I neglected to mention in class.
- Lecture 17
(Tues 26 February 2019) -- 6-1 Numerical Summaries of Data (sample mean, sample median, sample mode, sample variance, sample standard deviation, sample range); 6-2: Stem and Leaf Plots.
- Lecture 18
(Wed 27 February 2019) -- More on 6-2: Stem and Leaf Plots (quartiles and percentiles); 6-3: Frequency distributions and histograms; 6-4: Box (and whisker) plots.
- Lecture 19
(Fri 1 March 2019) -- More on 6-4: Box (and whisker) plots; 6.7: Probability plots; 7-1, 7-2: Point Estimation and Sampling Distributions (parameters, random samples, statistics, estimators, estimates).
- Lecture 20
(Tues 5 March 2019) -- More on 7-1: Point Estimation; 7-3: Concepts of Point Estimation (bias, trimmed mean, MVUE (Minimum Variance Unbiased Estimator), standard error, estimated standard error, mean square error, relative efficiency, optimal estimator).
- Lecture 21
(Wed 6 March 2019) -- More on 7-2: Central Limit Theorem; 8-1: Confidence Intervals (general definition of a $100(1-\alpha)\%$ confidence interval; confidence interval for the mean of a Normal distribution, variance known).
- Lecture 22
(Fri 8 March 2019) -- More on 8-1: Confidence Intervals (confidence interval for the mean of a Normal distribution, variance known -- margin of error (ME), one-sided confidence bounds; confidence interval for the mean of any distribution, variance known, large sample size; confidence interval for the mean of any distribution, variance unknown, large sample size); 8-2: Confidence interval for the mean of a Normal distribution, variance unknown -- (Student) t-distribution, t-tables).
- Lecture 23
(Tues 12 March 2019) -- More on 8-2: Confidence interval for the mean of a Normal distribution, variance unknown ((student) t-distribution, t-tables); 8-4: Confidence interval for the population proportion (large sample).
- Lecture 24
(Wed 13 March 2019) -- 9-1: Hypothesis testing (null hypothesis $H_0$, alternative hypothesis $H_1$, test statistic, critical values/regions, Type I and Type II errors, significance level $\alpha$, power $1-\beta$). (Notes corrected 19/03/2019.)
- Lecture 25
(Fri 15 March 2019) -- More on 9-1: Hypothesis testing (p-value, relationship to confidence intervals); 9-2: Hypothesis testing for the mean of a Normal distribution, variance known ($Z_0$, $z$-test).
- Lecture 26
(Tues 19 March 2019) -- More on 9-2: Hypothesis testing for the mean of a Normal distribution, variance known (more on $z$-test, Type II Error $\beta$ and sample size $n$).
- Lecture 27
(Wed 20 March 2019) -- 9-3: Hypothesis testing for the mean of a Normal distribution, variance unknown ($T_0$, $t$-test); 9-5: Hypothesis testing for the population proportion (test statistic $Z_0$, critical regions and p-values).
- Lecture 28
(Fri 22 March 2019) -- More on 9-5: Hypothesis testing for the population proportion (relationship between Type II Error $\beta$ and sample size $n$); 10-2: Hypothesis testing and confidence intervals for the difference of means of two normal populations, variances unknown (equal and not equal cases).
- Lecture 29
(Tues 26 March 2019) -- More on 10-2: Hypothesis testing and confidence intervals for the difference of means of two normal populations, variances unknown (examples); 11-1 and 11-2: Simple Linear Regression (residuals, least squares regression line, least squares estimates/estimators $\hat{\beta}_0, \hat{\beta}_1$).
- Lecture 30
(Wed 27 March 2019) -- More on 11-1 and 11-2: Simple Linear Regression (variance of the error, sums of squares error $SS_E$, total sum of squares $SS_T$, regression sum of squares $SS_R$); 11-3: Properties of the Least Squares Estimators (mean, variance and estimated standard error of $\hat{\beta}_0, \hat{\beta}_1$).
- Lecture 31
(Fri 29 March 2019) -- 11-4: Hypothesis Tests in Simple Linear Regression (t-test for $\hat{\beta}_1$); 11-5 Confidence intervals (on $\hat{\beta}_1$ and the expected value of $Y$ at $X=x_0$); 11-6: Prediction of New Observations (prediction intervals for the future value of $Y$ at $X=x_0$).
- Lecture 32
(Tues 2 April 2019) -- More on 11-4: Hypothesis Tests in Simple Linear Regression (Analysis of Variance Approach (ANOVA) and $F$-tests); 11-7: Adequacy of the Regression Model (probability plots for residuals, coefficient of determination $R^2$); 11-8 Correlation ($R$, and $R$ v. $R^2$).
- Lecture 33
(Wed 3 April 2019) -- 13-2: Single-factor Experiments and Analysis of Variance (ANOVA) (factors, treatments, completely randomized experimental design, Experiment-wise Error Rate EER, dot notation).
- Lecture 34
(Fri 5 April 2019) -- More on 13-2: Single-factor Experiments and Analysis of Variance (ANOVA) (total sums of squares $SS_T$, treatment sums of squares $SS_{\textrm{Treatments}}$, error sums of squares $SS_E$, mean squares treatments $MS_{\textrm{Treatments}}$, mean squares error $MS_E$, $F$-test on equal means/no treatment effects).
- Lecture 35
(Tues 9 April 2019) -- More on 13-2: Single-factor Experiments and Analysis of Variance (ANOVA) (confidence intervals using ANOVA for single treatment means and the difference in treatment means, tests on pairs of treatment means; testing assumptions with ANOVA; unbalanced experiments).
- ************************************************************************************************
- Review Lecture
(Wed 17 April 2019) -- Review of "End of Course"/"Part 3" material, in particular focussing on Confidence Intervals and Hypothesis Tests (Chapters 8, 9 and 10).
Back to Top of Page
Last updated: