Course Description:

Systems of linear equations, matrices, finite dimensional vector spaces, determinants, eigenvalues and eigenvectors.

Instructor:

Aaron Nung Kwan Yip

Department of Mathematics

Purdue University

Contact Information:

Office: MATH 432

Email and Phone: click here

Lecture Times and Places:

Section 022 (CRN 64933): T, Th 10:30 - 11:45, UNIV 117

Office Hours:

Tue: 2:00-3:15pm, Wed: 3:00-4:15pm, or by appointment.

Textbook:

Main Text (required):
[P] Linear Algebra, Ideas and Applications, 4th edition, Richard Penney, Wiley.
You are highly encouraged to make good use of the textbook by reading it.

Homework:

Homeworks will be assigned weekly, due usually on Thursday in class. They will be gradually posted as the course progresses. Please refer to the course announcement below.

Steps must be shown to explain your answers. No credit will be given for just writing down the answers, even if it is correct.

Please staple all loose sheets of your homework to prevent 5% penalty.

Please resolve any error in the grading (hws and tests) WITHIN ONE WEEK after the return of each homework and exam.

No late homeworks are accepted (in principle).

You are encouraged to discuss the homework problems with your classmates but all your handed-in homeworks must be your own work.

Examinations:

Tests: Midterm One and Midterm Two, in class, dates TBA

Final Exam: During Final Exam Week

No books, notes or electronic devices are allowed (nor needed) in any of the tests and exam.

Grading Policy:

Homeworks (25%)

Test (40%, 20% each test)

Final Exam (30%)

Class Participation (daily or weekly quizzes, etc, 5%)

You are encouraged to attend all the lectures. However, I do not take attendance. The quizzes are used to check your basic understanding and provide opportunity for you to mingle with your classmates and myself. It is open book, open note and open discussion, hopefully a fun activity. No make-up quiz will be given. You do not need to worry if you miss a few. However, if you anticipate to miss more (for legitimate reasons), please by all means let me know as soon as possible.

The following is departmental policy for the grade cut-offs:
97% of the total points in this course are guaranteed an A+,
93% an A,
90% an A-,
87% a B+,
83% a B
80% a B-,
77% a C+,
73% a C,
70% a C-,
67% a D+,
63% a D, and
60% a D-.
For each of these grades, it's possible that at the end of the semester a lower percentage will be enough to achieve that grade.

You are expected to observe academic honesty to the highest standard. Any form of cheating will automatically lead to an F grade, plus any other disciplinary action, deemed appropriate.

Accommodations for Students with Disabilities and Academic Adjustment:

Purdue University strives to make learning experiences accessible to all participants. If you anticipate or experience physical or academic barriers based on disability, you are welcome to let me know so that we can discuss options. You are also encouraged to contact the Disability Resource Center at: drc@purdue.edu or by phone at 765-494-1247.

If you have been certified by the Disability Resource Center (DRC) as eligible for accommodations, you should contact me to discuss your accommodations as soon as possible. Click here for instructions for sending your Course Accessibility Letter to me.

Nondiscrimination Statement:

This class, as part of Purdue University's educational endeavor, is committed to maintaining a community which recognizes and values the inherent worth and dignity of every person; fosters tolerance, sensitivity, understanding, and mutual respect among its members; and encourages each individual to strive to reach his or her own potential.

Protect Purdue Plan:

Protect Purdue Plan / (Pledge)
Essential Protect Purdue Guidance (and frequently asked questions)
Compliance Plan: What to do in the presence of violations: Ask, Offer, Leave, Report

Lack of compliance
Students who are not engaging in behaviors established in the standard operating procedures (e.g., properly wearing a mask when required) will be asked to comply and offered any assistance they need in order to comply. If non-compliance continues, possible results include instructors asking students to leave the class, potentially followed by instructors dismissing the whole class. Students who do not comply with the required health and Protect Purdue Pledge behaviors are violating the University Code of Conduct and will be reported to the Dean of Students Office, with sanctions ranging from educational requirements to dismissal from the university. For additional guidance, please see the Dean of Students guidance on Managing Classroom Behavior and Expectations.

Student rights
Any student who has substantial reason to believe that another person in the room is threatening class safety by not wearing a face covering or following other safety guidelines for public health considerations may leave the class without consequence. The student is encouraged to report the observed behavior to the course instructor or to the Office of Student Rights and Responsibilities (OSRR), as well as discuss next steps with the instructor.

Course Outline (tentative):

Chapter 1: linear systems and their solutions, matrices;

Chapter 2: vector spaces and subspaces, linear (in)dependence, dimension;

Chapter 3: linear transformation;

Chapter 4: determinants;

Chapter 5: eigenvectors and eigenvalues.

Course Progress and Announcement:

You should consult this section regularly, for homework assignments, additional materials and announcements.
You can also access this page through BrightSpace.

---

Key outcomes of this course.
(1) setting up of systems of linear algebraic equations, finding their solutions, interpretation of solutions;
(2) effective use of matrix notations and their interpretation;
(3) interpretation of (1) and (2) using the concepts of abstract (and yet concrete and useful) vector spaces, in particular, basis, dimension, and geometry of subspaces;
(4) last but not least, understanding and appreciation of the need of giving proofs, how to write proofs and knowing what constitutes a proof.

Reading of the textbook. I highly encourage you to read the textbook.
I will try to follow the materials from the textbook, but inevitably there will be deviations: in the presentation styles, emphasis, examples, and solution methods. Going to the lectures and reading the textbook can thus give you multiple viewpoints on the materials. In addition, the textbook has many worked out examples.

Use of technology. You are highly encouraged to try and experiment with technology, in particular Matlab. (I often use it myself.)
My motto on the use of technology:
If technology helps you understand, by all means use it. Otherwise, use it at your own risk.
Beware that during the tests and exam, no technology will be allowed.

Some matlab information.
(1) Matlab and linear algebra go hand in hand. Its effective usage
(a) requires good understanding of linear algebra, and also
(b) enhances your understanding of linear algebra.
(2) A very simple tutorial. Just follow the steps in the file.
(3) There are "lots" of Matlab manual available online. Type "matlab manual" in google.

NOTATION MATTERS!!!!!!!
The notations created for and used in linear algebra are supposed to make the concepts and computation easier.
But you need to UNDERSTAND them in order to get the most out of them.

---

Week 1 (Aug 24, 26):

[P 1.2]
Geometric interpretations of finding solutions:
(i) (row) intersection between lines, planes;
(ii) (column) writing vector as linear combination;
(iii) (map) finding pre-image of a point under linear transformation.
Elementary row operations (ERO):
(i) interchange two rows;
(ii) multiply a row by a nonzero number;
(iii) add a multiple of a row to another.

Note: Three interpretations of solving linear systems (include solution of Quiz #1)

Homework 1: due Tuesday, Sept 7, in class. (note: new due date)
(Unless otherwise stated, all homework problems are from the textbook, Penney, Linear Algebra, 4th Edition.)
p.39: #55, 59;
p.64: #67, 69.

---

Week 2 (Aug 31, Sept 2):

[P 1.3]
General mxn linear system: m equations in n unknowns. (Note: m might not equal n.)
Key concepts of Gaussian eliminations:

elementary row operations (ERO),

equivalence between systems (under ERO),

row echelon form (REF),

backward substitution,

pivot vs free variables,

reduced row echolon form (RREF).
Three possibililies upon solving mxn linear systems:
(i) unique solution (only pivot variables, i.e. no free variables);
(ii) infinitely many solutions (some free variables);
(iii) no solution (inconsistent)

Note: Gaussian Elimination
Note: Examples on solving mxn systems

Homework 2: due Thursday, Sept 9, in class.
p.63: #65, 74, 75, 78, 79, 80.

---

Week 3 (Sept 7, 9):

Some applications of solving mxn linear systems:

expressing vectors as linear combinations [P 1.1];

interpolating polynomials;

traffic flows [P 1.3.2].

[P 1.1] Vectors in R^n:

vector addition, scalar multiplication, and their properties;

linear combinations and span and their interpretation in terms of solving linear system.

Note (revised): Concept of a general Vector Space

Homework 3: due Thursday, Sept 16, in class.
Click here

---

Week 4 (Sept 14, 16):

[P 1.1] Polynomials, functions, matrices as vector spaces;
[P 1.1] Linear dependence and linear independence.
Linear dependence: linear relations between the vectors.
[P 1.4] (NOTATION MATTERS)
Matrix multiplied by a column vector and its linearity property:

A(X+Y) = AX + AY; A(aX) = aAX ==> A(aX+bY) = aAX + bAY;

(A+B)X = AX + BX; (aA)X = aAX ==> (aA + bB)X = aAX + bBX;
Linear system of equation in matrix form: AX=b;
Column space of A, Col(A) = Span{columns of A}
Null space of a matrix A, Null(A)={X: AX=0}.
Homogeneous (AX=0) vs inhomogeneous (AX=b) systems;

AX=b is solvable if and only if (iff) b belongs to Col(A).

Structure of solutions for AX=b (assume it is consistent):
X = p + Null(A), where p is a translation vector, or a particular solution.

Suppose AX=b is solvable. Then solution is unique if and only if (iff)
Null(A) = {0}, i.e. there is no free variables, i.e. all variables are pivots.

Note: Lecture of Sept 16
Note (revised): Column and Null spaces of a matrix

Homework 4: due Thursday, Sept 23, in class.
p.86: #96, 97, 106, 107, 108, 109, 111, 112, 121.

---

Week 5 (Sept 21, 23):

How to check if two spans or solution representations are the same.
[P 2.1] linear dependence and independence.
Dependence relation/equation,
Consequence of linear dependence.
Redundant vectors, how to throw away all the redundant vectors.
Basis vectors = spanning vectors with no redundancy.

Note: Linear Dependence and Independence

Practice problems for [P 2.1] (no need to hand in):
p.108: #2.1, 2.3, 2.7, 2.11, 2.13, 2.17, 2.18.

---

Week 6 (Sept 28, 30):

Midterm 1: Thursday, Sept 30, in class.
No calculator nor any electronic devices are allowed (nor needed.)
Materials covered: Penney, Chapter 1 to Chapter 2.1.
The best way to review is to:
(i) go over lecture materials,
(ii) read the textbook, and
(iii) go over the homework and quiz problems.

Solution of Quiz 1-4
Selected Solution of Hw 1, 2, 3, 4, and Problems for [P 2.1]
Past Exam One (Spring 2016)
Past Exam One (Spring 2019)

Test One Statistics: Total number of students = 38
A (74 <= scores <= 100): No. of students = 13 (34%)
B (54 <= scores <= 73): No. of students = 9 (24%)
C (30 <= scores <= 53): No. of students = 12 (32%)
D (20 <= scores <= 29): No. of students = 2 (5%)
F (scores <= 19): No. of students = 2 (5%)
Average = 61
Min = 21, Max = 99
Mode = 75
Median = 65
Standard Deviation = 20
(Note: the above cut-offs are very rough and simple cut-offs, purely based on the test scores. I have not considered the hws, and quizzes.)

Test 1 Solution

---

Week 7 (Oct 5, 7):

[P 2.1]
Basis vectors for a vector space V:
(i) span the whole V, i.e. any vector from V can be written as a linear combination of the basis vector;
(ii) linear independent, i.e. no redundant vectors.
How to find a basis:
Method 1: given a list of spanning vectors, throw away all the redundant vectors.
(Typical example: find a basis for Col(A).)
Method 2: express (linear) condition/constraint in terms of free variables.
(Typical example: find a basis for Null(A).)
[P 2.2]
Dimension of a vector space.

Homework 5: due Thursday, Oct 7, in class.
Click here

Homework 6: due Thursday, Oct 21, in class.
Click here

---

Week 8 (Oct 14):

[P 2.1, 2.2]
More unknown theorem:
In any linear system with m equations and n unknowns, if n > m, there must be at least one free variable.
More equation theorem:
In any linear system with m equations and n unknowns, if m > n, there must be a vector B such that AX=B is not solvable.
Even though there can be many basis of the same space, the dimension is unique.
Properties of dim:

Dimension is the maximum number of lin ind vectors

Dimension is the minimum number of vectors that can span

In an n-dim space, any n lin ind vectors must span,

In an n-dim space, any n vectors that span must be lin ind,
Dimension is the effective number of degree of freedom in a vector space.

Note: Basis and Dimension

---

Week 9 (Oct 19, 21):

[P 2.3]
Col, Null, and Row spaces associated with a matrix.
dim(Col) = number of pivots = Rank;
dim(Null) = number of free varables = Nullity;
Rank-Nullity Theorem: Rank + Nullity = Total number of variables.
Relationship between rank and nullity with lineary independence;
Relationship between rank and nullity with solvability and uniqueness of solution
Non-singular matrix A: AX=B has a unique solution for any B.
Equivalent properties of non-singular matrices.
[P 1.4]
Subspaces is closed under vector addition and scalar multiplication

Note: Col, Null and Row spaces

Homework 7: due Thursday, Oct 28, in class.
Click here

---

Week 10 (Oct 26, 28):

[P 3.1] Linearity properties: closed under vector addition and scalar multiplication
Definition of subspaces, examples
Matrix multiplication by a vector: X-->AX
Linear transformations: X--> T(X)
Examples: reflection, projection, rotations
Linear transformations given by matrix multiplications:
T(X) = AX: X (in R^n) ---> AX (in R^m), where A is an mxn matrix.
Matrix representation of T, how to find the matrix corresponding to T.
[P 3.2] Matrix multiplications
C^(mxn) = A^(mxl)*B^(lxn), beware of dimension compatibility

Homework 8: due Thursday, Nov 4, in class.
p.158: #3.1, 3.2, 3.5, 3.6, 3.10, 3.11, 3.12, 3.15
p.174: #3.41, 3.44
p.190: #3.64(a to j), 3.65(a to j), 3.72

---

Week 11 (Nov 2, 4):

[P 3.2] Matrix multiplications
Connection to composition of linear transformation: [TS]=[T][S]
In general, AB is not equal to BA

General theory of functions (or maps):
onto (surjective), one-to-one (injective), inverse of a map (for onto and one-to-one maps)
A^(mxn) is onto
<=> AX=Y is solvable for any Y
<=> A has m pivot (the maximum number) variables
<=> Rank(A)=m, i.e. A has full rank;
A^(mxn) is one-to-one
<=> AX=Y has unique solution (if solvable)
<=> A has no free variables
<=> Nullity(A) = 0
<=> Rank(A) = n

[P 3.3] Inverse of a matrix
A has an inverse
<=> A is onto and one-to-one
<=> AX=Y is uniquely solvable for any Y
<=> Rank(A)=m=n (hence A is necessarily a square matrix)
(A is non-singular.)
Finding the inverse of A by row operations:
If [A | I] -- (row reduction) -->[I | B], then B = A^(-1).
Properties of inverse: AA^(-1) = A^(-1)A = I.

Note: Inverse of a matrix

---

Week 12 (Nov 9, 11):

Midterm 2: Thursday, Nov 11, in class.
No calculator or any electronic devices are allowed (nor needed.)
Materials covered: Chapter 2 to Chapter 3. (Note: The whole Chapter 2 is included.)
(Even though I will not specifically ask questions about the materials before Test One, I do not know of any concepts before Test One that will not be used for Test Two.)
The best way to review is to:
(i) go over lecture materials,
(ii) read the textbook, and
(iii) go over the homework and quiz problems.

Past Exam Two (Spring 2016)
Past Exam Two (Spring 2019)

Note: Review Lecture (Tue Nov 9), Review Lecture (Wed Nov 10)
(Go to Brightspace, Content/Course Information to view both Tue and Wed's recorded review lecture.)

Test Two Statistics: Total number of students = 34
A (75 <= scores <= 100): No. of students = 12 (35%)
B (55 <= scores <= 74): No. of students = 13 (38%)
C (35 <= scores <= 54): No. of students = 9 (26%)
Average = 69 (Test One: 61)
Min = 40 (21), Max = 100 (99)
Mode = 82 (75)
Median = 66 (65)
Standard Deviation = 18 (20)
(Note: the above cut-offs are very rough and simple cut-offs, purely based on the test scores. I have not considered the hws, and quizzes.)

Test 2 Solution
(Go to Brightspace, Content/Course Information for recorded comments of Test Two Solution.)

---

Week 13 (Nov 16, 18):

Applications of matrices: rotation, projection and reflection.
[P 4.1, 4.2, 4.3] Determinant of a square matrix
(I) computation using co-factor expansion along any row (or column);
(II) computation using row (or column) reduction.
Applications of determinants:

computation of area of parallelogram and volume of parallelepiped

Cramer's rule for solving AX=b (for invertible square matrices)

formula for matrix inverse

---

Week 14 (Nov 23):

Further properties and applications of determinants.

Note: Lecture of Nov 23
(Go to Brightspace, Content/Course Information for the recorded lecture.)

Homework 9: due Thursday, Dec 2, in class.
p.176: 3.51, 3.52
p.192: 3.74, 3.75, 3.76, 3.77, 3.78, 3.85, 3.87
p.249: 4.1
p.259: 4.12, 4.15, 4.16, 4.17, 4.19, 4.24, 4.25
p.268: 4.34, 4.36, 4.41

---

Week 15 (Nov 30, Dec 2):

[P 5.1] Eigenvalue and eigenvectors:
AX=lambda X: X must not be the zero vector.
Examples with distinct and repeated eigenvalues.
Algebraic multiplities (m_i) vs geometric multiplicities (g_i): 1 <= g_i <= m_i
Deficient/defective eigenvalues and matrices: g_i < m_i
Non-deficient/non-defective eigenvalues and matrices: g_i = m_i
Linear independence of eigenvectors with distinct eigenvalues

Note: Eigenvalues and Eigenvectors

---

Week 16 (Dec 7, Dec 9):

[P 5.1, 5.2]
An application of eigenvalues and eigenvectors: computing matrix powers.
Use eigenvectors as basis.
Diagonalizable matrices and diagonalization process
Application to Markov processes.

Practice problems for Chapter 5 (no need to hand in):
p. 280: #5.3, 5.5, 5.10, 5.11, 5.12, 5.13, 5.14, 5.15, 5.16;
p. 285: #5.17, 5.20;
p. 290: #5.27, 5.28, 5.31, 5.32, 5.33, 5.34, 5.35, 5.37, 5.38, 5.39.

Note: Summary of 351

---

Final Exam: Wed 12/15, 8:00am - 10:00am, BRNG 2290

Materials covered: accumulative, i.e. everything covered in lectures, homeworks, quizzes.
You can use the above course log as a rough review sheet.
The best way to review is to read the textbook, go over the homework and quiz problems and understand.
NOTATION MATTERS!!!
No calculator or any electronic devices are allowed (nor needed).

Past final (Spring 2016)
Past final (Spring 2019)

Help sessions in zoom: Sunday, Monday 5pm-6pm.
(Both sessions will be recorded and posted in Brightspace.)

Notes:
Final Review - Part 1 (Dec 9)
Final Review - Part 2 (Dec 12)
Final Review - Part 3 (Dec 13)
Final Review - Part 4 (Dec 14)
(Go to Brightspace for recorded lecture.)