๐ What is Linear Algebra?
Linear Algebra is the branch of mathematics concerning linear equations, linear functions, and their representations through matrices and vector spaces.
It is fundamental in areas such as physics, engineering, computer graphics, machine learning, and more.
๐ข Scalars, Vectors, and Matrices
- Scalar: A single number (e.g., 3, -1, 0.5)
- Vector: An ordered list of numbers, often represented as a column or row (e.g., [2, 5] or โก2โค โฃ5โฆ)
- Matrix: A rectangular array of numbers arranged in rows and columns
๐งฎ Matrix Operations
Addition & Subtraction
You can add or subtract matrices of the same size by adding/subtracting corresponding elements.
Scalar Multiplication
Multiply every element in the matrix by a scalar value.
Matrix Multiplication
Multiply rows of the first matrix by columns of the second. Only possible if the number of columns in the first matrix equals the number of rows in the second.
Transpose
Switch rows and columns. If A is a 2ร3 matrix, then Aแต is 3ร2.
Determinant
Only defined for square matrices. The determinant gives useful properties like invertibility.
Inverse
The matrix Aโปยน is the inverse of A if A ร Aโปยน = I (identity matrix). Only invertible if determinant โ 0.
๐ Systems of Linear Equations
A system of linear equations is a set of equations like:
2x + 3y = 5
4x - y = 1
Can be solved using:
- Substitution
- Elimination
- Matrix methods (e.g., Gaussian elimination, inverse matrices)
๐ Vector Spaces
A vector space is a collection of vectors that can be added together and multiplied (scaled) by numbers (scalars).
To be a vector space, the set must satisfy 10 specific rules (like associativity, commutativity, zero vector, etc.).
Examples of vector spaces: โยฒ, โยณ, or any space where linear operations make sense.
๐ Linear Independence
Vectors are linearly independent if no vector in the set can be written as a linear combination of the others.
If they are dependent, it means at least one vector is redundant in describing the space.
๐ Basis and Dimension
A basis is a set of linearly independent vectors that span a vector space.
The dimension is the number of vectors in the basis.
Example: โยฒ has a dimension of 2, and a common basis is [1,0] and [0,1]
โ๏ธ Linear Transformations
A linear transformation is a function between vector spaces that preserves addition and scalar multiplication.
They can be represented by matrices: If T is a transformation, then T(x) = Aยทx where A is a matrix.
Applications include computer graphics (rotation, scaling, etc.)
๐ง Eigenvalues and Eigenvectors
For a matrix A, if Aยทv = ฮปยทv for a vector v โ 0, then:
- ฮป is an eigenvalue
- v is an eigenvector
These are powerful tools used in fields like physics, machine learning (PCA), and quantum mechanics.
๐ Applications of Linear Algebra
- 3D modeling and computer graphics
- Cryptography and coding theory
- Machine learning and AI (e.g., neural networks, PCA)
- Solving systems in engineering and physics
- Data science (dimensionality reduction, clustering)
๐ Practice Questions
- Add two 2ร2 matrices
- Find the inverse of a 2ร2 matrix
- Solve a system of equations using matrices
- Determine if a set of vectors is linearly independent
- Find the eigenvalues of a 2ร2 matrix
- Find a basis for a subspace of โยณ