https://www.quantstart.com/articles/How-to-Learn-Advanced-Mathematics-Without-Heading-to-University-Part-2
In the last article in the series we looked at the foundational courses that are often taken in a four-year undergraduate mathematics course. We saw that the major courses were Linear Algebra, Ordinary Differential Equations, Real Analysis and Probability. In the "second year" of our self-study mathematics degree we'll be digging deeper into analysis and algebra, with discussions on the Riemann integral, abstract algebra, metric spaces and vector calculus.
In a formal setting the midpoint of Year 2 is where students begin to
get a feel for whether they want to specialise in either pure or
applied mathematics, and whether they wish to concentrate on analysis or
algebra. Pure mathematics and algebra are quite synonymous, as are
analysis and applied mathematics. The former, because advanced pure
mathematics is often concerned with symmetry and relationships between
disparate areas of mathematics (such as the pairing of algebra and
geometry in algebraic geometry). The latter, because real-valued vector
spaces are often the domain of partial differential equations, which
represent spatio-temporaral physical phenomena such as electromagnetic
fields, compressible fluids and deformable structures.
It is highly likely that as a prospective quant you will want to specialise in applied mathematics, leading to courses in Stochastic Analysis, Fourier Analysis, Partial Differential Equations, Statistics and Scientific Computing. However, this is not always the case. Many famous quants started in pure mathematics or theoretical physics backgrounds, including Jim Simons and Emanuel Derman.
This article will cover Year 2 while the previous article covered Year 1. At least two more articles will cover Years 3 and 4. Later articles will cover the broad syllabus for a Masters in Financial Engineering (MFE) style course.
In addition further assumptions of structure are relaxed leading to the concept of metric spaces. These are sets that also possess a notion of "distance". Vector calculus extends differentiation and integration to vector spaces - highly applicable in the fields of electrodynamics, continuum mechanics and fluid dynamics.
Group theory is given more rigourous development via the introduction of rings as well as basic ideas of groups of matrices (Lie groups). Many courses also discuss non-Euclidean geometry in more depth. This includes spherical/elliptic geometry and hyperbolic geometry. These concepts eventually lead onto differential geometry and its application to the General Theory of Relativity.
The second year is also when basic stochastic processes are introduced, which are highly releveant for the quantitative finance professional. Another absolutely essential topic, which builds on the elementary probability discussed in Year 1, is statistics. Usually the statistics department of most universities will allow cross-over modules for mathematicians.
Also relevant to the quant, and usually offered as an option, is numerical analysis, which attempts to analyse algorithms that approximate problems in analysis such as with differential equations. Since many quant algorithms ultimately involve approximately computing values of functions, seeking eigenvalues, solving regression or optimisation problems (as in machine learning) it is highly worth studying as a module.
The courses found in a second year largely reflect the extension and consolidation of the topics introduced in the first year. The following areas of mathematics are considered:
f:R→R
), continuity of those functions as well as properties and results related to their derivatives.
In the second year the focus transfers across to the Riemann integral, which is the "standard" integral that will be familiar from high-school, as well as the concepts of pointwise convergence and uniform convergence of sequences of functions. One of the most important concepts discussed is the Fundamental Theorem of Calculus, which governs how derivatives and integrals of a function are related to each other.
Studying the Riemann integral is absolutely necessary for the quant analyst who desires to work in derivatives pricing, as a large part of stochastic calculus and probability theory relies on measure theoretic concepts such as the Lebesgue integral, which is more general than the more familiar Riemann integral.
Real analysis is a prerequesite for further second year courses in Metric Spaces and Vector Calculus, the latter of which is highly relevant to certain areas of machine learning.
This idea of distance within a set allows interesting properties to be discussed such as openness, closedness, completeness, connectedness as well as varying forms of continuity of functions between metric spaces. These ideas build on the concepts studied in Real Analysis, including sequences, series and convergence, albeit in higher dimensional settings.
A very familiar example of a metric space is three-dimensional Euclidean space with the "standard" Euclidean metric ("distance as the crow flies") between two points. A more abstract example is given by the Levenshtein distance between two strings of text, which allows a numerical measure of how similar the strings are. I can personally attest that this is extremely useful in the field of Natural Language Processing.
A course in vector calculus will introduce many useful tools such as the partial derivative, gradient, divergence, curl and Laplacian operators, as well as the key theorems of Gauss and Stokes, which are the building blocks of partial differential equations that ultimately model electromagnetic fields and fluid flows.
Partial derivatives and the gradient operator make strong appearances in the fields of statistical machine learning, particularly when it comes to optimising a solution over an optimisation surface as in the stochastic gradient descent algorithm.
Some university courses in vector calculus contain topics from the field of complex analysis. Although the majority of courses concentrate solely on physical applications of vector calculus methods such as electrodynamics, gravitation, continuum mechanics or fluid dynamics.
There is quite a large jump in complexity when studying differential equations of this type. The focus becomes less about mechanical methods for obtaining solutions and more about understanding the bounds on behaviour of more complicated systems. Differential equations eventually lead onto the more advanced area of dynamical systems. However, these are not often studied properly until the third or fourth year of a mathematics degree.
Ordinary differential equations also lead onto stochastic differential equations (SDE), which are ODE that contain a random aspect. SDE are extremely relevant to the prospective quant who wishes to study derivatives pricing and time series analysis. The underlying models for stock price movements are often modelled as geometric random walks necessitating the use of SDE.
Springer and CUP have a relatively good set of textbooks on ODEs. In particular after looking at those I recommended in the previous article, you could consider the following:
These additional geometries play a large part in the physical sciences, particularly the study of relativity and cosmology, where Riemannian geometry is used to model space-time in general relativity. These geometries are also extremely interesting subjects to study in their own right.
The study of geometry is less applicable to the quant than other areas of mathematics. However, I did mention in the previous article that a solid understanding of trigonometric concepts was essential for the study of Fourier Analysis, which is very relevant to quants.
A ring is similar to a group except that it has two operations representing "addition" and "multiplication". A group only has a single operation. Perhaps the most common example of a ring is that of the integers (Z
) with addition and multiplication.
The majority of second year abstract algebra courses discuss isomorphisms, quotient groups, Lagrange's Theorem, Abelian groups, orbits and stabilisers. These are all essential topics for futher study of abstract algebra including Lie groups and Lie algebras.
As I made clear in Part 1 it is not necessary for a prospective quant to have a huge grasp of group theoretic concepts. These concepts are not generally applicable to the main areas of quantitative finance. However, groups and rings are fascinating areas of mathematics and will provide a lot of enjoyment for the autodidact choosing to study them for their own sake.
Before studying stochastic calculus in depth, which requires an understand of the Lebesgue integral and other measure theoretic concepts, it is advisable to consider more elementary stochastic processes.
Such courses often begin with a review of probability theory, including a brief discussion on sigma-fields and probability measures (but without undue additional measure theoretic concepts). Attention then turns to processes such as discrete martingales and markov chains before introducing the continuous case.
Such a course naturally leads on to further study in stochastic analysis, which will introduce Ito calculus and ultimately options pricing.
Numerical analysis is extremely important to the solution of differential equations, which are pervasive in quantitative finance, fluid dynamics, gravitation, continuum mechanics and electrodynamics. Study of numerical analysis provides an understanding of when certain numerical techniques are applicable and when they can lead to excessive error.
As a quant it is likely that you will be using some form of numerical approximation, either Markov Chain Monte Carlo for Bayesian analysis or numerical integration for solving partial differential equations in derivatives pricing. Hence study of numerical analysis is a worthwhile endeavour to consider in order to avoid the common pitfalls.
In addition to its value as a risk management tool it also provides the foundations on which most of the major machine learning techniques are built. Hence it is imperative that prospective quant study statistics at the undergraduate level.
Statistics makes use of the theory of probability and then builds on it to discuss the concepts of probability distributions, expectation, correlation and covariance. Once these basic concepts are outlined the remainder of the material generally consists of explaining classical/frequentist hypothesis tests for data analysis.
These tests are incredibly pervasive in the commercial world - especially in quantitative finance. As a quant portfolio manager or risk analyst you will be using them frequently in real world settings. Hence it is worth becoming extremely familiar with these techniques.
A course in classical/frequentist statistics leads naturally to a course in Bayesian statistics. The latter has become popular in recent years due to the computational tractability of the underlying Markov Chain Monte Carlo algorithms.
I have outlined many courses above. Some of these are unimportant for the quant wishing to learn the "bare minimum" necessary for working on derivatives pricing, statistical machine learning or quantitative trading.
However it is important to realise that roles in quantitative finance are highly competitive. Having a well-rounded education in mathematics is just as important as knowing the prequisites for quantitative finance particularly when it comes to interview situations. One should not dismiss the more abstract courses such as Abstract Algebra or Non-Euclidean Geometry as results form these realms will often find their way into the more applied areas of mathematics and quantitative finance.
In the next article covering Year 3 we will look at more abstract areas of analysis, such as measure theory and functional analysis. The former is highly relevant for the study of probability and stochastic analysis. Many applied modules will be introduced such as Bayesian Statistics and Fluid Dynamics, both of which are great training grounds for teaching prospective quants how to perform data analysis and solve partial differential equations.
In the last article in the series we looked at the foundational courses that are often taken in a four-year undergraduate mathematics course. We saw that the major courses were Linear Algebra, Ordinary Differential Equations, Real Analysis and Probability. In the "second year" of our self-study mathematics degree we'll be digging deeper into analysis and algebra, with discussions on the Riemann integral, abstract algebra, metric spaces and vector calculus.
It is highly likely that as a prospective quant you will want to specialise in applied mathematics, leading to courses in Stochastic Analysis, Fourier Analysis, Partial Differential Equations, Statistics and Scientific Computing. However, this is not always the case. Many famous quants started in pure mathematics or theoretical physics backgrounds, including Jim Simons and Emanuel Derman.
This article will cover Year 2 while the previous article covered Year 1. At least two more articles will cover Years 3 and 4. Later articles will cover the broad syllabus for a Masters in Financial Engineering (MFE) style course.
Year 2
As mentioned briefly above the second year of an undergraduate mathematics degree extends the discussion of analysis to the Riemann integral, which is the usual integral that is familiar from highschool, engineering and physics. This is in contrast to the Lebesgue integral, which is discussed in Measure Theory during the third year.In addition further assumptions of structure are relaxed leading to the concept of metric spaces. These are sets that also possess a notion of "distance". Vector calculus extends differentiation and integration to vector spaces - highly applicable in the fields of electrodynamics, continuum mechanics and fluid dynamics.
Group theory is given more rigourous development via the introduction of rings as well as basic ideas of groups of matrices (Lie groups). Many courses also discuss non-Euclidean geometry in more depth. This includes spherical/elliptic geometry and hyperbolic geometry. These concepts eventually lead onto differential geometry and its application to the General Theory of Relativity.
The second year is also when basic stochastic processes are introduced, which are highly releveant for the quantitative finance professional. Another absolutely essential topic, which builds on the elementary probability discussed in Year 1, is statistics. Usually the statistics department of most universities will allow cross-over modules for mathematicians.
Also relevant to the quant, and usually offered as an option, is numerical analysis, which attempts to analyse algorithms that approximate problems in analysis such as with differential equations. Since many quant algorithms ultimately involve approximately computing values of functions, seeking eigenvalues, solving regression or optimisation problems (as in machine learning) it is highly worth studying as a module.
The courses found in a second year largely reflect the extension and consolidation of the topics introduced in the first year. The following areas of mathematics are considered:
- Structure - Groups, Metric Spaces
- Space/Geometry - Non-Euclidean Geometry
- Change - Vector Calculus, Non-Linearity, Chaos
- Applications - Stochastic Processes, Statistics, Numerical Analysis
- Real Analysis - Riemann Integral
- Metric Spaces
- Vector Calculus
- Ordinary Differential Equations - Nonlinearity and Chaos
- Geometry - Non-Euclidean
- Abstract Algebra
- Stochastic Processes
- Numerical Analysis
- Statistics
Real Analysis - Riemann Integral
The first year courses on real analysis tend to concentrate on sequences, series, functions of a single real variable (i.e.), continuity of those functions as well as properties and results related to their derivatives.
In the second year the focus transfers across to the Riemann integral, which is the "standard" integral that will be familiar from high-school, as well as the concepts of pointwise convergence and uniform convergence of sequences of functions. One of the most important concepts discussed is the Fundamental Theorem of Calculus, which governs how derivatives and integrals of a function are related to each other.
Studying the Riemann integral is absolutely necessary for the quant analyst who desires to work in derivatives pricing, as a large part of stochastic calculus and probability theory relies on measure theoretic concepts such as the Lebesgue integral, which is more general than the more familiar Riemann integral.
Real analysis is a prerequesite for further second year courses in Metric Spaces and Vector Calculus, the latter of which is highly relevant to certain areas of machine learning.
Study Material
- Textbook/~$35 - Principles of Mathematical Analysis by Walter Rudin
Metric Spaces
A course in Metric Spaces is often the first introduction to the more abstract ideas from the branch of mathematics known as topology. A metric space is a mathematical set along an associated function of two points within the set that defines a sense of "distance" or "metric" between them.This idea of distance within a set allows interesting properties to be discussed such as openness, closedness, completeness, connectedness as well as varying forms of continuity of functions between metric spaces. These ideas build on the concepts studied in Real Analysis, including sequences, series and convergence, albeit in higher dimensional settings.
A very familiar example of a metric space is three-dimensional Euclidean space with the "standard" Euclidean metric ("distance as the crow flies") between two points. A more abstract example is given by the Levenshtein distance between two strings of text, which allows a numerical measure of how similar the strings are. I can personally attest that this is extremely useful in the field of Natural Language Processing.
Study Material
At university I made use of Sutherland's Introduction to Metric and Topological Spaces for my second year Metric Spaces course. However, I've also found in retrospect that the Springer Undergraduate Mathematics Series book Metric Spaces, by M. O'Searcoid, is worth studying too.- Textbook/~$33 - Introduction to Metric and Topological Spaces by W.A. Sutherland
- Textbook/~$35 - Metric Spaces by M. O'Searcoid
Vector Calculus
Vector calculus is one of the most practically relevant courses for a prospective quant to have studied. It deals with the concept of change in scalar and vector fields. Many concepts in mathematics, physics and quant finance can be modelled as fields and as such the machinery of vector calculus is highly applicable.A course in vector calculus will introduce many useful tools such as the partial derivative, gradient, divergence, curl and Laplacian operators, as well as the key theorems of Gauss and Stokes, which are the building blocks of partial differential equations that ultimately model electromagnetic fields and fluid flows.
Partial derivatives and the gradient operator make strong appearances in the fields of statistical machine learning, particularly when it comes to optimising a solution over an optimisation surface as in the stochastic gradient descent algorithm.
Some university courses in vector calculus contain topics from the field of complex analysis. Although the majority of courses concentrate solely on physical applications of vector calculus methods such as electrodynamics, gravitation, continuum mechanics or fluid dynamics.
Study Material
- Textbook/~$46 - Vector Calculus by P.C. Matthews
- Textbook/~$38 - Div, Grad, Curl, and All That: An Informal Text on Vector Calculus by H.M. Schey
- MOOC/Free - MIT OCW Multivariable Calculus
Ordinary Differential Equations - Non-linearity and Chaos
Differential equations are a large research area in their own right. Once beyond the first year material, which generally finishes up discussing second order linear ODE with constant coefficients, more interesting ODE found in real-life applications appear. These include the areas of mechanics, electronics and mathematical biology. Such ODE possess non-linear and chaotic behaviour.There is quite a large jump in complexity when studying differential equations of this type. The focus becomes less about mechanical methods for obtaining solutions and more about understanding the bounds on behaviour of more complicated systems. Differential equations eventually lead onto the more advanced area of dynamical systems. However, these are not often studied properly until the third or fourth year of a mathematics degree.
Ordinary differential equations also lead onto stochastic differential equations (SDE), which are ODE that contain a random aspect. SDE are extremely relevant to the prospective quant who wishes to study derivatives pricing and time series analysis. The underlying models for stock price movements are often modelled as geometric random walks necessitating the use of SDE.
Study Material
As with first year ODE courses, there is no shortage of textbooks to learn undergraduate ordinary differential equations. The trick is to find a solid introductory text and then a text that goes a little deeper including discussions of control theory, non-linearity, chaos and modelling.Springer and CUP have a relatively good set of textbooks on ODEs. In particular after looking at those I recommended in the previous article, you could consider the following:
- Textbook/~$40 - Ordinary Differential Equations: Analysis, Qualitative Theory and Control by H. Logemann and E.P. Ryan
- Textbook/~$95 - Stability, Instability and Chaos: An Introduction to the Theory of Nonlinear Differential Equations by P. Glendinning
Geometry - Non-Euclidean
The familiar geometry of everyday life is three-dimensional Euclidean geometry. In the second year students are often introduced to projective geometry, elliptic geometry and hyperbolic geometry. These geometries arise when Euclids "fifth postulate" is relaxed, which allows parallel lines to cross or diverge, unlike in Euclidean geometry.These additional geometries play a large part in the physical sciences, particularly the study of relativity and cosmology, where Riemannian geometry is used to model space-time in general relativity. These geometries are also extremely interesting subjects to study in their own right.
The study of geometry is less applicable to the quant than other areas of mathematics. However, I did mention in the previous article that a solid understanding of trigonometric concepts was essential for the study of Fourier Analysis, which is very relevant to quants.
Study Material
- Textbook/~$32 - Geometry
by Roger Fenn
- Textbook/~$26 - Introduction to Projective Geometry by C.R. Wylie, Jr.
- Textbook/~$35 - Non-Euclidean Geometry by H.S.M. Coxeter
Abstract Algebra
In Part 1 we saw that students will often be exposed to abstract groups through a Foundations module. In Year 2 a more thorough treatment of abstract algebra is provided, which covers groups in depth and often leads onto the study of rings.A ring is similar to a group except that it has two operations representing "addition" and "multiplication". A group only has a single operation. Perhaps the most common example of a ring is that of the integers (
) with addition and multiplication.
The majority of second year abstract algebra courses discuss isomorphisms, quotient groups, Lagrange's Theorem, Abelian groups, orbits and stabilisers. These are all essential topics for futher study of abstract algebra including Lie groups and Lie algebras.
As I made clear in Part 1 it is not necessary for a prospective quant to have a huge grasp of group theoretic concepts. These concepts are not generally applicable to the main areas of quantitative finance. However, groups and rings are fascinating areas of mathematics and will provide a lot of enjoyment for the autodidact choosing to study them for their own sake.
Study Material
- Textbook/~$61 - Classic Algebra by P.M. Cohn
- Textbook/~$60 - Concrete Abstract Algebra: From Numbers to Gröbner Bases by N. Lauritzen
Stochastic Processes
Stochastic Processes is generally offered as an option module at university and as such is not "core". However it is clearly extremely relevant to quantitative finance particularly in the area of derivatives pricing.Before studying stochastic calculus in depth, which requires an understand of the Lebesgue integral and other measure theoretic concepts, it is advisable to consider more elementary stochastic processes.
Such courses often begin with a review of probability theory, including a brief discussion on sigma-fields and probability measures (but without undue additional measure theoretic concepts). Attention then turns to processes such as discrete martingales and markov chains before introducing the continuous case.
Such a course naturally leads on to further study in stochastic analysis, which will introduce Ito calculus and ultimately options pricing.
Study Material
- Textbook/~$33 - Basic Stochastic Processes by by Z. Brzezniak and T. Zastawniak
- Textbook/~$42 - Stochastic Calculus for Finance I by S. Shreve
Numerical Analysis
The main goal of Numerical Analysis is to introduce methods for solving equations via a numerical method, that is, using approximate methods rather than finding an analytic solution. The topic also introduces methods for understanding the errors introduced in the process as well as important concepts such as iterating equations, converge and stability.Numerical analysis is extremely important to the solution of differential equations, which are pervasive in quantitative finance, fluid dynamics, gravitation, continuum mechanics and electrodynamics. Study of numerical analysis provides an understanding of when certain numerical techniques are applicable and when they can lead to excessive error.
As a quant it is likely that you will be using some form of numerical approximation, either Markov Chain Monte Carlo for Bayesian analysis or numerical integration for solving partial differential equations in derivatives pricing. Hence study of numerical analysis is a worthwhile endeavour to consider in order to avoid the common pitfalls.
Study Material
- Textbook/~$288 (although it can be found much more cheaply by getting a second hand copy) - Numerical Analysis by R.L. Burden, J.D. Faires and A.M. Burden
- Textbook/~$77 - Numerical Recipes 3rd Edition: The Art of Scientific Computing by W.H. Press, S.A. Teukolsky, W.T. Vetterling and B.P. Flannery
Statistics
Statistics is probably the most sought after quantitative skill in the commercial sector that can be studied on a mathematics degree. It provides the basis for understanding uncertainty and measuring risk, both of which are absolutely crucial to practising quants.In addition to its value as a risk management tool it also provides the foundations on which most of the major machine learning techniques are built. Hence it is imperative that prospective quant study statistics at the undergraduate level.
Statistics makes use of the theory of probability and then builds on it to discuss the concepts of probability distributions, expectation, correlation and covariance. Once these basic concepts are outlined the remainder of the material generally consists of explaining classical/frequentist hypothesis tests for data analysis.
These tests are incredibly pervasive in the commercial world - especially in quantitative finance. As a quant portfolio manager or risk analyst you will be using them frequently in real world settings. Hence it is worth becoming extremely familiar with these techniques.
A course in classical/frequentist statistics leads naturally to a course in Bayesian statistics. The latter has become popular in recent years due to the computational tractability of the underlying Markov Chain Monte Carlo algorithms.
Study Material
- Textbook/~$13 - Schaum's Outline of Probability and Statistics
by Murray Spiegel, Jason Schiller and Alu Srinivasan
- Textbook/~$85 - Probability and Statistics by Example: Volume 1, Basic Probability and Statistics by Y. Suhov and M. Kelbert
- Textbook/~$42 - Statistical Inference by G. Casella and R.L. Berger
Next Steps
The second year of an undergraduate syllabus is all about consolidating and extending the ideas of the first year. For the autodidact it is a time to begin choosing modules that make sense for their own career trajectory.I have outlined many courses above. Some of these are unimportant for the quant wishing to learn the "bare minimum" necessary for working on derivatives pricing, statistical machine learning or quantitative trading.
However it is important to realise that roles in quantitative finance are highly competitive. Having a well-rounded education in mathematics is just as important as knowing the prequisites for quantitative finance particularly when it comes to interview situations. One should not dismiss the more abstract courses such as Abstract Algebra or Non-Euclidean Geometry as results form these realms will often find their way into the more applied areas of mathematics and quantitative finance.
In the next article covering Year 3 we will look at more abstract areas of analysis, such as measure theory and functional analysis. The former is highly relevant for the study of probability and stochastic analysis. Many applied modules will be introduced such as Bayesian Statistics and Fluid Dynamics, both of which are great training grounds for teaching prospective quants how to perform data analysis and solve partial differential equations.
Comments
Post a Comment