Useful tools
Useful tools
Preface
Introduction: human-machine entanglement
Machine learning: origins
Useful tools
Decision trees
Introduction to neural networks
Back-propagation
Regularisation
Optimisation
Building neural networks
Early applications of machine learning
Interpreting neural network decisions
Predicting corporate bond returns
Deep learning networks
Applications of deep learning networks
Machine intelligence
Consciousness
The future and its challenges
Artificial intelligence and the military
Final thoughts
Appendix
Epilogue
Acknowledgements
This chapter presents several of the mathematical and statistical algorithms that underlie machine learning computation. Readers having no experience of logarithms, probability density distributions or regression will find this useful for understanding the concepts presented in subsequent chapters. Those familiar with these tools may wish to skip this chapter.
3.1 LOGARITHMS AND EXPONENTS
Consider first exponential functions. These are often used in the activation functions of artificial neurons. An exponential function is a mathematical expression in the form:
where x is a variable and a is a constant called the base of the function, which is typically greater than zero. A commonly used exponential function base is the transcendental number e, also called Euler’s number, which is approximately equal to 2.71828. The domain of an exponential function is the set of all real numbers; the range is the set of all positive real numbers. Another popular logarithmic base is 10.
Parts (a) and (b) of Figure 3.1 present examples of exponential growth and decay functions. As illustrated in the graph of the growth function f (x), the exponential function increases rapidly
Copyright Infopro Digital Limited. All rights reserved.
As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (point 2.4), printing is limited to a single copy.
If you would like to purchase additional rights please email info@risk.net
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (clause 2.4), an Authorised User may only make one copy of the materials for their own personal use. You must also comply with the restrictions in clause 2.5.
If you would like to purchase additional rights please email info@risk.net