Machine Learning

AI (Artificial Intelligence)

A Very Short Introduction of Silhouette Score

A Brief History: Who Developed It? The Silhouette Score was introduced in 1986 by Belgian statistician Peter J. Rousseeuw: it evaluates the consistency of clusters in data. Over time, it has become a cornerstone metric for assessing clustering quality in

Read More »
AI (Artificial Intelligence)

A Very Short Introduction of Separable and Transpose Convolutions

A Brief History of Separable and Transpose Convolutions Imagine a versatile crafting toolkit, refined over decades to balance precision and scale. Separable convolutions, rooted in the field of signal processing, became popular in the 1990s for efficiently tackling detailed patterns.

Read More »
Sanger’s Network
AI (Artificial Intelligence)

A Very Short Introduction of Sanger’s Network

Sanger’s network, introduced by Terence D. Sanger in 1989, is a neural network model designed for online principal component extraction, enhancing feature extraction in unsupervised learning systems.
O’REILLY MEDIA
It simplifies complex datasets by identifying key patterns, making it valuable for dimensionality reduction and data compression. Australian government agencies, such as the Australian Bureau of Statistics and Transport for NSW, utilize Sanger’s network for tasks like census data processing and real-time traffic analysis, respectively. Tools like Scikit-learn and TensorFlow facilitate its implementation in various applications.

Read More »
Rubner
AI (Artificial Intelligence)

A Very Short Introduction of Rubner-Tavan’s Network

A Brief History: Who Developed It? Rubner-Tavan’s network, introduced in the 1980s by Joseph Rubner and Paul Tavan, emerged from the need to model adaptive neural systems efficiently. This innovation laid the groundwork for advancements in unsupervised learning and data

Read More »
raectifier
AI (Artificial Intelligence)

A Very Short Introduction of Rectifier Activation Functions

A Brief History: Who Invented It? Imagine a flashlight being turned on in a dark room. Geoffrey Hinton’s work in the 2000s popularized rectifier activation functions, much like flipping the switch illuminated new pathways in deep learning. They’ve since become

Read More »
Perceptron
AI (Artificial Intelligence)

A Very Short Introduction of Perceptron

A Brief History: Who Developed It? Imagine a key that unlocks the door to modern machine learning. That key is the perceptron, introduced in 1958 by Frank Rosenblatt, a psychologist and computer scientist. Inspired by the workings of biological neurons,

Read More »
PCA
AI (Artificial Intelligence)

A Very Short Introduction of Principal Component Analysis

A Brief History: Who Developed Principal Component Analysis? Principal Component Analysis (PCA), first introduced by Karl Pearson in 1901, revolutionized data analysis by uncovering the underlying patterns in datasets. Harold Hotelling later extended its applications in the 1930s, cementing PCA

Read More »
A Very Short Introduction of Neural NetworksA Very Short Introduction of Neural Networks
AI (Artificial Intelligence)

A Very Short Introduction of Neural Networks

The blog explains the history, functionality, and types of neural networks, detailing their applications and tools used in industries like healthcare, traffic optimisation, and economic modelling. It also emphasises the significance of neural networks in addressing challenges in machine learning.

Read More »
MLP
AI (Artificial Intelligence)

A Very Short Introduction of Multi-layer Perceptron (MLP)

The Multilayer Perceptron (MLP) is a foundational neural network model that transforms machine learning with its ability to solve non-linear problems and extract features automatically. This blog explores its history, structure, tools, and impactful applications across Australian industries.

Read More »
Momentum
AI (Artificial Intelligence)

A Very Short Introduction of Momentum and Nesterov Momentum

Momentum and Nesterov Momentum are essential optimisation techniques that accelerate machine learning training by smoothing updates and improving accuracy. This blog explores their history, functionality, features, and applications, including their impact in Australian industries like healthcare and environmental forecasting.

Read More »