Machine Learning

Label Spreading
AI (Artificial Intelligence)

A Very Short Introduction of Label Spreading

A Brief History of Label Spreading: Who Developed It? Label spreading, like its sibling label propagation, was developed from the foundations of graph theory and became integral to semi-supervised learning. Researchers sought to improve upon label propagation by introducing a

Read More »
AI (Artificial Intelligence)

A Very Short Introduction of Manifold Assumption

A Brief History: Who Developed the Manifold Assumption? The manifold assumption, a foundational concept in semi-supervised learning (SSL), became widely recognized in the late 1990s and early 2000s. Researchers like Sam Roweis, Lawrence Saul, and Joshua Tenenbaum contributed to its

Read More »
Huber Cost Function
AI (Artificial Intelligence)

A Very Short Introduction of Huber Cost Function

A Brief History: Who Developed the Huber Cost Function? The Huber cost function, also known as Huber loss, was introduced by Peter J. Huber in 1964. Huber, a Swiss statistician, developed this function to create a robust method for regression

Read More »
CRLB
AI (Artificial Intelligence)

A Very Short Introduction of The Cramér-Rao Bound

Imagine an archer aiming at a target: the sharpness of the arrow determines how closely it can hit the bullseye. The Cramér-Rao Bound is like the sharpness of an estimator—it defines the theoretical lower limit of variance for an unbiased

Read More »
AI (Artificial Intelligence)

A Very Short introduction of Weighted Log Likelihood

A Brief History of Weighted Log Likelihood Weighted log likelihood emerged from advancements in statistics and machine learning: statisticians recognized the need to address the varying importance of data points in unbalanced datasets. Refined through years of research, it has

Read More »
Spectral Clustering
AI (Artificial Intelligence)

A Very Short Introduction of Spectral Clustering

A Brief History: Who Developed It? Spectral clustering was developed in the late 1990s: it quickly became a cornerstone for analyzing non-linear data. Combining graph theory and linear algebra, it offered a robust solution for handling datasets with intricate relationships.

Read More »
Metropolis Hasting
AI (Artificial Intelligence)

A Very Short Introduction of Metropolis-Hastings Sampling

A Brief History of This Tool The Metropolis-Hastings algorithm, a cornerstone of Bayesian computation, began its journey in 1953 with Nicholas Metropolis and gained further refinement in 1970 through W.K. Hastings. Initially devised for thermodynamic simulations, this algorithm has since

Read More »
Viterabi
AI (Artificial Intelligence)

A Very Short Introduction of Viterbi Algorithm

A Brief History: Who Developed It? The Viterbi Algorithm was introduced by Andrew Viterbi in 1967 to decode convolutional codes in communication systems. Its efficiency and reliability have since made it a cornerstone in fields like speech recognition, bioinformatics, and

Read More »