Technology
Data Science
Turn data into decisions, not just dashboards
Novice
Mastery0%
Novice
Technology
Turn data into decisions, not just dashboards
Novice
Subdomain
Machine learning is a set of tools for finding patterns in data too complex for manual analysis. Understanding the basics prevents misuse.
Regression Basics
A statistical method that models the relationship between one outcome variable and one or more predictor variables, producing predictions and measuring the size and direction of relationships.
Open
Classification vs Clustering
Classification assigns new observations to predefined categories using labelled training data (supervised). Clustering groups observations by similarity without predefined categories (unsupervised).
Open
Feature Engineering
The process of using domain knowledge to create, transform, or select input variables that make a machine learning model more accurate or interpretable.
Open
Overfitting and Underfitting
Overfitting is when a model learns the training data too specifically, including noise, and generalises poorly. Underfitting is when a model is too simple to capture the real patterns in the data.
Open
EDA
Exploratory Data Analysis. Examining data structure, quality, and patterns before modelling.
Correlation
A statistical measure of how two variables move together. Does not imply causation.
Causation
One variable producing changes in another. Established through experiments or causal inference methods.
p-value
The probability of observing results this extreme if the null hypothesis were true. Not the probability the alternative is true.
Overfitting
When a model memorises training data and generalises poorly to new data.
Underfitting
When a model is too simple to capture the real patterns in the data.
Bias-variance tradeoff
The tension between a model being too simple (high bias) and too sensitive to training data (high variance).
Feature engineering
Creating or transforming input variables to make a model more accurate or interpretable.
Bayes theorem
P(H|E) = P(E|H) * P(H) / P(E). The rule for updating beliefs given evidence.
A/B test
A randomised experiment assigning users to control and treatment conditions to measure the causal effect of a change.
Regularisation
A technique for reducing overfitting by penalising model complexity during training.
DPDPA
Digital Personal Data Protection Act 2023. India's framework governing how personal data is collected, used, and processed.