Learning From Experience: The Story of Machine Learning#

Imagine you were tasked with building a perfect Spam Filter in the 1990s. As a programmer, you would write thousands of manual rules:

IF email contains “FREE MONEY” OR “CLAIM PRIZE” THEN classify as SPAM.

This works for a day, but then spammers change “FREE MONEY” to “FR€€ M0N€Y.” You add new rules, but the spammers always win. The problem is too complex and changes too fast for fixed, explicit rules.

*The Machine Learning Solution: Machine Learning (ML) solves this by abandoning fixed rules. Instead of telling the computer how to classify spam, we show it a mountain of data—millions of emails already labeled as “Spam” or “Not Spam.”

The ML algorithm then learns the hidden patterns and correlations on its own: not just individual words, but the combination of words, the structure of the text, and even the sender’s metadata.

This is the core idea:

Instead of programming explicit rules, we let the computer learn patterns from data.

The Human Analogy#

Before we define anything formally, let’s think like humans.

How do we learn?

A child sees many dogs. Some are big. Some are small. Some bark loudly. Over time, the child builds an internal concept:

“If it has four legs, fur, and barks; it’s probably a dog.”

No one writes down a perfect rule. The child learns from examples.

Machine Learning works the same way Instead of explicitly writing rules like:

IF a fruit is red, round, and grows on a tree → apple

We show the computer thousands of fruit images labeled apple, orange, banana, and so on. Over time, it learns the patterns that distinguish one fruit from another — on its own.

“Learning from examples” - that is the core idea.

Formal Definition: What is Machine Learning?#

Machine Learning (ML) is a subfield of Artificial Intelligence (AI) that focuses on developing systems that can learn from data and improve their performance on a specific task over time, without being explicitly programmed.for that task.

At its core, Machine Learning shifts the paradigm of computing:

Instead of writing explicit rules, we allow computers to discover patterns from data and use those patterns to make predictions or decisions. A widely accepted formal definition is:

A machine learns from experience (E) with respect to some task (T), and its performance (P) in the task improves.

This definition highlights three essential components:

  • Task (T): What the system is trying to do (e.g., classify images, predict prices, detect fraud)

  • Experience (E): The data the system learns from

  • Performance (P): How well the system performs the task

Learning occurs when performance improves as experience increases.

Think of it this way: instead of a traditional programmer writing a specific rule like “IF the email contains ‘prize’ and ‘claim now’ THEN classify as spam,” an ML algorithm is fed thousands of examples of spam and not-spam emails. It then learns the hidden patterns and rules on its own to make the classification.

The core idea can be summarized as:

Experience (E) → Task (T) → Performance (P)

Why Machine Learning?#

In traditional programming, we give the computer explicit rules to follow. However, some problems are too complex to define with simple rules; for example, identifying a cat in an image or predicting stock prices. Machine Learning (ML) helps solve such problems by learning patterns from data rather than following fixed instructions.

Traditional Programming vs Machine Learning#

Traditional Programming

Machine Learning

Rules + Data → Output

Data + Output → Rules (Model)

Example: Instead of writing rules to detect spam manually, we show the computer many examples of spam and not spam emails, and it learns the pattern itself.

Real-World Applications#

  • Recommendation Systems: Netflix suggestions, Amazon ‘Customers Also Bought…’

  • Natural Language Processing (NLP): Translation (Google Translate), Voice Assistants (Siri, Alexa).

  • Computer Vision: Facial recognition, self-driving cars.

  • Prediction: Stock market forecasting, predicting equipment failure.

  • Banking → fraud detection