If you examine the above table, there will be repetitive product items if consider for a size of an item there comes so many colours. We need to create different product rows for each size different colours.
So Let’s split the table into two.
1. Product Table
class CreateProducts < ActiveRecord::Migration[8.0]
def change
def change
create_table :products do |t|
t.string :name
t.text :description
t.string :category # women, men, kids, infants
t.decimal :rating, precision: 2, scale: 1, default: 0.0
t.timestamps
end
add_index :products, :category
end
end
end
2. Product Variant Table
class CreateProductVariants < ActiveRecord::Migration[8.0]
def change
create_table :product_variants do |t|
t.references :product, null: false, foreign_key: true
t.string :sku, null: false
t.decimal :price, precision: 10, scale: 2
t.string :size
t.string :color
t.integer :stock_quantity, default: 0
t.jsonb :specs, default: {}, null: false
t.timestamps
end
# GIN index for fast JSONB attribute searching
add_index :product_variants, :specs, using: :gin
add_index :product_variants, [ :product_id, :size, :color ], unique: true
add_index :product_variants, :sku, unique: true
end
end
Data normalization is a core concept in database design that helps organize data efficiently, eliminate redundancy, and ensure data integrity.
🔍 What Is Data Normalization?
Normalization is the process of structuring a relational database in a way that:
Reduces data redundancy (no repeated data)
Prevents anomalies in insert, update, or delete operations
Improves data integrity
It breaks down large, complex tables into smaller, related tables and defines relationships using foreign keys.
🧐 Why Normalize?
Problem Without Normalization
How Normalization Helps
Duplicate data everywhere
Moves repeated data into separate tables
Inconsistent values
Enforces rules and relationships
Hard to update data
Isolates each concept so it’s updated once
Wasted storage
Reduces data repetition
📚 Normal Forms (NF)
Each Normal Form (NF) represents a level of database normalization. The most common are:
🔸 1NF – First Normal Form
Eliminate repeating groups
Ensure each column has atomic (indivisible) values
Hover effects and transitions for a smooth UI experience.
Add Brand to products table
Let’s add brand column to the product table:
✗ rails g migration add_brand_to_products brand:string:
index
class AddBrandToProducts < ActiveRecord::Migration[8.0]
def change
# Add 'brand' column
add_column :products, :brand, :string
# Add index for brand
add_index :products, :brand
end
end
❗️Important Note:
❌ PostgreSQL does not support BEFORE or AFTER when adding a column.
Caused by:
PG::SyntaxError: ERROR: syntax error at or near "BEFORE" (PG::SyntaxError)
LINE 1: ...LTER TABLE products ADD COLUMN brand VARCHAR(255) BEFORE des...
PostgreSQL (default in Rails) does not support column order (they’re always returned in the order they were created).
If you’re using MySQL, you could use raw SQL for positioning as shown below.
If I USEMySQL, I would like to see the brand name as first column of the table products. You can do that by changing the migration to:
class AddBrandToProducts < ActiveRecord::Migration[8.0]
def up
execute "ALTER TABLE products ADD COLUMN brand VARCHAR(255) BEFORE description;"
add_index :products, :brand
end
def down
remove_index :products, :brand
remove_column :products, :brand
end
end
Reverting Previous Migrations
You can use Active Record’s ability to rollback migrations using the revert method:
require_relative "20121212123456_example_migration"
class FixupExampleMigration < ActiveRecord::Migration[8.0]
def change
revert ExampleMigration
create_table(:apples) do |t|
t.string :variety
end
end
end
The revert method also accepts a block of instructions to reverse. This could be useful to revert selected parts of previous migrations.
If you’ve already built a Rails 8 app using the default SQLite setup and now want to switch to PostgreSQL, here’s a clean step-by-step guide to make the transition smooth:
1.🔧 Setup PostgreSQL in macOS
🔷 Step 1: Install PostgreSQL via Homebrew
Run the following:
brew install postgresql
This created a default database cluster for me, check the output. So you can skip the Step 3.
==> Summary
🍺 /opt/homebrew/Cellar/postgresql@14/14.17_1: 3,330 files, 45.9MB
==> Running `brew cleanup postgresql@14`...
==> postgresql@14
This formula has created a default database cluster with:
initdb --locale=C -E UTF-8 /opt/homebrew/var/postgresql@14
To start postgresql@14 now and restart at login:
brew services start postgresql@14
Or, if you don't want/need a background service you can just run:
/opt/homebrew/opt/postgresql@14/bin/postgres -D /opt/homebrew/var/postgresql@14
Sometimes Homebrew does this automatically. If not:
initdb /opt/homebrew/var/postgresql@<version>
Or a more general version:
initdb /usr/local/var/postgres
Key functions of initdb: Creates a new database cluster, Initializes the database cluster’s default locale and character set encoding, Runs a vacuum command.
In essence, initdb prepares the environment for a PostgreSQL database to be used and provides a foundation for creating and managing databases within that cluster
🔷 Step 4: Create a User and Database
PostgreSQL uses a role-based access control. Create a user with superuser privileges:
# createuser creates a new Postgres user
createuser -s postgres
createuser is a shell script wrapper around the SQL command CREATE USER via the Postgres interactive terminal psql. Thus, there is nothing special about creating users via this or other methods
Then switch to psql:
psql postgres
You can also create a database:
createdb <db_name>
🔷 Step 5: Connect and Use psql
psql -d <db_name>
Inside the psql shell, try:
\l -- list databases
\dt -- list tables
\q -- quit
Then go to http://localhost:3000 and confirm everything works.
7. Check psql manually (Optional)
psql -d your_app_name_development
Then run:
\dt -- view tables
\q -- quit
8. Update .gitignore
Note: If not already added /storage/*
Make sure SQLite DBs are not accidentally committed:
/storage/*.sqlite3
/storage/*.sqlite3-journal
After moving into PostgreSQL
I was getting an issue with postgres column, where I have the following data in the migration:
# migration
t.decimal :rating, precision: 1, scale: 1
# log
ActiveRecord::RangeError (PG::NumericValueOutOfRange: ERROR: numeric field overflow
12:44:36 web.1 | DETAIL: A field with precision 1, scale 1 must round to an absolute value less than 1.
12:44:36 web.1 | )
Value passed is: 4.3. I was not getting this issue in SqLite DB.
What does precision: 1, scale: 1 mean?
precision: Total number of digits (both left and right of the decimal).
scale: Number of digits after the decimal point
If you want to store ratings like 4.3, 4.5, etc., a good setup is:
t.decimal :rating, precision: 2, scale: 1
# revert and migrate for products table
✗ rails db:migrate:down VERSION=2025031XXXXX -t
✗ rails db:migrate:up VERSION=2025031XXXXXX -t
Then go to http://localhost:3000 and confirm everything works.
For a Ruby on Rails 8 application, the choice of database depends on your specific needs, but here’s a breakdown of the best options and when to use each:
PostgreSQL (Highly Recommended)
Best overall choice for most Rails apps.
Why:
First-class support in Rails.
Advanced features like full-text search, JSONB support, CTEs, window functions.
Strong consistency and reliability.
Scales well vertically and horizontally (with tools like Citus).
Used by: GitHub, Discourse, Basecamp, Shopify.
Use if:
You’re building a standard Rails web app or API.
You need advanced query features or are handling complex data types (e.g., JSON).
SQLite (For development/testing only)
Lightweight, file-based.
Fast and easy to set up.
But not recommended for production.
Use if:
You’re building a quick prototype or local dev/testing app.
NOT for multi-user production environments.
MySQL / MariaDB
Also supported by Rails.
Can work fine for simpler applications.
Lacks some advanced features (like robust JSON support or full Postgres-style indexing).
Not the default in many modern Rails setups.
Use if:
Your team already has MySQL infrastructure or legacy systems.
You need horizontal scaling with Galera Cluster or similar setups.
Others (NoSQL like MongoDB, Redis, etc.)
Use Redis for caching and background job data (not as primary DB).
Use MongoDB or other NoSQL only if your data model really demands it (e.g., unstructured documents, event sourcing).
Recommendation Summary:
Use Case
Recommended DB
Production web/API app
PostgreSQL
Dev/prototyping/local testing
SQLite
Legacy systems/MySQL infrastructure
MySQL/MariaDB
Background jobs/caching
Redis
Special needs (e.g., documents)
MongoDB (with caution)
If you’re starting fresh or building something scalable and modern with Rails 8, go with PostgreSQL.
Let’s break that down:
💬 What does “robust JSON support” mean?
PostgreSQL supports a special column type: json and jsonb, which lets you store structured JSON data directly in your database — like hashes or objects.
Why it matters:
You can store dynamic data without needing to change your schema.
You can query inside the JSON using SQL (->, ->>, @>, etc.).
You can index parts of the JSON — for speed.
🔧 Example:
You have a products table with a specs column that holds tech specs in JSON:
SELECT * FROM products WHERE specs->>'color' = 'black';
Or check if the JSON contains a value:
SELECT * FROM products WHERE specs @> '{"brand": "Libas"}';
You can even indexspecs->>'color' to make these queries fast.
💬 What does “full Postgres-style indexing” mean?
PostgreSQL supports a wide variety of powerful indexing options, which improve query performance and flexibility.
⚙️ Types of Indexes PostgreSQL supports:
Index Type
Use Case
B-Tree
Default; used for most equality and range searches
GIN (Generalized Inverted Index)
Fast indexing for JSON, arrays, full-text search
Partial Indexes
Index only part of the data (e.g., WHERE active = true)
Expression Indexes
Index a function or expression (e.g., LOWER(email))
Covering Indexes (INCLUDE)
Fetch data directly from the index, avoiding table reads
B-Tree Indexes: B-tree indexes are more suitable for single-value columns.
When to Use GIN Indexes: When you frequently search for specific elements within arrays, JSON documents, or other composite data types.
Example for GIN Indexes: Imagine you have a table with a JSONB column containing document metadata. A GIN index on this column would allow you to quickly find all documents that have a specific author or belong to a particular category.
Why does this matter for our shopping app?
We can store and filter products with dynamic specs (e.g., kurtas, shorts, pants) without new columns.
Full-text search on product names/descriptions.
Fast filters: color = 'red' AND brand = 'Libas' even if those are stored in JSON.
Index custom expressions like LOWER(email) for case-insensitive login.
💬 What are Common Table Expressions (CTEs)?
CTEs are temporary result sets you can reference within a SQL query — like defining a mini subquery that makes complex SQL easier to read and write.
WITH recent_orders AS (
SELECT * FROM orders WHERE created_at > NOW() - INTERVAL '7 days'
)
SELECT * FROM recent_orders WHERE total > 100;
Breaking complex queries into readable parts.
Re-using result sets without repeating subqueries.
In Rails (via with from gems like scenic or with_cte):
Window functions perform calculations across rows related to the current row — unlike aggregate functions, they don’t group results into one row.
🔧 Example: Rank users by their score within each team:
SELECT
user_id,
team_id,
score,
RANK() OVER (PARTITION BY team_id ORDER BY score DESC) AS rank
FROM users;
Use cases:
Ranking rows (like leaderboards).
Running totals or moving averages.
Calculating differences between rows (e.g. “How much did this order increase from the last?”).
🛤 In Rails:
Window functions are available through raw SQL or Arel. Here’s a basic example:
User
.select("user_id, team_id, score, RANK() OVER (PARTITION BY team_id ORDER BY score DESC) AS rank")
CTEs and Window functions are fully supported in PostgreSQL, making it the go-to DB for any Rails 8 app that needs advanced querying.
JSONB Support
JSONB stands for “JSON Binary” and is a binary representation of JSON datathat allows for efficient storage and retrieval of complex data structures.
This can be useful when you have data that doesn’t fit neatly into traditional relational database tables, such as nested or variable-length data structures.
Absolutely — storing JSON in a relational database (like PostgreSQL) can be super powerful when used wisely. It gives you schema flexibility without abandoning the structure and power of SQL. Here are real-world use cases for using JSON columns in relational databases:
Here are real-world use cases for using JSON columns in relational databases:
🔧 1. Flexible Metadata / Extra Attributes
Let users store arbitrary attributes that don’t require schema changes every time.
A lightweight version that only declares attribute accessors for keys inside a JSON column. Doesn’t include serialization logic — so you usually use it with a json/jsonb/text column that already works as a Hash.
👉 Example:
class User < ApplicationRecord
store_accessor :settings, :theme, :notifications
end
This gives you:
user.theme, user.theme=
user.notifications, user.notifications=
🤔 When to Use Each?
Feature
When to Use
store
When you need both serialization and accessors
store_accessor
When your column is already serialized (jsonb, etc.)
If you’re using PostgreSQL with jsonb columns — it’s more common to just use store_accessor.
Querying JSON Fields
User.where("settings ->> 'theme' = ?", "dark")
Or if you’re using store_accessor:
User.where(theme: "dark")
💡 But remember: you’ll only be able to query these fields efficiently if you’re using jsonb + proper indexes.
🔥 Conclusion:
PostgreSQL can store, search, and index inside JSON fields natively.
This lets you keep your schema flexible and your queries fast.
Combined with its advanced indexing, it’s ideal for a modern e-commerce app with dynamic product attributes, filtering, and searching.
To install and set up PostgreSQL on macOS, you have a few options. The most common and cleanest method is using Homebrew. Here’s a step-by-step guide:
Order
.where("created_at < ?", last_created_at)
.order(created_at: :desc)
.limit(20)
This is called keyset pagination or cursor pagination.
Scenario 6 – SELECT *
Query:
SELECT*
FROM users;
Returns:
id
name
email
city
address
bio
avatar
...
Suppose the page only displays:
name
city
Why fetch everything?
Better:
SELECT
name,
city
FROM users;
Rails:
User.select(:name, :city)
Scenario 7 – COUNT(*)
Suppose:
SELECTCOUNT(*)
FROM orders;
On:
300 million rows
Question:
Can this be slow?
Yes.
Because PostgreSQL must count visible rows.
Unlike some databases, PostgreSQL generally doesn’t maintain an exact row count that’s instantly available for arbitrary COUNT(*).
Scenario 8 – DISTINCT
Query:
SELECTDISTINCT users.*
FROM users
JOIN orders
ON users.id=orders.user_id;
Question:
Why is DISTINCT needed?
Because JOIN duplicates users.
Could EXISTS express the requirement more directly?
SELECT*
FROM users u
WHEREEXISTS(
SELECT1
FROM orders o
WHERE o.user_id=u.id
);
Sometimes that’s clearer.
Scenario 9 – Functions in WHERE
Query:
SELECT*
FROM users
WHERE LOWER(email)='john@example.com';
Normal email index?
Not useful.
Solution:
CREATE INDEX idx_lower_email
ON users(LOWER(email));
Expression index.
Scenario 10 – Too Many Indexes
Suppose:
users
↓
12 indexes
Problem?
Every INSERT must update:
Table
+
12 indexes
Indexes speed reads but slow writes.
Always consider the workload.
Optimization Decision Tree
When a query is slow, ask:
Is PostgreSQL scanning too many rows?
│
▼
Yes
│
▼
Would an index help?
│
▼
Yes
│
▼
Do I already have one?
│
▼
No
│
▼
Create the correct index.
But also ask:
Am I returning unnecessary data?
Am I sorting unnecessarily?
Am I joining unnecessarily?
Am I executing the query too many times?
Real Rails Optimization Example
Suppose this page loads slowly:
@orders = Order
.where(status: "completed")
.order(created_at: :desc)
.limit(20)
Questions:
Is there an index on status?
Is there an index on created_at?
Would a composite index help?
Potential solution:
CREATE INDEX idx_orders_status_created_at
ON orders(status, created_at DESC);
Why?
Because the query filters by status and orders by created_at.
Senior Interview Exercise
Suppose you see:
SELECT*
FROM orders
WHERE user_id =100
ORDERBY created_at DESC
LIMIT20;
Which index would you create?
Many people answer:
(user_id)
(created_at)
A stronger answer is:
CREATE INDEX idx_orders_user_created
ON orders(user_id, created_at DESC);
Because it supports both the filter and the ordering in one index.
Common Performance Mistakes
Mistake 1
Adding indexes without measuring.
Mistake 2
Using SELECT * everywhere.
Mistake 3
Ignoring N+1 queries.
Mistake 4
Using huge OFFSET values.
Mistake 5
Creating duplicate indexes.
Mistake 6
Ignoring EXPLAIN ANALYZE.
Senior-Level Mental Model
Every query has a “cost.”
The cost comes from:
Rows read
+
Rows sorted
+
Rows joined
+
Rows transferred
+
Application round trips
The goal of optimisation is to reduce one or more of these.
Practical Exercises
Exercise 1
Create:
CREATE INDEX idx_orders_user_created
ON orders(user_id, created_at DESC);
Run:
EXPLAIN ANALYZE
SELECT*
FROM orders
WHERE user_id=1
ORDERBY created_at DESC
LIMIT20;
Observe whether PostgreSQL can avoid an explicit Sort.
Exercise 2
Compare:
SELECT*
FROM users;
with:
SELECT name, city
FROM users;
Think about the amount of data returned.
Exercise 3
Write three versions of:
“Find users with completed orders.”
Using:
JOIN
EXISTS
IN
Then compare their execution plans.
Exercise 4
Find a query that performs a Seq Scan.
Add an appropriate index.
Run EXPLAIN ANALYZE again.
What changed?
Interview Case Study
Imagine you’re in a senior Rails interview.
The interviewer says:
“A customer reports that the Orders page takes 6 seconds to load.”
A strong answer isn’t:
“I’ll add an index.”
A stronger answer is:
Reproduce the issue.
Identify the SQL generated by ActiveRecord.
Run EXPLAIN ANALYZE.
Inspect scan types, joins, and sort operations.
Check existing indexes.
Decide whether the fix belongs in the SQL, indexes, ActiveRecord code, or schema.
Measure again after the change.
That systematic approach demonstrates senior-level thinking.
Homework
Build a small benchmark using your practice schema.
Populate:
100,000 users
500,000 orders
Measure these queries before and after adding indexes:
Find a user by email.
Find recent orders for a user.
Find completed orders.
Find users with no orders.
For each query, record:
Execution plan
Execution time
Scan type
Rows estimated
Rows returned
Explain why PostgreSQL chose each plan.
What’s Next?
At this point, you’re already covering topics that many experienced Rails developers never study in depth.
For Day 8, I recommend Window Functions:
ROW_NUMBER()
RANK()
DENSE_RANK()
LAG()
LEAD()
Running totals
Moving averages
Top N per group
Window functions are common in reporting, analytics, and senior backend interviews because they solve problems that are difficult or inefficient with plain GROUP BY. Understanding them will significantly broaden your SQL toolkit.
Today we’ll go beyond “create an index” and learn how senior backend engineers decide which index to create.
This is one of the most valuable topics for PostgreSQL and Rails interviews.
By the end of this lesson, you should be able to answer questions like:
Why did you create that index?
instead of just saying
Because the query was slow.
Today’s Goals
We’ll learn:
Composite Indexes
Leftmost Prefix Rule
Covering Indexes (Index Only Scan)
Included Columns (INCLUDE)
Partial Indexes
Expression Indexes
Unique Indexes
Choosing the right index
B-tree vs Hash vs GIN vs GiST vs BRIN
Rails migration examples
Real production examples
Part 1 – Let’s Create a Realistic Table
We’ll use a slightly more realistic table.
DROP TABLE IF EXISTS users;
CREATE TABLE users (
id BIGSERIAL PRIMARY KEY,
email TEXT,
city TEXT,
age INTEGER,
active BOOLEAN,
created_at TIMESTAMP
);
Populate it:
INSERT INTO users(email, city, age, active, created_at)
SELECT
'user' || i || '@example.com',
CASE
WHEN i % 4 = 0 THEN 'Boston'
WHEN i % 4 = 1 THEN 'Chicago'
WHEN i % 4 = 2 THEN 'New York'
ELSE 'Dallas'
END,
20 + (i % 40),
(i % 10 <> 0),
NOW() - (i || ' days')::interval
FROM generate_series(1,100000) i;
Part 2 – Composite Indexes
Suppose your application frequently runs:
SELECT *
FROM users
WHERE city = 'Chicago'
AND age = 30;
Many developers think:
I’ll create two indexes.
CREATE INDEX idx_users_city
ON users(city);
CREATE INDEX idx_users_age
ON users(age);
Sometimes PostgreSQL can combine them using a Bitmap Index Scan.
But often, a composite index is even better.
CREATE INDEX idx_users_city_age
ON users(city, age);
How PostgreSQL Stores It
Think of it as sorting by the first column, then by the second.
Conceptually:
Boston
20
21
22
23
Chicago
20
21
22
23
24
25
Dallas
...
Notice:
Everything is ordered by:
city
↓
age
The Leftmost Prefix Rule
This is probably the most important composite-index interview question.
Suppose you have:
(city, age)
Will it help?
Query 1
WHERE city='Chicago'
✅ Yes
Because the index starts with city.
Query 2
WHERE city='Chicago'
AND age=30
✅ Yes
Perfect.
Query 3
WHERE age=30
❌ Usually No
Why?
Imagine a dictionary.
Can you find:
age = 30
without first knowing the city?
No.
The index is organised by city first.
Senior Interview Question
Which is better?
(city, age)
or
(age, city)
Answer:
It depends on your query patterns.
Suppose:
95% of queries are:
WHERE city='Chicago'
Choose:
(city, age)
Suppose:
95% are:
WHERE age=30
Choose:
(age, city)
There is no universally “better” order.
Practical Exercise
Create:
CREATE INDEX idx_users_city_age
ON users(city, age);
Now test:
EXPLAIN ANALYZE
SELECT*
FROM users
WHERE city='Chicago';
Test:
EXPLAIN ANALYZE
SELECT*
FROM users
WHERE city='Chicago'
AND age=30;
Test:
EXPLAIN ANALYZE
SELECT*
FROM users
WHERE age=30;
Observe which queries use the composite index.
Part 3 – Covering Indexes
Suppose you run:
SELECT email
FROM users
WHERE email='user500@example.com';
Question:
Why read the whole table?
The index already contains:
email
↓
pointer
If PostgreSQL can answer the query using only the index, it may perform an:
Index Only Scan
instead of:
Index Scan
Why Is It Faster?
Index Scan:
Index
↓
Find pointer
↓
Read table
↓
Return email
Index Only Scan:
Index
↓
Return email
The table doesn’t need to be accessed.
Important Detail
Index Only Scans are only possible when PostgreSQL knows that the table pages are “all-visible” via the Visibility Map, which is maintained by VACUUM.
We’ll study this in PostgreSQL Internals.
Try It
Create:
CREATE INDEX idx_users_email
ON users(email);
Run:
EXPLAIN ANALYZE
SELECT email
FROM users
WHERE email='user90000@example.com';
Sometimes you’ll see:
Index Only Scan
Sometimes:
Index Scan
We’ll later learn why.
Part 4 – INCLUDE Columns
Suppose your application frequently runs:
SELECT
email,
city
FROM users
WHERE email='user100@example.com';
A normal email index stores:
email
↓
pointer
The planner still needs to visit the table to fetch city.
PostgreSQL allows:
CREATE INDEX idx_users_email_include
ON users(email)
INCLUDE(city);
Now:
email is part of the searchable index key.
city is stored in the index payload.
This can allow an Index Only Scan for:
SELECT email, city
...
without making city part of the search order.
Interview Question
Difference between:
(email, city)
and
(email)
INCLUDE(city)
Answer:
city in a composite index affects the index ordering and can be used for searching.
city in INCLUDE cannot be searched efficiently but can be returned without accessing the table.
Part 5 – Partial Indexes
One of PostgreSQL’s best features.
Suppose:
100,000 users
90,000 active
10,000 inactive
Your application only searches active users.
Instead of indexing everybody:
CREATE INDEX idx_users_active
ON users(active);
Create:
CREATE INDEX idx_active_email
ON users(email)
WHERE active=true;
Now the index contains only active users.
Advantages:
Smaller index
Faster scans
Less maintenance
Query
SELECT*
FROM users
WHERE active=true
AND email='user100@example.com';
Perfect candidate.
Rails Migration
add_index:users,
:email,
where:"active = true"
Part 6 – Expression Indexes
Suppose users log in with:
WHERE LOWER(email)=LOWER(?)
Without an expression index:
PostgreSQL can’t efficiently use a normal email index because you’re applying a function to the column.
Create:
CREATE INDEX idx_users_lower_email
ON users(LOWER(email));
Now:
SELECT*
FROM users
WHERE LOWER(email)=LOWER('JOHN@test.com');
can use the index.
Rails Example
User.where(
"LOWER(email)=?",
email.downcase
)
Expression indexes are extremely common for case-insensitive searches.
Part 7 – Unique Indexes
Earlier we learned:
email UNIQUE
Internally PostgreSQL implements this using a unique index.
You can also create one directly:
CREATEUNIQUE INDEX idx_users_email_unique
ON users(email);
Now duplicates are impossible.
Interview Question
Difference between:
UNIQUECONSTRAINT
and
CREATEUNIQUE INDEX
Practically, both enforce uniqueness.
The preferred way for business rules is usually a UNIQUE constraint, which PostgreSQL implements using a unique index under the hood.
Part 8 – Index Types
So far we’ve only used:
B-tree
PostgreSQL supports several index types.
B-tree (Default)
Good for:
=
<
BETWEEN
ORDER BY
Most common.
Hash
Good for:
=
only.
Rarely needed because B-tree also supports equality efficiently.
GIN
Great for:
JSONB
Arrays
Full-text search
Rails examples:
where("tags @> ARRAY['ruby']")
or
where("metadata @> ?", ...)
GiST
Useful for:
Geospatial data
PostGIS
Range types
BRIN
Designed for huge tables where rows are naturally ordered.
Example:
Logs
Millions of rows
Ordered by timestamp
A BRIN index is tiny compared with a B-tree.
Quick Comparison
Index
Best Use
B-tree
Default choice
Hash
Equality only
GIN
JSONB, arrays, full-text
GiST
Geometry, ranges
BRIN
Huge sequential tables
Part 9 – Real Rails Examples
Login
User.find_by(email:params[:email])
Index:
(email)
User Orders
user.orders
Index:
(user_id)
Dashboard
Order.where(status:"pending")
Maybe:
(status)
But ask:
How selective is status?
If 95% are pending, maybe not.
Recent Orders
Order
.order(created_at::desc)
.limit(20)
Good candidate:
(created_at)
Or even:
(created_at DESC)
Part 10 – Choosing the Right Index
Never ask:
Which index can I create?
Ask:
Which queries does my application actually run?
Example:
95%
WHERE email=?
Index email.
Example:
95%
WHERE city='Chicago'
Index city.
Example:
95%
WHERE city='Chicago'
AND age=30
Composite index.
Indexes should be driven by query patterns, not by table columns.
Common Mistakes
Mistake 1
Creating:
(city)
(age)
when almost every query filters on both together.
Mistake 2
Wrong column order.
(age, city)
when almost every query starts with city.
Mistake 3
Using functions without expression indexes.
LOWER(email)
Mistake 4
Indexing everything.
Indexes are not free.
Senior-Level Insights
Composite indexes should reflect how your application filters data, not simply the table schema.
Partial indexes are often a better solution than full indexes when only a subset of rows is queried frequently.
Expression indexes solve a very common performance problem when functions are applied in WHERE clauses.
Covering indexes reduce table lookups and can enable Index Only Scans.
The best index is the one that matches your most common query pattern—not necessarily the one that indexes the most columns.
Practical Exercises
Exercise 1
Create:
(city, age)
Run:
EXPLAIN ANALYZE
SELECT*
FROM users
WHERE city='Boston';
Exercise 2
Run:
SELECT*
FROM users
WHERE city='Boston'
AND age=35;
Observe the plan.
Exercise 3
Run:
SELECT*
FROM users
WHERE age=35;
Explain why the composite index is or isn’t used.
Exercise 4
Create:
CREATE INDEX idx_lower_email
ON users(LOWER(email));
Run:
EXPLAIN ANALYZE
SELECT*
FROM users
WHERE LOWER(email)=LOWER('user100@example.com');
Exercise 5
Create a partial index:
CREATE INDEX idx_active_users
ON users(email)
WHERE active=true;
Run:
SELECT*
FROM users
WHERE active=true
AND email='user100@example.com';
Compare the execution plan with and without the partial index.
Homework
Create and test:
A composite index
A partial index
An expression index
A unique index
For each index, answer:
Which query benefits?
Why?
Would a different index be better?
Use EXPLAIN ANALYZE to verify your assumptions.
Day 6C Preview
Next, we’ll become execution plan detectives.
We’ll take real EXPLAIN ANALYZE outputs like:
Gather
Hash Join
Nested Loop
Memoize
Bitmap Heap Scan
Bitmap Index Scan
Sort
Aggregate
Limit
Materialize
and decode every single line.
By the end of Day 6C, we’ll be able to sit in a senior interview, look at a PostgreSQL execution plan, and explain not just what PostgreSQL did, but why it chose that plan. That is a skill that sets experienced backend engineers apart.
In this post let’s find out how the data structure look like for a b-tree index in postgresql. Also we analyse our following test query results using EXPLAIN ANALYSE
EXPLAIN ANALYSE SELECT * FROM users WHERE city='Chicago';
QUERY PLAN ----- Seq Scan on users (cost=0.00..2332.00 rows=24780 width=51)
(actual time=0.077..21.085 rows=25000 loops=1)
CREATE INDEX idx_users_city ON users(city);
CREATE INDEX EXPLAIN ANALYSE SELECT * FROM users WHERE city='Chicago';
QUERY PLAN ---- Bitmap Heap Scan on users (cost=280.34..1672.09 rows=24780 width=51)
(actual time=3.309..15.732 rows=25000 loops=1)
Q1) How can PostgreSQL build a B-tree index for emails when every email is unique?
Short answer: Yes. The index contains one entry for every row.
The tree lets PostgreSQL eliminate huge portions of the search space.
Instead of checking every row, it follows the correct branch.
Does it consume memory?
Yes.
Every index consumes disk space.
If you have:
1 million rows
and create an index on email,
the index also has approximately 1 million entries.
That’s why we don’t create indexes on everything.
What happens during INSERT?
Suppose:
INSERT INTO users(email)
VALUES ('zack@test.com');
PostgreSQL does two things:
Inserts the row into the table.
Inserts a new entry into the B-tree.
That’s why indexes make:
INSERT
UPDATE
DELETE
slightly slower.
Interview Question
If an index has one entry per row, isn’t searching still O(n)?
No.
Because of the B-tree.
Searching isn’t done linearly.
It’s approximately:
O(log n)
instead of
O(n)
For:
1,000,000 rows
a B-tree may require only around 20–25 comparisons rather than scanning all million rows.
Q2. Why did PostgreSQL use a Bitmap Heap Scan instead of an Index Scan?
Your output:
Before index:
Seq Scan on users
rows = 25000
After index:
Bitmap Heap Scan
rows = 25000
This is actually exactly what PostgreSQL should do.
Let’s understand why.
Your data distribution
Remember how you inserted the data?
CASE
WHEN i % 4 = 0 THEN 'Boston'
WHEN i % 4 = 1 THEN 'Chicago'
WHEN i % 4 = 2 THEN 'New York'
ELSE 'Dallas'
END
So:
100,000 rows
↓
4 cities
↓
25,000 users per city
That means:
Chicago
↓
25%
of the table
Option 1 — Sequential Scan
Without index:
Read
100000 rows
↓
Return
25000 rows
One pass through the table.
Option 2 — Normal Index Scan
Imagine PostgreSQL used the city index.
It would do something like:
Index
↓
Find row 4
↓
Jump to table
↓
Find row 9
↓
Jump to table
↓
Find row 13
↓
Jump to table
...
25000 times
That’s a lot of random table accesses.
Random disk reads (or random memory accesses) are expensive.
Option 3 — Bitmap Heap Scan
This is PostgreSQL’s compromise.
Step 1:
Read the index.
Chicago
↓
Rows
4
9
13
22
31
...
99998
Instead of fetching the rows immediately, PostgreSQL creates a bitmap.
Conceptually:
Rows to fetch
4
9
13
22
31
...
Then it sorts/groups those row locations by table page.
Only then does it read the table.
So instead of:
Index
↓
Table
↓
Index
↓
Table
↓
Index
↓
Table
it does:
Index
↓
Collect all matching row locations
↓
Read table pages efficiently
↓
Return rows
This reduces random I/O significantly.
When does PostgreSQL choose Bitmap Heap Scan?
Typically when:
Some rows match
but
not too few
and
not almost all.
Think of it like this:
Rows matched
Likely plan
1 row
Index Scan
100 rows
Index Scan
5,000 rows
Bitmap Heap Scan
25,000 rows
Bitmap Heap Scan
99,000 rows
Seq Scan
The exact thresholds depend on statistics and cost estimates.
Why not an Index Scan?
Your query returns:
25,000 rows
That’s 25% of the table.
PostgreSQL thinks:
“Using the index is worthwhile, but fetching 25,000 rows one-by-one would be inefficient. I’ll gather all matching row locations first and then fetch the data in batches.”
That’s why you got:
Bitmap Heap Scan
Understanding our EXPLAIN ANALYZE Output
Seq Scan on users
(cost=0.00..2332.00 rows=24780 width=51)
(actual time=0.077..21.085 rows=25000 loops=1)
Let’s decode it.
Seq Scan
PostgreSQL reads every row.
cost
0.00..2332.00
This is not time.
It’s PostgreSQL’s internal cost estimate.
0.00 = startup cost
2332.00 = estimated total cost
Costs are used only to compare execution plans.
rows=24780
Planner estimated:
24,780 rows
Actual:
25,000 rows
Excellent estimate.
Good statistics help PostgreSQL choose the right plan.
width=51
Average row size is estimated to be:
51 bytes
This helps estimate I/O cost.
actual time
0.077..21.085
First row available after 0.077 ms.
Entire query finished after 21.085 ms.
loops=1
The node executed once.
After Creating the Index
Bitmap Heap Scan
(actual time=3.309..15.732)
Notice:
Execution time dropped from roughly:
21 ms
↓
16 ms
The improvement isn’t dramatic because your query still returns 25% of the table.
Indexes shine when they allow PostgreSQL to skip most of the table.
Want to See an Index Scan?
Try a highly selective query.
EXPLAIN ANALYZE
SELECT *
FROM users
WHERE email = 'user75000@example.com';
Since email is unique, PostgreSQL should choose:
Index Scan
because only one row matches.
A Practical Rule for Senior Engineers
When reading an execution plan, ask yourself these questions in order:
How many rows does the query return?
How many rows are in the table?
Is the predicate selective enough for an index?
What scan type did PostgreSQL choose?
Does that choice make sense?
Let’s cover the following topics in the remaining areas of Day 6.
Day 6B – Composite indexes, covering indexes, partial indexes, unique indexes, expression indexes, GIN vs GiST vs BRIN vs Hash indexes, and real-world Rails indexing strategies
Day 6C – Query optimization workshop: we’ll analyze real EXPLAIN ANALYZE outputs together, identify bottlenecks, and optimize queries step by step.
Given our role of Senior Rails Developer, Let’s spend 3 focused sessions on indexing and query optimization will provide much more value than rushing to the next topic.
Today marks an important milestone in this course.
Up until now, we’ve focused on writing correct SQL.
From today onward, we’ll focus on writing fast SQL.
This is one of the biggest differences between a mid-level Rails developer and a senior Rails developer.
A mid-level developer asks:
“Does my query work?”
A senior developer asks:
“How many rows did PostgreSQL have to examine to answer this query?”
Today’s Goals
By the end of today, you should understand:
What an index is
How PostgreSQL uses indexes
B-Tree indexes
Sequential Scan
Index Scan
Bitmap Index Scan
EXPLAIN
EXPLAIN ANALYZE
When indexes help
When indexes hurt
Composite indexes
Foreign key indexes
ActiveRecord index creation
Common interview questions
A Senior Engineer’s Mental Model
Imagine you have a book with 2 million pages.
You need to find:
Ruby on Rails
Without an Index
You start from page 1.
Page 1
Page 2
Page 3
...
Page 2,000,000
This is a Sequential Scan.
With an Index
You open the index section at the back of the book.
Ruby on Rails → Page 1,542,381
Immediately jump there.
This is an Index Scan.
That analogy is almost exactly how database indexes work.
Part 1 – Create a Practice Table
We’ll create a larger dataset than before.
DROPTABLEIFEXISTS users;
CREATETABLE users (
id BIGSERIAL PRIMARYKEY,
name VARCHAR(100),
email VARCHAR(255),
city VARCHAR(100),
age INTEGER,
active BOOLEANDEFAULTtrue
);
Insert Sample Data
Instead of inserting thousands of rows manually, PostgreSQL provides a wonderful function:
generate_series()
We’ll use it a lot.
INSERTINTO users(name, email, city, age)
SELECT
'User '|| i,
'user'|| i ||'@example.com',
CASE
WHEN i %4=0THEN'Boston'
WHEN i %4=1THEN'Chicago'
WHEN i %4=2THEN'New York'
ELSE'Dallas'
END,
20+(i %40)
FROM generate_series(1,100000) i;
Congratulations.
You now have:
100,000 users
Verify:
SELECTCOUNT(*)
FROM users;
Output:
100000
Part 2 – Why Indexes Exist
Suppose we search:
SELECT*
FROM users
WHERE email ='user75000@example.com';
Without an index:
PostgreSQL has to inspect rows one by one.
User 1
No
↓
User 2
No
↓
User 3
No
↓
...
↓
User 75,000
YES
Potentially:
75,000 comparisons
Part 3 – See PostgreSQL’s Plan
Instead of running:
SELECT*
FROM users
WHERE email='user75000@example.com';
Run:
EXPLAIN
SELECT*
FROM users
WHERE email='user75000@example.com';
You will likely see something similar to:
Seq Scan on users
This means:
Sequential Scan
Interview Question:
What is a Sequential Scan?
Answer:
PostgreSQL reads every row (or nearly every row) in the table to evaluate the query condition.
Part 4 – Create an Index
Let’s create one.
CREATE INDEX idx_users_email
ON users(email);
Run:
EXPLAIN
SELECT*
FROM users
WHERE email='user75000@example.com';
Now you’ll likely see:
Index Scan
Congratulations!
You just made your first query significantly faster.
What Is an Index?
An index is a separate data structure maintained by PostgreSQL.
Conceptually:
users table
id
name
email
...
↓
Index
email
↓
Row Location
Notice:
The table itself is not sorted.
The index is.
Part 5 – B-Tree Index
The default PostgreSQL index type is:
B-tree
Rails interviewers love asking:
What type of index does PostgreSQL create by default?
Answer:
B-tree
Good for:
=
<
BETWEEN
ORDER BY
Create explicitly:
CREATE INDEX idx_users_age
ON users
USING btree(age);
Usually:
CREATE INDEX idx_users_age
ON users(age);
creates the same thing.
Part 6 – EXPLAIN ANALYZE
Very important.
Difference:
EXPLAIN
Shows what PostgreSQL plans to do.
EXPLAIN ANALYZE
Actually runs the query and measures it.
Run:
EXPLAIN ANALYZE
SELECT*
FROM users
WHERE email='user75000@example.com';
Output looks similar to:
Index Scan
Planning Time: 0.2 ms
Execution Time: 0.1 ms
Notice:
Planning time
vs
Execution time.
Reading EXPLAIN ANALYZE
Typical output:
Index Scan using idx_users_email
(cost=0.42..8.44)
(rows=1)
(width=65)
(actual time=0.03..0.04)
(actual rows=1)
Don’t panic.
We’ll learn each part.
rows
Estimated rows.
Example:
rows=1
Planner expects:
1 row
actual rows
Returned rows.
actual rows=1
Perfect.
If estimates differ greatly from actual rows, PostgreSQL may choose a poor plan.
This is one reason why running ANALYZE (to refresh table statistics) matters.
Part 7 – Why Doesn’t PostgreSQL Always Use an Index?
This surprises many developers.
Suppose:
SELECT*
FROM users;
Would an index help?
No.
You need every row.
Sequential Scan is faster.
Suppose:
SELECT*
FROM users
WHERE active=true;
Imagine:
98%
of users
are active.
Would using an index help?
Usually not.
Why?
Using the index would require PostgreSQL to:
traverse the index
then visit almost every table row anyway
Sometimes a Sequential Scan is cheaper.
Interview Question:
Why might PostgreSQL ignore an index?
Good answer:
Because the planner estimates that scanning the entire table is cheaper than using the index, often due to low selectivity or because a large percentage of rows match the condition.
Part 8 – Selectivity
A crucial concept.
Imagine:
Gender
Male
Female
Only two values.
Index?
Not very useful.
Now:
email
Every row unique.
Excellent index.
Rule of thumb:
Higher uniqueness
↓
Better selectivity
↓
More useful index
Examples:
Good:
email
UUID
order_number
tracking_number
Poor:
gender
active
status (if only a few values)
Part 9 – Composite Indexes
Suppose we often search:
SELECT*
FROM users
WHERE city='Chicago'
AND age=25;
Instead of:
CREATE INDEX idx_city;
CREATE INDEX idx_age;
We can create:
CREATE INDEX idx_city_age
ON users(city, age);
Interview Question:
Will this index help?
WHERE city='Chicago'
Yes.
Will it help?
WHERE city='Chicago'
AND age=25
Yes.
Will it help?
WHERE age=25
Usually No.
This is called the Leftmost Prefix Rule.
Leftmost Prefix Rule
For an index:
(city, age)
Efficient for:
WHERE city='Chicago'
and
WHERE city='Chicago'
AND age=25
Not generally for:
WHERE age=25
because the index is ordered by city first.
Part 10 – Indexes on Foreign Keys
Consider:
orders
user_id
Rails creates:
belongs_to:user
You often query:
SELECT*
FROM orders
WHERE user_id=5;
Should user_id be indexed?
Absolutely.
Without it:
Every order
↓
Scan
With it:
Jump directly to user 5's orders.
Rails Migration
add_reference:orders,
:user,
foreign_key:true,
index:true
or
t.references:user,
foreign_key:true
Rails creates the index automatically.
Part 11 – Rails Examples
Find by email:
User.find_by(email:email)
Should email be indexed?
Yes.
Authentication:
User.find_by(email:params[:email])
Index?
Definitely.
Showing a user’s orders:
user.orders
Queries:
WHERE user_id=?
Index?
Yes.
Searching by created_at:
Order.order(created_at::desc)
Index?
Often yes, especially for recent-record queries or pagination.
Part 12 – Bitmap Index Scan
Sometimes PostgreSQL combines indexes.
Example:
city='Chicago'
AND
age=30
Two separate indexes:
idx_city
idx_age
Planner may choose:
Bitmap Index Scan
Meaning:
scan both indexes
combine the matching row locations
visit the table once
This can be efficient when no suitable composite index exists.
Today we move from basic filtering and aggregation into query composition.
This is an important topic for senior Rails interviews because many real production queries can be expressed in several ways:
JOIN
IN
EXISTS
Subquery
ActiveRecord association queries
A senior engineer should know not only how to write them, but also:
Which query expresses the business requirement most clearly?
Does the query preserve duplicates?
Does NULL affect the result?
Does PostgreSQL need to calculate one value or evaluate rows repeatedly?
What SQL is ActiveRecord generating?
We’ll build on the users and orders tables from Day 4.
Today’s Goals
By the end of Day 5, you should understand:
What a subquery is
Scalar subqueries
Multi-row subqueries
Subqueries in WHERE
Subqueries in FROM
Correlated subqueries
IN
EXISTS
NOT EXISTS
NOT IN and the NULL trap
ANY
ALL
JOIN vs IN vs EXISTS
ActiveRecord equivalents
Common mistakes
Senior interview questions
Part 1 – Prepare the Practice Data
We’ll use the same domain from Day 4, but add a few more rows to make today’s queries more interesting.
First, inspect your current data:
SELECT*FROM users ORDERBY id;
SELECT*FROM orders ORDERBY id;
If you want to recreate everything from scratch, run:
DROPTABLEIFEXISTS orders;
DROPTABLEIFEXISTS users;
CREATETABLE users (
id BIGSERIAL PRIMARYKEY,
name VARCHAR(100)NOTNULL,
city VARCHAR(100)
);
CREATETABLE orders (
id BIGSERIAL PRIMARYKEY,
user_id BIGINT NOTNULL,
amount NUMERIC(10,2)NOTNULL,
status VARCHAR(20)NOTNULL,
created_at TIMESTAMPNOTNULLDEFAULT NOW(),
CONSTRAINT fk_orders_user
FOREIGNKEY(user_id)
REFERENCES users(id)
);
Insert users:
INSERTINTO users(name, city)
VALUES
('John','New York'),
('Mary','Chicago'),
('Bob','Chicago'),
('Alice','Boston'),
('David','Mumbai'),
('Sara','Boston');
Insert orders:
INSERTINTO orders(user_id, amount, status)
VALUES
(1,100,'completed'),
(1,250,'completed'),
(1,75,'pending'),
(2,500,'completed'),
(2,300,'completed'),
(3,200,'pending'),
(4,800,'completed'),
(4,150,'cancelled'),
(6,1000,'completed'),
(6,1200,'completed');
Now our data looks conceptually like this:
User
Orders
John
100, 250, 75
Mary
500, 300
Bob
200
Alice
800, 150
David
No orders
Sara
1000, 1200
This dataset is intentionally designed so we can practice:
users with orders
users without orders
users above average spending
users with expensive orders
correlated subqueries
EXISTS and NOT EXISTS
Part 2 – What Is a Subquery?
A subquery is a query nested inside another SQL statement.
Example:
SELECT*
FROM orders
WHERE amount >(
SELECT AVG(amount)
FROM orders
);
The inner query is:
SELECT AVG(amount)
FROM orders;
The outer query is:
SELECT*
FROM orders
WHERE amount >(...);
Conceptually:
Inner query
↓
Calculate average order amount
↓
Return the result
↓
Outer query
↓
Find orders greater than that value
Let’s run the inner query separately first:
SELECT AVG(amount)
FROM orders;
Total amount:
4575
Number of orders:
10
Average:
457.5
Now the outer query becomes conceptually:
SELECT*
FROM orders
WHERE amount >457.5;
Result:
500
800
1000
1200
Rails Equivalent
Order.where(
"amount > (?)",
Order.select("AVG(amount)")
)
However, in Rails you may also see:
average=Order.average(:amount)
Order.where("amount > ?", average)
These are not exactly the same approach.
The first can produce one SQL statement containing a subquery.
The second executes:
Query 1 → Calculate average
Query 2 → Find orders above average
That distinction can matter when data changes between queries and when minimizing database round trips.
Part 3 – Scalar Subqueries
A scalar subquery returns:
One row
One column
Therefore, it produces a single value.
Example:
SELECT AVG(amount)
FROM orders;
Result:
457.5
We can use that result with operators such as:
=
>
<
>=
<=
<>
Example:
SELECT
id,
user_id,
amount
FROM orders
WHERE amount >(
SELECT AVG(amount)
FROM orders
);
What Happens if the Subquery Returns Multiple Rows?
Try:
SELECT*
FROM orders
WHERE amount =(
SELECT amount
FROM orders
);
The inner query returns many rows.
PostgreSQL will raise an error similar to:
more than one row returned by a subquery used as an expression
Why?
Because:
amount = ???
expects one value.
But the subquery returned:
100
250
75
500
300
...
PostgreSQL cannot compare one amount against multiple scalar values using =.
This leads us to IN.
Part 4 – IN with a Subquery
Suppose the requirement is:
Find users who have placed at least one order.
We can write:
SELECT*
FROM users
WHERE id IN(
SELECT user_id
FROM orders
);
Run the subquery separately:
SELECT user_id
FROM orders;
Result:
1
1
1
2
2
3
4
4
6
6
Conceptually:
SELECT*
FROM users
WHERE id IN(1,1,1,2,2,3,4,4,6,6);
Result:
John
Mary
Bob
Alice
Sara
David is excluded because he has no orders.
Rails Equivalent
A good ActiveRecord version is:
User.where(
id:Order.select(:user_id)
)
Conceptually, Rails can generate:
SELECT*
FROM users
WHERE id IN(
SELECT user_id
FROM orders
);
Notice the difference between:
Order.select(:user_id)
and:
Order.pluck(:user_id)
This is important.
Using select
User.where(id:Order.select(:user_id))
can remain a single SQL statement with a subquery.
Using pluck
User.where(id:Order.pluck(:user_id))
executes the inner query immediately.
Conceptually:
Query 1
SELECT user_id FROM orders;
Then Rails constructs another query:
Query 2
SELECT *
FROM users
WHERE id IN (1, 1, 1, 2, 2, 3, ...);
For a large dataset, that can be undesirable.
Senior-Level Insight
When building SQL subqueries in ActiveRecord, don’t automatically reach for pluck.
Ask:
Do I want Ruby to materialize these IDs?
Or:
Can PostgreSQL keep the work inside one SQL statement?
Part 5 – NOT IN
Suppose the requirement is:
Find users who have never placed an order.
You might write:
SELECT*
FROM users
WHERE id NOTIN(
SELECT user_id
FROM orders
);
Result:
David
With our current schema, this works because:
orders.user_id BIGINT NOTNULL
Therefore, the subquery cannot return NULL.
But NOT IN has a famous SQL trap.
Part 6 – The NOT IN + NULL Trap
Let’s create a small demonstration table.
DROPTABLEIFEXISTS order_users_demo;
CREATETABLE order_users_demo (
user_id BIGINT
);
Insert:
INSERTINTO order_users_demo(user_id)
VALUES
(1),
(2),
(NULL);
Now run:
SELECT*
FROM users
WHERE id NOTIN(
SELECT user_id
FROM order_users_demo
);
You might expect:
Bob
Alice
David
Sara
But you get:
0 rows
Why?
Because SQL uses three-valued logic:
TRUE
FALSE
UNKNOWN
Conceptually:
id NOTIN(1,2,NULL)
behaves like:
id <>1
AND id <>2
AND id <>NULL
But:
id <>NULL
is not TRUE.
It is:
UNKNOWN
And:
TRUE AND TRUE AND UNKNOWN
results in:
UNKNOWN
WHERE only keeps rows where the condition evaluates to TRUE.
This is one of the most important SQL interview traps to remember.
Part 7 – EXISTS
Now let’s solve:
Find users who have at least one order.
Using EXISTS:
SELECT*
FROM users u
WHEREEXISTS(
SELECT1
FROM orders o
WHERE o.user_id = u.id
);
Result:
John
Mary
Bob
Alice
Sara
David is excluded.
How Does EXISTS Work?
Look carefully:
SELECT*
FROM users u
WHEREEXISTS(
SELECT1
FROM orders o
WHERE o.user_id = u.id
);
The inner query references:
u.id
But u was defined in the outer query.
Therefore, this is a:
Correlated Subquery
Conceptually PostgreSQL evaluates:
John
↓
Does an order exist with user_id = John's id?
↓
Yes
↓
Keep John
Then:
Mary
↓
Does an order exist?
↓
Yes
↓
Keep Mary
Then:
David
↓
Does an order exist?
↓
No
↓
Remove David
Important: this is a useful conceptual model, but it does not mean PostgreSQL must literally execute the inner query once per outer row. The optimizer can transform correlated EXISTS queries into efficient semi-join plans.
We’ll inspect that later using:
EXPLAIN ANALYZE
Why SELECT 1?
You commonly see:
EXISTS(
SELECT1
FROM orders
...
)
Why 1?
Because EXISTS doesn’t care what columns are returned.
It only asks:
Does at least one matching row exist?
These are semantically equivalent:
EXISTS(
SELECT1
FROM orders
WHERE ...
)
EXISTS(
SELECT*
FROM orders
WHERE ...
)
EXISTS(
SELECT amount
FROM orders
WHERE ...
)
SELECT 1 communicates intent clearly.
Part 8 – NOT EXISTS
Requirement:
Find users who have never placed an order.
SELECT*
FROM users u
WHERENOTEXISTS(
SELECT1
FROM orders o
WHERE o.user_id = u.id
);
Result:
David
This is called an anti-join pattern.
Conceptually:
For each user:
Does a matching order exist?
YES → reject
NO → keep
Compare With LEFT JOIN
We learned this yesterday:
SELECT u.*
FROM users u
LEFTJOIN orders o
ON o.user_id = u.id
WHERE o.id ISNULL;
And today:
SELECT u.*
FROM users u
WHERENOTEXISTS(
SELECT1
FROM orders o
WHERE o.user_id = u.id
);
Both express:
Find users without orders.
The PostgreSQL optimizer may produce similar execution strategies.
However, NOT EXISTS often expresses the business requirement more directly:
Keep the user if no matching order exists.
Rails Equivalent: where.missing
Rails provides a very readable API:
User.where.missing(:orders)
Conceptually, Rails generates a LEFT OUTER JOIN with an IS NULL condition.
Another option is to build a NOT EXISTS query using Arel, but for standard Rails association queries, where.missing is usually clearer.
Rails Equivalent: where.associated
Find users who have orders:
User.where.associated(:orders)
Depending on Rails version and query construction, this uses an association join and filters out missing related rows.
You may also write:
User.joins(:orders).distinct
Remember why distinct can be needed:
John has 3 orders
JOIN result:
John
John
John
EXISTS does not duplicate John because it tests existence rather than returning matching order rows.
This is a major conceptual difference.
Part 9 – IN vs EXISTS
Let’s compare them.
IN
SELECT*
FROM users
WHERE id IN(
SELECT user_id
FROM orders
);
Conceptually:
Is this user’s ID present in the set of order user IDs?
EXISTS
SELECT*
FROM users u
WHEREEXISTS(
SELECT1
FROM orders o
WHERE o.user_id = u.id
);
Conceptually:
Does at least one matching order exist for this user?
Which Is Faster?
A common junior-level answer is:
EXISTS is always faster.
That’s incorrect.
Modern PostgreSQL can rewrite IN and EXISTS into similar plans, such as semi-joins.
Performance depends on:
table sizes
indexes
statistics
data distribution
selectivity
query structure
PostgreSQL planner decisions
The correct senior-level approach is:
Choose the query that expresses the requirement clearly, then inspect the execution plan when performance matters.
Later we’ll compare:
EXPLAIN ANALYZE
SELECT ...
WHERE id IN(...);
with:
EXPLAIN ANALYZE
SELECT ...
WHEREEXISTS(...);
Part 10 – Correlated Subqueries
We’ve already seen one:
SELECT*
FROM users u
WHEREEXISTS(
SELECT1
FROM orders o
WHERE o.user_id = u.id
);
The inner query depends on the outer query.
Let’s look at another important example.
Requirement:
Find orders whose amount is greater than the average order amount for that particular user.
This is different from:
Find orders above the global average.
Global average:
SELECT*
FROM orders
WHERE amount >(
SELECT AVG(amount)
FROM orders
);
Per-user average:
SELECT
o.id,
o.user_id,
o.amount
FROM orders o
WHERE o.amount >(
SELECT AVG(o2.amount)
FROM orders o2
WHERE o2.user_id = o.user_id
);
Notice:
o2.user_id = o.user_id
The inner query references the outer row.
Let’s manually reason through John.
John’s orders:
100
250
75
Average:
141.67
Which John’s orders are above John’s average?
250
Mary:
500
300
Average:
400
Above average:
500
Alice:
800
150
Average:
475
Above average:
800
Sara:
1000
1200
Average:
1100
Above average:
1200
Bob has only one order:
200
Average:
200
Condition:
200 > 200
False.
So Bob has no matching result.
Rails Equivalent
A direct SQL fragment is often the clearest ActiveRecord solution:
Order.where(<<~SQL)
orders.amount> (
SELECTAVG(o2.amount)
FROMorderso2
WHEREo2.user_id=orders.user_id
)
SQL
Senior Rails Insight:
Not every query should be forced into a chain of ActiveRecord methods.
For complex database logic, readable SQL inside ActiveRecord can be better than complicated Arel code.
The important things are:
parameterize external input
keep the SQL understandable
test it
inspect its execution plan when needed
Part 11 – Subqueries in FROM
A subquery can also act like a temporary result set.
Requirement:
Calculate each user’s total spending, then return only users whose total spending exceeds 500.
First calculate totals:
SELECT
user_id,
SUM(amount)AS total_spent
FROM orders
GROUPBY user_id;
Now use that result as a derived table:
SELECT*
FROM(
SELECT
user_id,
SUM(amount)AS total_spent
FROM orders
GROUPBY user_id
) user_totals
WHERE total_spent >500;
Important:
PostgreSQL requires an alias for the derived table:
user_totals
Conceptually:
orders
↓
GROUP BY user_id
↓
temporary result set
user_id | total_spent
↓
filter temporary result
↓
total_spent > 500
Of course, for this particular query, HAVING is simpler:
SELECT
user_id,
SUM(amount)AS total_spent
FROM orders
GROUPBY user_id
HAVING SUM(amount)>500;
So why learn subqueries in FROM?
Because derived tables become useful when:
aggregating in multiple stages
joining against aggregated results
ranking data
reporting queries
building complex analytical queries
Part 12 – ANY
ANY compares a value against values returned by a subquery.
Example:
SELECT*
FROM orders
WHERE amount >ANY(
SELECT amount
FROM orders
WHERE user_id =1
);
John’s order amounts:
100
250
75
The condition is:
amount > ANY (100, 250, 75)
This means:
The amount must be greater than at least one value.
Effectively:
amount > 75
because being greater than the smallest value is enough to satisfy the condition.
Therefore:
>ANY
can often be thought of as:
Greater than at least one value
Part 13 – ALL
Now:
SELECT*
FROM orders
WHERE amount >ALL(
SELECT amount
FROM orders
WHERE user_id =1
);
John’s amounts:
100
250
75
Condition:
amount > ALL (100, 250, 75)
The amount must be greater than every value.
Effectively:
amount > 250
Therefore:
>ALL
means:
Greater than every value returned by the subquery.
Important ANY / ALL Mental Model
Given:
10
20
30
Then:
value>ANY(10,20,30)
means:
value > at least one of them
Equivalent threshold:
value > 10
But:
value>ALL(10,20,30)
means:
value > every one of them
Equivalent threshold:
value > 30
Be careful: this shortcut depends on the comparison operator. For example, < ANY and < ALL have different effective thresholds.
Part 14 – ANY with ActiveRecord Arrays
You may occasionally see PostgreSQL queries like:
SELECT*
FROM users
WHERE id =ANY(ARRAY[1,2,3]);
However, normal Rails code would usually use:
User.where(id: [1, 2, 3])
which generates an IN condition.
Don’t use PostgreSQL-specific syntax unless it provides a real advantage.
Part 15 – JOIN vs IN vs EXISTS
Requirement:
Find users who have completed orders.
JOIN
SELECTDISTINCT u.*
FROM users u
JOIN orders o
ON o.user_id = u.id
WHERE o.status ='completed';
Potential issue:
The join produces one row per matching order.
Therefore, duplicates may occur.
We use:
DISTINCT
IN
SELECT*
FROM users
WHERE id IN(
SELECT user_id
FROM orders
WHERE status ='completed'
);
No duplicate users in the outer result.
EXISTS
SELECT*
FROM users u
WHEREEXISTS(
SELECT1
FROM orders o
WHERE o.user_id = u.id
AND o.status ='completed'
);
Also no duplicate users.
How Should You Choose?
Use JOIN when:
You need columns from both tables.
You need to aggregate related rows.
You intentionally need matching rows.
Use EXISTS when:
You're asking whether a related row exists.
You don't need columns from the related table.
You want existence semantics without row multiplication.
Use IN when:
You're checking membership in a set of values.
The query reads naturally as "value belongs to this result set."
Do not choose solely based on old rules such as:
EXISTS is always faster than IN.
PostgreSQL’s optimizer is smarter than that.
Part 16 – Practical PostgreSQL Exercises
Let’s practice one query at a time.
Exercise 1
Find all orders above the global average order amount.
SELECT*
FROM orders
WHERE amount >(
SELECT AVG(amount)
FROM orders
);
Rails:
Order.where(
"amount > (?)",
Order.select("AVG(amount)")
)
Exercise 2
Find users who have orders.
SQL using IN:
SELECT*
FROM users
WHERE id IN(
SELECT user_id
FROM orders
);
Rails:
User.where(id:Order.select(:user_id))
Exercise 3
Find users who have orders using EXISTS.
SELECT*
FROM users u
WHEREEXISTS(
SELECT1
FROM orders o
WHERE o.user_id = u.id
);
Rails association-oriented alternative:
User.where.associated(:orders)
or:
User.joins(:orders).distinct
Exercise 4
Find users without orders.
SELECT*
FROM users u
WHERENOTEXISTS(
SELECT1
FROM orders o
WHERE o.user_id = u.id
);
Rails:
User.where.missing(:orders)
Exercise 5
Find users who have at least one completed order greater than 400.
SELECT*
FROM users u
WHEREEXISTS(
SELECT1
FROM orders o
WHERE o.user_id = u.id
AND o.status ='completed'
AND o.amount >400
);
Try writing the ActiveRecord version yourself before looking below.
One option:
User
.joins(:orders)
.where(orders: { status:"completed" })
.where("orders.amount > ?", 400)
.distinct
Exercise 6
Find orders above the average order amount for that order’s user.
SELECT*
FROM orders o
WHERE o.amount >(
SELECT AVG(o2.amount)
FROM orders o2
WHERE o2.user_id = o.user_id
);
This is today’s most important correlated subquery exercise.
Run it and manually verify every returned row.
Part 17 – Common Mistakes
Mistake 1: Using = with a Multi-Row Subquery
Wrong:
WHERE id =(
SELECT user_id
FROM orders
)
If multiple rows are returned, PostgreSQL raises an error.
Use:
IN
or:
EXISTS
depending on the requirement.
Mistake 2: Using NOT IN Without Considering NULL
Potentially dangerous:
WHERE id NOTIN(
SELECT user_id
FROM some_table
)
If the subquery can return NULL, the result may surprise you.
Safer existence-oriented query:
WHERENOTEXISTS(...)
Mistake 3: Using pluck When You Want a SQL Subquery
Potentially inefficient:
User.where(id:Order.pluck(:user_id))
Better:
User.where(id:Order.select(:user_id))
when you want PostgreSQL to handle the operation as a subquery.
Mistake 4: Using JOIN + DISTINCT for Every Existence Check
User.joins(:orders).distinct
works.
But if your requirement is simply:
Does a matching row exist?
EXISTS more directly expresses the requirement.
Mistake 5: Assuming a Correlated Subquery Always Executes Once Per Row
Conceptually, we reason about it that way.
Physically, PostgreSQL may optimize it into:
Semi Join
Anti Join
Hash Join
Nested Loop
other execution strategies
Always distinguish:
SQL semantics
from:
physical execution plan
This distinction is very important for senior-level interviews.
Part 18 – Senior Interview Questions
Try answering these without looking back.
Q1
What is the difference between a normal subquery and a correlated subquery?
Q2
What happens if a scalar subquery returns multiple rows?
Q3
What’s the difference between:
Order.select(:user_id)
and:
Order.pluck(:user_id)
when used to build another query?
Q4
Why can NOT IN return zero rows when the subquery contains NULL?
Q5
What’s the difference between:
JOIN
and:
EXISTS
when one user has many matching orders?
Q6
Is EXISTS always faster than IN in PostgreSQL?
Q7
What is a semi-join?
Q8
What is an anti-join?
Q9
When would you use a subquery in the FROM clause instead of HAVING?
Q10
What is the difference between:
>ANY
and:
>ALL
Part 19 – Today’s Interview Challenge
Do not run this immediately.
First predict the result.
SELECT
u.id,
u.name
FROM users u
WHEREEXISTS(
SELECT1
FROM orders o
WHERE o.user_id = u.id
AND o.amount >(
SELECT AVG(o2.amount)
FROM orders o2
WHERE o2.user_id = u.id
)
);
Questions:
What does the innermost query calculate?
Is the innermost query correlated?
What does the middle EXISTS query check?
Which users will be returned?
Will a user with exactly one order be returned?
Why does this query not need DISTINCT?
Try to manually execute it for:
John
Mary
Bob
Alice
David
Sara
If you can reason through this query confidently, your understanding of SQL has moved beyond basic CRUD querying.
Homework
Use the users and orders tables.
Write both SQL and ActiveRecord for each exercise.
Find users who have at least one completed order.
Find users who have no completed orders.
Find orders greater than the global average order amount.
Find orders greater than the average order amount for their respective user.
Find users whose total order amount is greater than the average total spending across all users who have orders.
Find users who have an order greater than every order placed by John. Use ALL.
Find users who have an order greater than at least one order placed by Sara. Use ANY.
Rewrite “users without orders” using:
LEFT JOIN
NOT EXISTS
NOT IN
Then explain the NULL behavior of each approach.
Write a query using a subquery in FROM to calculate user totals, then join the derived table with users to display:
user name
total spent
Use EXPLAIN ANALYZE to compare:
IN
versus:
EXISTS
for finding users with orders.
Don’t worry if you can’t interpret the complete execution plan yet. Save the output – we’ll learn how to read it systematically.
Day 6 Preview
On Day 6, we’ll cover Indexes and EXPLAIN ANALYZE.
This is one of the most important transitions in the course because we’ll move from:
“Can I write the correct query?”
to:
“Can I explain why this query is fast or slow?”
We’ll cover:
How PostgreSQL stores tables and indexes conceptually
B-tree indexes
Single-column indexes
Composite indexes
Index selectivity
Sequential Scan
Index Scan
Bitmap Index Scan
EXPLAIN
EXPLAIN ANALYZE
Why PostgreSQL sometimes ignores an index
Indexes for foreign keys
Rails migrations for indexes
Query optimization interview questions
For a senior Rails interview, Day 6 is one of the highest-value lessons in the entire course.
If JOINs tell you how records are related, then GROUP BY tells you how to summarize data.
This is one of the highest-frequency SQL topics in senior Ruby on Rails interviews because reporting, dashboards, analytics, and business metrics all rely on it.
As a Rails developer, we’ve probably written things like:
Order.count
or
Order.sum(:amount)
or
User.group(:city).count
Today we’ll learn what PostgreSQL is actually doing under the hood.
Today’s Goals
By the end of today, you’ll understand:
Aggregate Functions
COUNT
SUM
AVG
MIN
MAX
GROUP BY
HAVING
GROUP BY with JOINs
ActiveRecord equivalents
Common interview questions
Senior-level insights
Step 1: Create Our Practice Database
We’ll use two tables.
DROPTABLEIFEXISTS orders;
DROPTABLEIFEXISTS users;
CREATETABLE users (
id BIGSERIAL PRIMARYKEY,
name VARCHAR(100),
city VARCHAR(100)
);
CREATETABLE orders (
id BIGSERIAL PRIMARYKEY,
user_id BIGINT NOTNULL,
amount NUMERIC(10,2),
status VARCHAR(20),
created_at TIMESTAMPDEFAULT NOW(),
CONSTRAINT fk_orders_user
FOREIGNKEY(user_id)
REFERENCES users(id)
);
Insert Users
INSERTINTO users(name, city)
VALUES
('John','New York'),
('Mary','Chicago'),
('Bob','Chicago'),
('Alice','Boston');
Insert Orders
INSERTINTO orders(user_id, amount, status)
VALUES
(1,100,'completed'),
(1,250,'completed'),
(1,75,'pending'),
(2,500,'completed'),
(2,300,'completed'),
(3,200,'pending'),
(4,800,'completed'),
(4,150,'cancelled');
Let’s first see the data.
SELECT*FROM users;
id
name
city
1
John
New York
2
Mary
Chicago
3
Bob
Chicago
4
Alice
Boston
SELECT*FROM orders;
user_id
amount
status
1
100
completed
1
250
completed
1
75
pending
2
500
completed
2
300
completed
3
200
pending
4
800
completed
4
150
cancelled
Part 1 – Aggregate Functions
Aggregate functions operate on multiple rows and return a single value.
Examples:
Function
Purpose
COUNT
Count rows
SUM
Add values
AVG
Average
MIN
Smallest value
MAX
Largest value
Think of them as summary functions.
COUNT()
How many orders exist?
SELECTCOUNT(*)
FROM orders;
Result
8
COUNT(column)
SELECTCOUNT(status)
FROM orders;
Counts only non-NULL values.
If one status were NULL:
COUNT(*) = 8
COUNT(status) = 7
This difference is asked surprisingly often in interviews.
Rails Equivalent
Order.count
COUNT(DISTINCT)
How many cities do users belong to?
SELECTCOUNT(DISTINCT city)
FROM users;
Result
3
Cities:
Chicago
Boston
New York
Rails:
User.distinct.count(:city)
SUM()
Total revenue:
SELECT SUM(amount)
FROM orders;
Calculation:
100
+250
+75
+500
+300
+200
+800
+150
-------
2375
Rails:
Order.sum(:amount)
AVG()
Average order amount.
SELECT AVG(amount)
FROM orders;
Rails
Order.average(:amount)
MIN()
SELECT MIN(amount)
FROM orders;
Result
75
MAX()
SELECT MAX(amount)
FROM orders;
Result
800
Rails
Order.maximum(:amount)
Part 2 – GROUP BY
This is today’s biggest topic.
Without GROUP BY:
SELECT SUM(amount)
FROM orders;
One answer.
2375
Suppose the business asks:
What’s the total revenue for each customer?
Now we need GROUP BY.
GROUP BY user_id
SELECT
user_id,
SUM(amount)
FROM orders
GROUPBY user_id;
Result
user_id
sum
1
425
2
800
3
200
4
950
Notice:
PostgreSQL divides the rows into groups first.
User 1
100
250
75
↓
425
Then repeats for every user.
Rails Equivalent
Order.group(:user_id).sum(:amount)
Returns:
{
1=>425,
2=>800,
3=>200,
4=>950
}
Visualizing GROUP BY
Imagine sorting all orders into buckets.
Orders
↓
User 1 Bucket
100
250
75
↓
425
User 2 Bucket
500
300
↓
800
This is essentially what GROUP BY does conceptually.
GROUP BY City
SELECT
city,
COUNT(*)
FROM users
GROUPBY city;
Result
city
count
Chicago
2
Boston
1
New York
1
Rails
User.group(:city).count
Common Interview Question
Why doesn’t this work?
SELECT
user_id,
amount
FROM orders
GROUPBY user_id;
PostgreSQL responds:
column “amount” must appear in the GROUP BY clause or be used in an aggregate function
Why?
Because each group contains multiple amount values. PostgreSQL doesn’t know which one you want.
For user_id = 1, there are three amounts:
100
250
75
Which one should it return?
It can’t guess.
Rule to Remember
Every selected column must be:
in GROUP BY, or
inside an aggregate function.
Correct:
SELECT
user_id,
SUM(amount)
FROM orders
GROUPBY user_id;
GROUP BY Multiple Columns
SELECT
user_id,
status,
COUNT(*)
FROM orders
GROUPBY user_id, status;
Result
user_id
status
count
1
completed
2
1
pending
1
2
completed
2
3
pending
1
4
completed
1
4
cancelled
1
Now each unique (user_id, status) combination becomes its own group.
GROUP BY with JOIN
Very common interview question.
Show each user’s total spending.
SELECT
u.name,
SUM(o.amount)AS total_spent
FROM users u
JOIN orders o
ON u.id = o.user_id
GROUPBY u.name;
Result
name
total_spent
John
425
Mary
800
Bob
200
Alice
950
Rails
User
.joins(:orders)
.group(:name)
.sum("orders.amount")
What if a User Has No Orders?
Let’s add one.
INSERTINTO users(name, city)
VALUES('David','Mumbai');
Now run:
SELECT
u.name,
SUM(o.amount)
FROM users u
LEFTJOIN orders o
ON u.id = o.user_id
GROUPBY u.name;
Result
name
sum
John
425
Mary
800
Bob
200
Alice
950
David
NULL
Notice:
LEFT JOIN keeps David, even though he has no orders.
COALESCE()
Business users usually don’t want NULL.
They want:
0
Use:
SELECT
u.name,
COALESCE(SUM(o.amount),0)AS total_spent
FROM users u
LEFTJOIN orders o
ON u.id = o.user_id
GROUPBY u.name;
Result
name
total_spent
David
0
We’ll study COALESCE in more detail later, but it’s useful to know this pattern now.
HAVING
Many developers confuse WHERE and HAVING.
This is a favorite interview topic.
Suppose we want:
Show only customers who spent more than 500.
Wrong:
SELECT
user_id,
SUM(amount)
FROM orders
WHERE SUM(amount)>500
GROUPBY user_id;
This fails because WHERE filters individual rows before grouping. At that stage, SUM(amount) hasn’t been calculated yet.
Correct:
SELECT
user_id,
SUM(amount)
FROM orders
GROUPBY user_id
HAVING SUM(amount)>500;
Result
user_id
sum
2
800
4
950
WHERE vs HAVING
Think of the execution order:
FROM
↓
WHERE
↓
GROUP BY
↓
Aggregate Functions
↓
HAVING
↓
SELECT
↓
ORDER BY
WHERE filters rows before grouping.
HAVING filters groups after aggregation.
Rails Equivalent
Order
.group(:user_id)
.having("SUM(amount) > ?", 500)
.sum(:amount)
Real Interview Questions
Top Spending Customer
SELECT
user_id,
SUM(amount)AS total
FROM orders
GROUPBY user_id
ORDERBY total DESC
LIMIT1;
Number of Orders Per Status
SELECT
status,
COUNT(*)
FROM orders
GROUPBY status;
Average Order Value Per User
SELECT
user_id,
AVG(amount)
FROM orders
GROUPBY user_id;
Highest Single Order Per User
SELECT
user_id,
MAX(amount)
FROM orders
GROUPBY user_id;
Common Mistakes
Mistake 1
Selecting non-grouped columns.
SELECT user_id, amount
FROM orders
GROUPBY user_id;
Mistake 2
Using WHERE instead of HAVING for aggregate conditions.
Mistake 3
Using an INNER JOIN when the business wants users with zero orders.
Use a LEFT JOIN plus COALESCE.
Senior-Level Insights
GROUP BY changes the shape of your data. You no longer have one row per order—you have one row per group.
Always think about the business question first. Ask yourself:
“What am I grouping by?”
“What summary do I want for each group?”
JOIN + GROUP BY is the foundation of almost every reporting query you’ll write.
Practical Exercises
Count the total number of users.
Calculate the total revenue from completed orders only.
Find the average order amount for each user.
Count how many orders each status has.
Find users who have placed more than two orders.
Show each city and the total number of users in that city.
Add another user with no orders and show them with a total spend of 0.
Find the highest order amount for every user.
Homework
Create two new tables:
departments
id
name
employees
id
department_id
salary
Insert data for at least:
3 departments
10 employees
Then write SQL to answer:
Number of employees per department.
Average salary per department.
Highest salary per department.
Departments with more than 3 employees.
Departments with no employees (hint: LEFT JOIN + GROUP BY).
Also write the Rails/ActiveRecord equivalent for each query.
Interview Challenge (Don’t Run It Yet)
Without executing the query, tell me what you think this returns:
SELECT
status,
COUNT(*)AS order_count,
SUM(amount)AS total_amount,
AVG(amount)AS average_amount
FROM orders
WHERE amount >=100
GROUPBY status
HAVINGCOUNT(*)>=2
ORDERBY total_amount DESC;
In senior interviews, you’re often asked to reason about a query rather than just write it. Being able to mentally execute SQL like this is a valuable skill.
Day 5 Preview
Tomorrow we’ll move to another core interview topic:
Filtering, Subqueries & EXISTS
We’ll cover:
Scalar subqueries
Correlated subqueries
IN vs EXISTS
NOT EXISTS
ANY and ALL
Common Rails equivalents
Performance considerations
Real interview questions and optimization tips
These concepts are widely used in production applications and are common in senior backend interviews.