Is Reinforcement Learning: An Introduction better than Reinforcement Learning and Optimal Control?

Reinforcement Learning: An Introduction ranks higher in our list of reinforcement learning and edge ML books (#1 against #2, score 94.0 against 90.5). Reinforcement Learning: An Introduction is best for: standard free reinforcement learning textbook. Reinforcement Learning and Optimal Control is best for: graduate study of RL and dynamic programming.

Which is cheaper, Reinforcement Learning: An Introduction or Reinforcement Learning and Optimal Control?

Reinforcement Learning: An Introduction: Full PDF free from the authors; printed copies sold separately. Reinforcement Learning and Optimal Control: Free PDF for instructional use; 2nd edition from 2025.

Comparison · Reinforcement learning and edge ML books

Reinforcement Learning: An Introduction vs Reinforcement Learning and Optimal Control: which is better in 2026?

Reinforcement Learning: An Introduction94.0#1 in best reinforcement learning and edge ML booksReinforcement Learning and Optimal Control90.5#2 in best reinforcement learning and edge ML books

Reinforcement Learning: An Introduction ranks higher in our list of reinforcement learning and edge ML books (#1 against #2, score 94.0 against 90.5).

How we rank Share

94.0
Editorial score
90.5
2
Formats
1
Yes
Free to use
Yes

Which should you choose?

Choose Reinforcement Learning: An Introduction if you want

Standard free reinforcement learning textbook.

The standard free text for reinforcement learning, with the full PDF from the authors and exercises throughout. It focuses on core ideas rather than the newest deep reinforcement learning systems.

Choose Reinforcement Learning and Optimal Control if you want

Graduate study of RL and dynamic programming.

A rigorous dynamic programming view of reinforcement learning, with a free 2025 PDF and lectures on the author's site. It is heavier on mathematics than Sutton and Barto, so it suits graduate study.

Side by side

	Reinforcement Learning: An Introduction	Reinforcement Learning and Optimal Control
Score	94.0	90.5
Rank in list	#1 of 10	#2 of 10
Price	FreeFull PDF free from the authors; printed copies sold separately	FreeFree PDF for instructional use; 2nd edition from 2025
Free to use	Yes	Yes
Formats	PDF, Print	PDF
Author	Richard S. Sutton and Andrew G. Barto	Dimitri P. Bertsekas
Level	Intermediate	Advanced
Free to read online	Yes	Yes
Latest edition	2nd edition, 2018	2nd edition, 2025
Math required	Light to moderate: probability	Heavy: optimization and probability
Best for	Standard free reinforcement learning textbook	Graduate study of RL and dynamic programming
Strengths	Full PDF free from the authors Exercises, errata and slides online Clear build-up from basic ideas	Free PDF of the 2025 second edition Ties reinforcement learning to dynamic programming Video lectures and slides on the author's site
Limits	Older than many recent deep reinforcement learning methods Long, with a strong focus on theory	Graduate-level mathematics throughout The free copy is offered for instructional use
Links	Visit site	Visit site

Questions about Reinforcement Learning: An Introduction vs Reinforcement Learning and Optimal Control

Is Reinforcement Learning: An Introduction better than Reinforcement Learning and Optimal Control?: Reinforcement Learning: An Introduction ranks higher in our list of reinforcement learning and edge ML books (#1 against #2, score 94.0 against 90.5). Reinforcement Learning: An Introduction is best for: standard free reinforcement learning textbook. Reinforcement Learning and Optimal Control is best for: graduate study of RL and dynamic programming.
Which is cheaper, Reinforcement Learning: An Introduction or Reinforcement Learning and Optimal Control?: Reinforcement Learning: An Introduction: Full PDF free from the authors; printed copies sold separately. Reinforcement Learning and Optimal Control: Free PDF for instructional use; 2nd edition from 2025.