Is Reinforcement Learning and Optimal Control better than Reinforcement Learning: Theory and Algorithms?

Reinforcement Learning and Optimal Control ranks higher in our list of reinforcement learning and edge ML books (#2 against #7, score 90.5 against 86.0). Reinforcement Learning and Optimal Control is best for: graduate study of RL and dynamic programming. Reinforcement Learning: Theory and Algorithms is best for: theory-first study of reinforcement learning.

Which is cheaper, Reinforcement Learning and Optimal Control or Reinforcement Learning: Theory and Algorithms?

Reinforcement Learning and Optimal Control: Free PDF for instructional use; 2nd edition from 2025. Reinforcement Learning: Theory and Algorithms: Free PDF, updated frequently; no print edition listed.

Comparison · Reinforcement learning and edge ML books

Reinforcement Learning and Optimal Control vs Reinforcement Learning: Theory and Algorithms: which is better in 2026?

Reinforcement Learning and Optimal Control90.5#2 in best reinforcement learning and edge ML booksReinforcement Learning: Theory and Algorithms86.0#7 in best reinforcement learning and edge ML books

Reinforcement Learning and Optimal Control ranks higher in our list of reinforcement learning and edge ML books (#2 against #7, score 90.5 against 86.0).

How we rank Share

90.5
Editorial score
86.0
1
Formats
1
Yes
Free to use
Yes

Which should you choose?

Choose Reinforcement Learning and Optimal Control if you want

Graduate study of RL and dynamic programming.

A rigorous dynamic programming view of reinforcement learning, with a free 2025 PDF and lectures on the author's site. It is heavier on mathematics than Sutton and Barto, so it suits graduate study.

Choose Reinforcement Learning: Theory and Algorithms if you want

Theory-first study of reinforcement learning.

A free, frequently updated theory text that treats sample-efficient reinforcement learning carefully. It has little code and is still in progress, so it ranks below the more finished textbooks.

Side by side

	Reinforcement Learning and Optimal Control	Reinforcement Learning: Theory and Algorithms
Score	90.5	86.0
Rank in list	#2 of 10	#7 of 10
Price	FreeFree PDF for instructional use; 2nd edition from 2025	FreeFree PDF, updated frequently; no print edition listed
Free to use	Yes	Yes
Formats	PDF	PDF
Author	Dimitri P. Bertsekas	Alekh Agarwal, Kianté Brantley, Nan Jiang, Sham M. Kakade and Wen Sun
Level	Advanced	Advanced
Free to read online	Yes	Yes
Latest edition	2nd edition, 2025	Draft, updated in 2026
Math required	Heavy: optimization and probability	Heavy: probability and proofs
Best for	Graduate study of RL and dynamic programming	Theory-first study of reinforcement learning
Strengths	Free PDF of the 2025 second edition Ties reinforcement learning to dynamic programming Video lectures and slides on the author's site	Free PDF with frequent updates Rigorous, theorem-based treatment Written by reinforcement learning researchers
Limits	Graduate-level mathematics throughout The free copy is offered for instructional use	Still in progress, not a finished edition Little code or practical advice
Links	Visit site	Visit site

Questions about Reinforcement Learning and Optimal Control vs Reinforcement Learning: Theory and Algorithms

Is Reinforcement Learning and Optimal Control better than Reinforcement Learning: Theory and Algorithms?: Reinforcement Learning and Optimal Control ranks higher in our list of reinforcement learning and edge ML books (#2 against #7, score 90.5 against 86.0). Reinforcement Learning and Optimal Control is best for: graduate study of RL and dynamic programming. Reinforcement Learning: Theory and Algorithms is best for: theory-first study of reinforcement learning.
Which is cheaper, Reinforcement Learning and Optimal Control or Reinforcement Learning: Theory and Algorithms?: Reinforcement Learning and Optimal Control: Free PDF for instructional use; 2nd edition from 2025. Reinforcement Learning: Theory and Algorithms: Free PDF, updated frequently; no print edition listed.