Computing Reviews

Reinforcement learning :with OpenAI, TensorFlow and Keras using Python
Nandy A., Biswas M., Apress,New York, NY,2018. 167 pp.Type:Book
Date Reviewed: 10/11/18

The success of reinforcement learning (RL) in everything from AlphaGo to intelligent decision making for services in everyday life has made RL a hot topic. The concept has been around since the birth of artificial intelligence (AI) via Turing’s ideas, especially in Marvin Minsky’s vision in The society of mind [1].

Recent advances in deep learning and the drive toward self-driving cars have instigated a number of new studies into various reinforcement algorithms and platforms to test them. Reinforcement learning with OpenAI, TensorFlow, and Keras using Python aims to showcase these applications.

The book has few details on different RL approaches, but offers more on the basic architecture of agents, reward functions and interactions with the environment, and programming exercises.

The book gives a review of installing and setting up various RL libraries and environments such as TensorFlow, Jupyter, and chain RL. Very little is said about big research topics such as swarm learning, dynamic programming, and combinatorial game theory. I think the authors just want to present to readers the possibility of various techniques, but mostly concentrate on implementing some basic examples of games and RL. OpenAI Gym is mentioned as a go-to application for building these systems, but many more examples can also be found on the OpenAI website (https://gym.openai.com/). This book is a good starting point for people trying RL algorithms for the first time, but readers will eventually need more theoretical concepts to actually test and measure the success of their RL algorithms.

There are too many screen shots and too much programming code, with a very limited discussion of theory. It might be a useful tool for PhD students trying to code, but if students want to understand theory and reasoning in RL algorithms, they might need another textbook.

More reviews about this item: Amazon


1)

Minsky, M. The society of mind. Simon & Schuster, New York, NY, 1986.

Reviewer:  Mariam Kiran Review #: CR146271 (1812-0615)

Reproduction in whole or in part without permission is prohibited.   Copyright 2024 ComputingReviews.com™
Terms of Use
| Privacy Policy