Since the beginning of the Internet of Things (IoT) concept, there has always been a deep belief that we are expecting a new paradigm in computer science and engineering. There are many new interesting ideas that will lead us toward new challenges, like the Internet of Everything (IoE) and the Web of Things (WoT), and most of us are expecting a technological revolution; however, before we take this huge step into a new reality, there is a lot of urgent work that should be done.
We have relied on the World Wide Web (WWW) since the 90s, and now there is no doubt that this concept was the big technological paradigm shift. We know a lot about how this idea works and what one can expect and should assume on a technological and social level when some new solutions with WWW are done; however, the concept of IoT integrated with the web, leading to WoT, is still an open question. From an engineering point of view, this seems to be a natural and understandable step toward new possibilities; however, before we start this transformation, we need tools to benchmark and score performance proposed systems before any real deployments of WoT infrastructure can be done. WoTbench (WoT benchmarking) is a framework that provides, in an integrated way, many features also supported by other simulation and testing environments. The authors present its components:
- Test harness: the main shell script process that creates the environment, initiates the tests, collects the results, and cleans the environment;
- Synthetic trace generator: a component that creates workloads for device resources with specific patterns of time distributions;
- Resource monitor: runs in online mode and collects different system usage metrics; and
- Reporting module: shows a summary of test-obtained results and visualizes different workload characteristics and performance metrics.
The target audience is readers interested in simulations of WoT systems. Unfortunately, the paper fails to provide any results for WoTbench, thus it’s hard to deeply evaluate all of its features.