Contents

# Performance

How to write performant crawlers with Wayfarer.

## Use Redis >= 6.2.0

Redis 6.2.0 introduced the
[`SMISMEMBER`](https://redis.io/commands/smismember) command which enables
Wayfarer to check whether multiple URLs have been processed in a batch with a
single command. With earlier versions, one command per URL is required.

Wayfarer detects the Redis server version and uses `SMISMEMBER` without user
configuration when supported.

## Use Oj for JSON parsing

Wayfarer uses [Oj](https://github.com/ohler55/oj) for JSON parsing if the gem
has been required at runtime:

```ruby
require "oj"
```

Version data entries

2 entries across 2 versions & 1 rubygems

Version	Path
wayfarer-0.4.1	docs/guides/performance.md
wayfarer-0.4.0	docs/guides/performance.md