This option enables extra checking for duplicate documents. Documents
with the same content are only be stored once, even if their URLs are
different. This is accomplished by hashing the textual content of the page
and not storing any page with a hash code that is already in the database.
