HUBLO Duplicate Content Auditor
HUBLO Duplicate Content Auditor
Description
Sites that publish for years end up with articles competing against each other: the 2019 guide and the 2023 rewrite, the category page and the pillar post, three near-identical product round-ups. HUBLO Duplicate Content Auditor finds them and tells you what to do about it.
It is deliberately a planning tool, not an editing tool. It reads your content, reports what overlaps, and produces a plan. Every destructive step stays in your hands.
What it does
- Near-duplicate detection across the whole site. Each post is reduced to a MinHash fingerprint and grouped with Locality Sensitive Hashing, so a site with thousands of posts does not need to compare every pair against every other pair.
- Similarity scoring and banding — near identical (90%+), strong overlap (75–90%), and partial overlap.
- Canonical version suggestion, with the reasoning shown. Content length, publication date, comment activity, inbound internal links, featured image, and slug quality are scored side by side so you can see why one version was suggested and disagree with it.
- Section-by-section comparison. The single most important question before merging is “what would I lose?”. The audit lists exactly which sections exist only in the version you are about to retire.
- Merge preview showing shared sections, unique sections, and word counts.
- Redirect plan preview with the source path, target path and status code.
- CSV export of both the duplicate report and the redirect plan, in a shape other redirect plugins can import.
Works with Japanese, Chinese and Korean content
Similarity detection that assumes spaces between words fails badly on unspaced scripts. This plugin detects the script and switches between word shingles and character shingles accordingly, so CJK content is compared properly rather than producing noise.
Languages
Every user-facing string on both the PHP and JavaScript sides goes through WordPress’s translation functions, so this plugin can be translated into any locale without a code change. Translations are hosted on translate.wordpress.org and installed as language packs; none are bundled in the download.
Privacy and external services
No external server is contacted. No analytics, no telemetry, no account, no API key. Fingerprinting and comparison happen entirely inside your own WordPress installation.
Safety
Read-only with respect to your content. It never merges, deletes, rewrites, trashes or redirects anything. It creates three tables of its own for scan data and removes them on uninstall.
WP Content Merge & Redirect Manager (Pro)
A separate, independently distributed Pro plugin performs the merge inside WordPress, creates the 301 redirects, rewrites internal links pointing at the retired post, and provides revision backup with one-click rollback and conflict detection.
Pro is not bundled inside this plugin. This download contains only Free code, nothing expires, and no feature stops working. If you prefer, you can act on the exported plan by hand or with any redirect plugin you already use.
External services
This plugin does not contact any external service on its own. Nothing is sent
from your site in the background.
The “Upgrade to Pro” button is an ordinary link. If you click it, your
browser opens https://hublo-wp.com/buy/duplicate-content-auditor, operated by
HUBLO. While the Pro edition is on sale that page hands you on to Stripe’s
hosted checkout, where Stripe takes the payment; this plugin never sees or
handles card details. The link carries no query string: your site address,
your email address, your installation identifier and your scan results are
never appended to it and never leave your site. Nothing happens until you
click.
The Pro edition is a separate plugin distributed outside WordPress.org. This
plugin never downloads it, never installs it and never updates it. It fetches
no executable code from anywhere. After purchase you download the Pro ZIP in
your browser and install it yourself via Plugins Add New Upload Plugin.
- Purchase service: https://hublo-wp.com/buy/duplicate-content-auditor — operated by HUBLO
- Payment processing: Stripe — https://stripe.com/privacy
- Terms: https://hublo-wp.com/terms/
- Privacy: https://hublo-wp.com/hublo-privacy-policy/
- Refunds: https://hublo-wp.com/refund-policy/
Installation
- Upload the plugin to
/wp-content/plugins/, or install it from the Plugins screen. - Activate it.
- Go to Duplicate Audit in the admin menu.
- Set your post types and similarity threshold, then press Scan for duplicates.
Screenshots
Overview: how many posts overlap, and how badly.
Every overlapping pair, ranked by similarity.
One pair in detail: which version should survive, what each version contains, and the redirect the retired one would need.
Settings: post types, similarity threshold and exclusions.
What the free edition does, and where the Pro edition takes over.
Faq
No. It never writes to your content. The Free edition produces a plan and exports it; applying it is your decision.
60% is a sensible default. Raise it if you see loose matches that are not really duplicates; lower it if you suspect overlap the audit is not catching.
Very short texts share phrasing by coincidence. Set a minimum word count in Settings — 100 words removes most false matches.
Comparing every post with every other post grows quadratically. Instead each post gets a fixed-length fingerprint, and only posts whose fingerprints collide are compared in full.
No, and it does not pretend to be. The scoring table is shown in full precisely so you can override it.
No. Nothing leaves your server.
Reviews
Changelog
1.0.0
- First release.
- MinHash and LSH based near-duplicate detection with CJK-aware shingling.
- Canonical suggestion with visible scoring, section comparison, redirect plan and CSV export.
- Fully internationalised on both the PHP and JavaScript sides; translations are provided through translate.wordpress.org.