pSEO Tech

URL inventory duplicate checker

Paste one absolute HTTP or HTTPS URL per line. The tool identifies exact normalized duplicates and shows hostname counts. It runs locally and does not fetch the URLs.

The sample contains three valid URLs and two unique normalized URLs. The fragment-only difference is a duplicate.

Illustrative starting values. Inputs stay in this tab. Download saves a plain-text record on your device; it includes any URLs you entered.

Source: https://pseo.tech/tools/url-inventory/ · Save the assumptions with this result.

Before you enter your URLs

  1. Paste absolute HTTP or HTTPS URLs, one per line.
  2. Keep private tokens and customer-specific links out of an inventory you plan to share.
  3. Review duplicate groups before choosing redirects or canonical URLs; this tool does not inspect page content.

A worked comparison

https://example.com/guide/#top and https://example.com/guide/ normalize to one URL because fragments are removed. https://example.com/Guide/ remains distinct because path case is preserved. A query such as ?page=2 is also retained. This prevents an inventory check from silently merging potentially different resources.

Keep these assumptions with your result

  • Inventory source and date
  • Valid absolute URLs
  • Duplicate groups
  • Case and query differences
  • Separate crawl status
  • Human decision and reason for any redirect

Common questions

Does it check whether a URL is live or indexed?

No. No URLs are fetched. It only parses the text you provide. Use a separate crawl or Search Console to investigate HTTP status and indexing.

Why keep query parameters and trailing slashes?

Their meaning depends on the server and application. Removing them without inspecting behavior could merge different pages. Normalization is deliberately limited.

How the tool works

Normalization removes fragments and default ports through the browser URL parser. It retains path case, query parameters and trailing slashes because those can identify different resources. The result is an inventory check, not a canonicalization verdict.

What the result does not tell you

Two different URLs can contain identical content, while two similar-looking URLs can be distinct. This tool does not crawl, inspect robots directives, check status codes, or determine which URL Google selected as canonical.

Use the estimate responsibly

Replace the example values with records that cover the same period and scope. Save the input assumptions with your result so that another person can reproduce it. Change one assumption at a time to see why the result moves. Do not treat more decimal places as evidence that an estimate is more certain.

Keep working through the question