betteridge.com
robots.txt

Robots Exclusion Standard data for betteridge.com

Resource Scan

Scan Details

Site Domain betteridge.com
Base Domain betteridge.com
Scan Status Ok
Last Scan2024-11-09T10:43:50+00:00
Next Scan 2024-12-09T10:43:50+00:00

Last Scan

Scanned2024-11-09T10:43:50+00:00
URL https://betteridge.com/robots.txt
Redirect https://www.betteridge.com/robots.txt
Redirect Domain www.betteridge.com
Redirect Base betteridge.com
Domain IPs 23.215.7.26, 23.215.7.27, 2600:1413:b000:1b::17d7:71a, 2600:1413:b000:1b::17d7:71b
Redirect IPs 23.215.7.26, 23.215.7.27, 2600:1413:b000:1b::17d7:71a, 2600:1413:b000:1b::17d7:71b
Response IP 96.17.180.43
Found Yes
Hash 7cdd201b834847d27cfc982dd976226ccf33b163a29d52f1e2142675f35ba38b
SimHash 6e311bd4ce27

Groups

*

Rule Path
Disallow /cart
Disallow /checkout
Disallow /my-account
Disallow /login
Disallow /search
Disallow /*?=
Disallow /v12finance*

Other Records

Field Value
sitemap https://www.betteridge.com/sitemap.xml
sitemap https://www.betteridge.com/sitemap/product-en_us-usd.xml
sitemap https://www.betteridge.com/sitemap/homepage-en_us-usd.xml
sitemap https://www.betteridge.com/sitemap/category-en_us-usd.xml
sitemap https://www.betteridge.com/sitemap/store-en_us-usd.xml
sitemap https://www.betteridge.com/sitemap/content-en_us-usd.xml

Comments

  • For all robots
  • Block access to specific groups of pages
  • Allow search crawlers to discover the sitemaps