bradsdeals.com
robots.txt

Robots Exclusion Standard data for bradsdeals.com

Resource Scan

Scan Details

Site Domain bradsdeals.com
Base Domain bradsdeals.com
Scan Status Ok
Last Scan2024-06-30T05:35:39+00:00
Next Scan 2024-07-07T05:35:39+00:00

Last Scan

Scanned2024-06-30T05:35:39+00:00
URL https://bradsdeals.com/robots.txt
Redirect https://www.bradsdeals.com/robots.txt
Redirect Domain www.bradsdeals.com
Redirect Base bradsdeals.com
Domain IPs 18.239.36.127, 18.239.36.17, 18.239.36.74, 18.239.36.97
Redirect IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Response IP 151.101.130.133
Found Yes
Hash 5cd54fb4acdf933edd4fbf8e3a4c9dc8307bd9a46de08f1e2770ceb901f0d409
SimHash eb5fca469c73

Groups

mj12bot
dotbot
scoutjet
linkdex

Rule Path
Disallow /

ubicrawler
doc
zao
etaospider
xenu

Rule Path
Disallow /

*

Rule Path
Disallow /api/
Disallow /go/*
Disallow /c/*
Disallow /p/*
Disallow /update/
Disallow /emails/
Disallow /email/
Disallow /CFIDE/
Disallow /WEB-INF/
Disallow /cfdocs/
Disallow /my/
Disallow /search?query*
Disallow /print/*
Disallow /blog/feed/
Disallow /blog/trackback/
Disallow /blog/wp-admin/
Disallow /blog/wp-content/
Disallow /blog/xmlrpc.php
Disallow /blog/wp-
Allow /blog/wp-content/uploads/

*

Rule Path
Disallow /coupons/houzz*
Disallow /stores/houzz*

Other Records

Field Value
sitemap https://www.bradsdeals.com/googlesitemap.0.xml.gz

Comments

  • SEO/SEM Competitor Tool Bot Block
  • Bots that obey Robots.txt block
  • Original robots disallows
  • Special Merchant Requests
  • Sitemap