brandbucket.com
robots.txt
Robots Exclusion Standard data for brandbucket.com
Resource Scan
Scan Details
Site Domain | brandbucket.com |
Base Domain | brandbucket.com |
Scan Status | Ok |
Last Scan | 2024-11-14T05:02:00+00:00 |
Next Scan | 2024-12-14T05:02:00+00:00 |
Last Scan
Scanned | 2024-11-14T05:02:00+00:00 |
URL | https://brandbucket.com/robots.txt |
Redirect | https://www.brandbucket.com/robots.txt |
Redirect Domain | www.brandbucket.com |
Redirect Base | brandbucket.com |
Domain IPs | 104.22.6.216, 104.22.7.216, 172.67.4.41, 2606:4700:10::6816:6d8, 2606:4700:10::6816:7d8, 2606:4700:10::ac43:429 |
Redirect IPs | 104.22.6.216, 104.22.7.216, 172.67.4.41, 2606:4700:10::6816:6d8, 2606:4700:10::6816:7d8, 2606:4700:10::ac43:429 |
Response IP | 104.22.7.216 |
Found | Yes |
Hash | f09697064b9031cdb6ed94d2ed20dc4752baf70a701d6c540d9fa162c64afc48 |
SimHash | 6a4e78fcc6b6 |
Groups
*
Rule | Path |
---|---|
Disallow | /cart$ |
Disallow | /favorites$ |
Disallow | /cart/ |
Disallow | /favorites/ |
Disallow | /admin/ |
Disallow | /logout/ |
Disallow | /user/ |
Disallow | /search/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.brandbucket.com/sitemap.xml |
Comments