roughtrade.com
robots.txt

Robots Exclusion Standard data for roughtrade.com

Resource Scan

Scan Details

Site Domain roughtrade.com
Base Domain roughtrade.com
Scan Status Ok
Last Scan2024-09-11T12:38:34+00:00
Next Scan 2024-10-11T12:38:34+00:00

Last Scan

Scanned2024-09-11T12:38:34+00:00
URL https://roughtrade.com/robots.txt
Redirect https://www.roughtrade.com/robots.txt
Redirect Domain www.roughtrade.com
Redirect Base roughtrade.com
Domain IPs 104.26.14.153, 104.26.15.153, 172.67.75.247, 2606:4700:20::681a:e99, 2606:4700:20::681a:f99, 2606:4700:20::ac43:4bf7
Redirect IPs 104.26.14.153, 104.26.15.153, 172.67.75.247, 2606:4700:20::681a:e99, 2606:4700:20::681a:f99, 2606:4700:20::ac43:4bf7
Response IP 172.67.75.247
Found Yes
Hash 1815f33aa4329e6785d392e93ebb6589a39f295514ab26ba3b5a39626a2dbe1f
SimHash 65041e00c394

Groups

*

Rule Path
Allow /*
Disallow */search/
Disallow */search?*

Other Records

Field Value
sitemap https://roughtrade-sitemaps.s3.eu-west-2.amazonaws.com/sitemap.xml
sitemap https://roughtrade-sitemaps.s3.eu-west-2.amazonaws.com/sitemap1.xml