blackbarn.com
robots.txt
Robots Exclusion Standard data for blackbarn.com
Resource Scan
Scan Details
Site Domain | blackbarn.com |
Base Domain | blackbarn.com |
Scan Status | Ok |
Last Scan | 2024-09-12T14:00:15+00:00 |
Next Scan | 2024-10-12T14:00:15+00:00 |
Last Scan
Scanned | 2024-09-12T14:00:15+00:00 |
URL | https://blackbarn.com/robots.txt |
Redirect | https://www.blackbarn.com/robots.txt |
Redirect Domain | www.blackbarn.com |
Redirect Base | blackbarn.com |
Domain IPs | 120.138.16.117 |
Redirect IPs | 120.138.16.117 |
Response IP | 120.138.16.117 |
Found | Yes |
Hash | 53158e091dcb34509e3b605f1a7767d5f8f5de6ae989a5b2a779c7c5e01eaae6 |
SimHash | 9a900d0283c9 |
Groups
*
Rule | Path |
---|---|
Disallow | /Enquiry/ |
Disallow | /Admin |
Disallow | /Areas |
Disallow | /gallery.asp |
Disallow | /gallery_about.asp |
Disallow | /gallery_artist.asp |
Disallow | /gallery_coming.asp |
Disallow | /gallery_contact.asp |
Disallow | /gallery_current.asp |
Disallow | /gallery_otherartists.asp |
Disallow | /gallery_photo.asp |
Disallow | /gallery_stockroom.asp |
Disallow | /*.asp |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://www.blackbarn.com/XMLSitemap |
Comments