highlightcrafts.com
robots.txt

Robots Exclusion Standard data for highlightcrafts.com

Resource Scan

Scan Details

Site Domain highlightcrafts.com
Base Domain highlightcrafts.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-05-15T15:25:38+00:00
Next Scan 2025-08-13T15:25:38+00:00

Last Successful Scan

Scanned2024-03-29T13:41:00+00:00
URL https://highlightcrafts.com/robots.txt
Domain IPs 77.68.72.40
Response IP 77.68.72.40
Found Yes
Hash fe39dd15ac8c4a48e57ef5a578138ac153d67852a57a5cc25f9f85a2ae0761e2
SimHash f01e54128e32

Groups

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

patric

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

fidget-spinner-bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://highlightcrafts.com/sitemap_index.xml