tarotsmith.net
robots.txt

Robots Exclusion Standard data for tarotsmith.net

Resource Scan

Scan Details

Site Domain tarotsmith.net
Base Domain tarotsmith.net
Scan Status Ok
Last Scan2025-10-11T22:04:45+00:00
Next Scan 2025-10-18T22:04:45+00:00

Last Scan

Scanned2025-10-11T22:04:45+00:00
URL https://tarotsmith.net/robots.txt
Domain IPs 104.21.91.173, 172.67.176.222, 2606:4700:3035::6815:5bad, 2606:4700:3035::ac43:b0de
Response IP 172.67.176.222
Found Yes
Hash 8509c9969385ec4dffd247324adaa154b72c2dcaed0cd6a495137b1087d1cf91
SimHash ab34d832cbf3

Groups

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 12

urlmetrics

Rule Path
Disallow /