shat.net
robots.txt

Robots Exclusion Standard data for shat.net

Resource Scan

Scan Details

Site Domain shat.net
Base Domain shat.net
Scan Status Ok
Last Scan2024-05-31T13:07:08+00:00
Next Scan 2024-06-14T13:07:08+00:00

Last Scan

Scanned2024-05-31T13:07:08+00:00
URL https://shat.net/robots.txt
Domain IPs 172.93.52.73
Response IP 172.93.52.73
Found Yes
Hash 8cfb6d413e9523159d2260f4bad5202e7fac77a3c6ddc7c0fac4b620a4d358ec
SimHash 901c6236a5c2

Groups

ia_archiver

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

friendly_crawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /