filipiknow.net
robots.txt

Robots Exclusion Standard data for filipiknow.net

Resource Scan

Scan Details

Site Domain filipiknow.net
Base Domain filipiknow.net
Scan Status Ok
Last Scan2024-09-22T13:07:21+00:00
Next Scan 2024-09-29T13:07:21+00:00

Last Scan

Scanned2024-09-22T13:07:21+00:00
URL https://filipiknow.net/robots.txt
Domain IPs 104.21.7.142, 172.67.187.151, 2606:4700:3030::ac43:bb97, 2606:4700:3035::6815:78e
Response IP 104.21.7.142
Found Yes
Hash 575c3c5ebadc6c8d6abc6068cb3fb606b9f5e6add97a12ce32b97da64802fba2
SimHash 25155b5463d8

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /tmp/
Disallow /junk/

Comments

  • Blocks robots from specific folders / directories