software-directory.net
robots.txt

Robots Exclusion Standard data for software-directory.net

Resource Scan

Scan Details

Site Domain software-directory.net
Base Domain software-directory.net
Scan Status Ok
Last Scan2025-10-18T17:24:48+00:00
Next Scan 2025-11-17T17:24:48+00:00

Last Scan

Scanned2025-10-18T17:24:48+00:00
URL https://software-directory.net/robots.txt
Domain IPs 104.21.40.88, 172.67.183.68, 2606:4700:3032::ac43:b744, 2606:4700:3037::6815:2858
Response IP 172.67.183.68
Found Yes
Hash e3bb3e144d9f52f37756c7c25099087469e7c775b0f3cf2aa2993854e8b7204c
SimHash 8910d890abd2

Groups

*

Rule Path
Disallow /user/

aipbot

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

mediapartners-google*

Rule Path
Disallow