generic.tools
robots.txt

Robots Exclusion Standard data for generic.tools

Resource Scan

Scan Details

Site Domain generic.tools
Base Domain generic.tools
Scan Status Ok
Last Scan2024-09-07T04:16:38+00:00
Next Scan 2024-10-07T04:16:38+00:00

Last Scan

Scanned2024-09-07T04:16:38+00:00
URL https://generic.tools/robots.txt
Domain IPs 104.21.71.124, 172.67.145.40, 2606:4700:3030::ac43:9128, 2606:4700:3035::6815:477c
Response IP 172.67.145.40
Found Yes
Hash 208ba054acdb9f0611351807e0cdee9cb28ced3a1368247382194580e7496858
SimHash 6d51e800e693

Groups

*

Rule Path
Disallow /*?
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://generic.tools/sitemap.xml