web-general.com
robots.txt

Robots Exclusion Standard data for web-general.com

Resource Scan

Scan Details

Site Domain web-general.com
Base Domain web-general.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-05-26T11:24:31+00:00
Next Scan 2025-08-24T11:24:31+00:00

Last Successful Scan

Scanned2022-02-19T13:47:33+00:00
URL http://web-general.com/robots.txt
Response IP 217.113.62.81
Found Yes
Hash f5e92d971e6e3282e7057e968b6898a8439584538b3f02e6097a5769eb9de509
SimHash 85244c04c931

Groups

*

Rule Path
Disallow /click.php
Disallow /link.php
Disallow /admin