prowlerforums.net
robots.txt

Robots Exclusion Standard data for prowlerforums.net

Resource Scan

Scan Details

Site Domain prowlerforums.net
Base Domain prowlerforums.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-10T05:47:53+00:00
Next Scan 2024-11-17T05:47:53+00:00

Last Successful Scan

Scanned2024-07-12T20:55:43+00:00
URL https://prowlerforums.net/robots.txt
Domain IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91
Response IP 151.101.193.91
Found Yes
Hash 12e35e30e083366a8bb6ce981def4477c5f843fe791d4754868a1a6b7bf65941
SimHash c47d5c42a201

Groups

*

Rule Path
Disallow /account/
Disallow /goto/
Disallow /login/
Disallow /search/
Disallow /members/
Disallow /admin.php
Disallow /business/directory
Allow /

Other Records

Field Value
sitemap https://prowlerforums.net/sitemap.xml