politicalfray.com
robots.txt

Robots Exclusion Standard data for politicalfray.com

Resource Scan

Scan Details

Site Domain politicalfray.com
Base Domain politicalfray.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-01-02T10:10:33+00:00
Next Scan 2025-04-02T10:10:33+00:00

Last Successful Scan

Scanned2023-03-15T03:15:51+00:00
URL https://politicalfray.com/robots.txt
Domain IPs 104.21.33.239, 172.67.151.176, 2606:4700:3036::ac43:97b0, 2606:4700:3037::6815:21ef
Response IP 104.21.33.239
Found Yes
Hash a7a18a15099452aae6c9caf569d7f38c631f0d081da31bc2042a46d5ba8679a9
SimHash 255b5b60af00

Groups

*

Rule Path
Disallow /login/
Disallow /register/
Disallow /lost-password/
Disallow /members/
Disallow /account/
Disallow /conversations/
Disallow /help/
Disallow /help/bb-codes/
Disallow /help/smilies/
Disallow /help/terms/
Disallow /help/privacy-policy/
Disallow /terms/
Disallow /privacy/
Disallow /misc/contact
Disallow /contact/
Disallow /admin.php
Allow /

Other Records

Field Value
sitemap https://politicalfray.com/sitemap.xml