joebidenscholarships.com
robots.txt

Robots Exclusion Standard data for joebidenscholarships.com

Resource Scan

Scan Details

Site Domain joebidenscholarships.com
Base Domain joebidenscholarships.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2024-09-15T06:55:55+00:00
Next Scan 2024-12-14T06:55:55+00:00

Last Successful Scan

Scanned2022-11-24T22:16:43+00:00
URL http://joebidenscholarships.com/robots.txt
Redirect https://www.blackscholarships.org/robots.txt
Redirect Domain www.blackscholarships.org
Redirect Base blackscholarships.org
Response IP 74.125.130.121
Found Yes
Hash a664370ef3195a61f8b88c00c6528b888e9b0212c3d9987c1c8ca59b37a9875c
SimHash 6904da70c712

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.blackscholarships.org/sitemap.xml