savethestudent.org
robots.txt

Robots Exclusion Standard data for savethestudent.org

Resource Scan

Scan Details

Site Domain savethestudent.org
Base Domain savethestudent.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-26T18:44:57+00:00
Next Scan 2024-11-24T18:44:57+00:00

Last Successful Scan

Scanned2024-01-30T18:42:58+00:00
URL https://savethestudent.org/robots.txt
Redirect https://www.savethestudent.org/robots.txt
Redirect Domain www.savethestudent.org
Redirect Base savethestudent.org
Domain IPs 172.66.41.36, 172.66.42.220, 2606:4700:3108::ac42:2924, 2606:4700:3108::ac42:2adc
Redirect IPs 172.66.41.36, 172.66.42.220, 2606:4700:3108::ac42:2924, 2606:4700:3108::ac42:2adc
Response IP 172.66.41.36
Found Yes
Hash 571e2245e03f9c6145611d3c9dfd334d7a36bef3e5f354a6900b444ea418cfb3
SimHash c4290b7b8794

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /featuresblog/
Disallow /xmlrpc.php
Disallow /out/
Disallow /go-to/
Disallow /redirect/
Disallow *?s=*
Disallow *?p=*
Disallow *?desktop=*
Disallow *?switch=*
Disallow *?j-page=*
Disallow *?jobtype_search=*
Disallow *?city_search=*
Disallow *?sort=*
Disallow *?mailchimp=*

googlebot

Rule Path
Allow *?s=*

Other Records

Field Value
sitemap https://www.savethestudent.org/sitemap.xml