scientistafoundation.com
robots.txt

Robots Exclusion Standard data for scientistafoundation.com

Resource Scan

Scan Details

Site Domain scientistafoundation.com
Base Domain scientistafoundation.com
Scan Status Ok
Last Scan2025-06-04T14:27:03+00:00
Next Scan 2025-07-04T14:27:03+00:00

Last Scan

Scanned2025-06-04T14:27:03+00:00
URL http://scientistafoundation.com/robots.txt
Redirect http://www.scientistafoundation.com/robots.txt
Redirect Domain www.scientistafoundation.com
Redirect Base scientistafoundation.com
Domain IPs 199.34.228.47
Redirect IPs 199.34.228.47
Response IP 199.34.228.47
Found Yes
Hash a735d158e4cd86f505f557d2c6a754f6c062619a65c0dd184029ef78ef31346d
SimHash 211adc004b12

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /http%3A//www.scientistafoundation.com/career-blog.html
Disallow /symposium-poster-submission-2017---archive.html
Disallow /http%3A//www.scientistafoundation.com/office-hours-sujata-bhatia.html
Disallow /http%3A//scientistasymposium.splashthat.com/
Disallow /about.html
Disallow /judge-sign-up---archive.html
Disallow /homedraft.html
Disallow /http%3A//www.scientistafoundation.com/32/post/2012/06/summer-internship-series-2012.html
Disallow /symposium-2019.html
Disallow /get-inspired1.html
Disallow /https%3A//scisymp2017.splashthat.com/
Disallow /events1.html
Disallow /scientista-symposium-archive.html
Disallow /advice-center.html
Disallow /symposium-poster-fair-2017---archive.html
Disallow /http%3A//symposium.scientistafoundation.org/poster-application.html
Disallow /http%3A//symposium.scientistafoundation.org/become-a-judge.html
Disallow /http%3A//symposium.scientistafoundation.org/sponsors.html
Disallow /join.html
Disallow /sponsorship.html
Disallow /sciscymp17archive.html
Disallow /judge-sign-up---archive1.html

Other Records

Field Value
sitemap http://www.scientistafoundation.com/sitemap.xml