everystudent.com
robots.txt

Robots Exclusion Standard data for everystudent.com

Resource Scan

Scan Details

Site Domain everystudent.com
Base Domain everystudent.com
Scan Status Ok
Last Scan2025-10-25T06:32:15+00:00
Next Scan 2025-11-08T06:32:15+00:00

Last Scan

Scanned2025-10-25T06:32:15+00:00
URL https://everystudent.com/robots.txt
Redirect https://www.everystudent.com/robots.txt
Redirect Domain www.everystudent.com
Redirect Base everystudent.com
Domain IPs 104.26.4.238, 104.26.5.238, 172.67.68.90, 2606:4700:20::681a:4ee, 2606:4700:20::681a:5ee, 2606:4700:20::ac43:445a
Redirect IPs 104.26.4.238, 104.26.5.238, 172.67.68.90, 2606:4700:20::681a:4ee, 2606:4700:20::681a:5ee, 2606:4700:20::ac43:445a
Response IP 104.26.5.238
Found Yes
Hash 1d3ac7f28487c310abc82c23adf0163bc4b29d9c3eb99a4cd7f222c4bc0906e5
SimHash 2bd4834786d5

Groups

*

Rule Path
Disallow /4laws.html
Disallow /jdquestions.html
Disallow /team/*
Disallow /admin/*
Disallow /mobi/*
Disallow /sys/*
Disallow /mypage/*
Disallow /email/africa.html
Disallow /email/kuwait.html
Disallow /email/montenegro.html
Disallow /email/english.php
Disallow /contactUS.php
Disallow /contactMY.php
Disallow /email/singapore.html
Disallow /email/canada.html
Disallow /email/india.html
Disallow /email/denmark.html
Disallow /email/caribbean.html
Disallow /email/forumquestion.html
Disallow /email/australia.html
Disallow /email/newzealand.html
Disallow /email/uae.html
Disallow /email/pakistan.html
Disallow /email/sweden.html
Disallow /atools/*

gptbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

google-extended

Rule Path
Allow /

bingbot

Rule Path
Allow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.everystudent.com/sitemap.xml