raynerinstitute.com
robots.txt

Robots Exclusion Standard data for raynerinstitute.com

Resource Scan

Scan Details

Site Domain raynerinstitute.com
Base Domain raynerinstitute.com
Scan Status Ok
Last Scan2025-09-04T10:48:09+00:00
Next Scan 2025-10-04T10:48:09+00:00

Last Scan

Scanned2025-09-04T10:48:09+00:00
URL https://raynerinstitute.com/robots.txt
Redirect https://www.raynerinstitute.com/robots.txt
Redirect Domain www.raynerinstitute.com
Redirect Base raynerinstitute.com
Domain IPs 199.34.228.45
Redirect IPs 199.34.228.45
Response IP 199.34.228.45
Found Yes
Hash d88a0431e4d8b4736fc246b537c82a631c8834fd69507bfb259f28a1a866db03
SimHash 0bddd85473b2

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /about.html
Disallow /programs.html
Disallow /prospective-students.html
Disallow /payment.html
Disallow /current-students.html
Disallow /hire-a-coach.html
Disallow /instructors.html
Disallow /past-classrooms.html
Disallow /landings-page-master-program.html
Disallow /landing-page-self-paced-recorded-training.html
Disallow /core-alignment-homeroom-april-22-2014-complete.html
Disallow /images.html
Disallow /current-students1.html
Disallow /september-14th-15-evening-classroom.html

Other Records

Field Value
sitemap https://www.raynerinstitute.com/sitemap.xml