senorashby.com
robots.txt

Robots Exclusion Standard data for senorashby.com

Resource Scan

Scan Details

Site Domain senorashby.com
Base Domain senorashby.com
Scan Status Ok
Last Scan2024-06-19T19:24:08+00:00
Next Scan 2024-06-26T19:24:08+00:00

Last Scan

Scanned2024-06-19T19:24:08+00:00
URL https://senorashby.com/robots.txt
Redirect https://www.senorashby.com/robots.txt
Redirect Domain www.senorashby.com
Redirect Base senorashby.com
Domain IPs 199.34.228.71
Redirect IPs 199.34.228.71
Response IP 199.34.228.71
Found Yes
Hash 50ca70bfcc5007e595a35301c359c3c8e1fd672402f3d21d05dda93e8672844c
SimHash 1a58d77f0fb3

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /spanish-1.html
Disallow /preliminary-unit.html
Disallow /top-ten-vocabulary-activities.html
Disallow /topics-a-l.html
Disallow /online-lessons.html
Disallow /face-to-face-lessons.html
Disallow /lessons-and-ci-videos.html
Disallow /online-lessons1.html
Disallow /face-to-face-lessons1.html
Disallow /creating-a-classroom-culture.html
Disallow /spanish-2.html
Disallow /topics-m-z.html
Disallow /spanish-resources-topic-pages.html
Disallow /about.html
Disallow /lessons.html
Disallow /full-length-music-videos.html
Disallow /orignal-music.html
Disallow /free.html
Disallow /unit-1.html
Disallow /unit-2.html
Disallow /song-resources.html
Disallow /unit-3.html
Disallow /unit-4.html
Disallow /unit-5.html
Disallow /unit-6.html
Disallow /unit-7.html
Disallow /other-resources.html
Disallow /unit-8.html
Disallow /remote-teaching-during-covid.html
Disallow /thank-you-for-your-purchase-summer-trial.html
Disallow /sign-up-for-full-access.html
Disallow /store.html
Disallow /https%3A//www.etsy.com/shop/FlyFamilyDesigns?ref=shop_sugg

Other Records

Field Value
sitemap https://www.senorashby.com/sitemap.xml