erikalancaster.com
robots.txt

Robots Exclusion Standard data for erikalancaster.com

Resource Scan

Scan Details

Site Domain erikalancaster.com
Base Domain erikalancaster.com
Scan Status Ok
Last Scan2025-11-06T10:21:53+00:00
Next Scan 2025-11-13T10:21:53+00:00

Last Scan

Scanned2025-11-06T10:21:53+00:00
URL https://erikalancaster.com/robots.txt
Redirect https://www.erikalancaster.com/robots.txt
Redirect Domain www.erikalancaster.com
Redirect Base erikalancaster.com
Domain IPs 199.34.228.72
Redirect IPs 199.34.228.72
Response IP 199.34.228.72
Found Yes
Hash 9ece989d6b29de14fb6dd6b412ca3aa73770fb03e921159990b61b4887807a99
SimHash 0355dc166bd3

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /watercolor-basics-full-course.html
Disallow /pen-wash-flowers-full-course.html
Disallow /patreon_drawing_watercolor_tutorials.html
Disallow /classes_art_fundamentals.html
Disallow /drawing-mini-courses.html
Disallow /reference_photo_vault_patreon.html

Other Records

Field Value
sitemap https://www.erikalancaster.com/sitemap.xml