blog.rosettastone.com
robots.txt

Robots Exclusion Standard data for blog.rosettastone.com

Resource Scan

Scan Details

Site Domain blog.rosettastone.com
Base Domain rosettastone.com
Scan Status Ok
Last Scan2025-10-04T09:33:26+00:00
Next Scan 2025-10-18T09:33:26+00:00

Last Scan

Scanned2025-10-04T09:33:26+00:00
URL https://blog.rosettastone.com/robots.txt
Domain IPs 104.18.32.113, 172.64.155.143, 2a06:98c1:3105::6812:2071, 2a06:98c1:310c::ac40:9b8f
Response IP 172.64.155.143
Found Yes
Hash ccf88d38e0aa743d976d0155dc7a0dbef20768ea30b31f80528f7cd1de0b06f1
SimHash 690c8840cbf2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/
Allow /wp-admin/admin-ajax.php

gptbot

Rule Path
Allow /
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/

google-extend

Rule Path
Allow /
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/

googleother

Rule Path
Allow /
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

tiktokspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://blog.rosettastone.com/sitemap_index.xml