thoughtsfromapage.com
robots.txt

Robots Exclusion Standard data for thoughtsfromapage.com

Resource Scan

Scan Details

Site Domain thoughtsfromapage.com
Base Domain thoughtsfromapage.com
Scan Status Ok
Last Scan2025-05-09T19:32:42+00:00
Next Scan 2025-05-16T19:32:42+00:00

Last Scan

Scanned2025-05-09T19:32:42+00:00
URL https://thoughtsfromapage.com/robots.txt
Redirect https://www.thoughtsfromapage.com/robots.txt
Redirect Domain www.thoughtsfromapage.com
Redirect Base thoughtsfromapage.com
Domain IPs 54.90.47.105
Redirect IPs 54.90.47.105
Response IP 54.90.47.105
Found Yes
Hash c9e0f73f708e4b40b8a5788b94d7226fab2c3c3a825ab01058e485d03e1da27a
SimHash 631dd1f1e791

Groups

googlebot
bingbot
slurp
duckduckbot
yandexbot

Rule Path
Allow /

amazonbot
mj12bot
petalbot
aspiegelbot
ahrefsbot
semrushbot
dotbot
mauibot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.thoughtsfromapage.com/sitemap.xml