carlsteins.com
robots.txt

Robots Exclusion Standard data for carlsteins.com

Resource Scan

Scan Details

Site Domain carlsteins.com
Base Domain carlsteins.com
Scan Status Ok
Last Scan2025-09-20T16:34:04+00:00
Next Scan 2025-10-20T16:34:04+00:00

Last Scan

Scanned2025-09-20T16:34:04+00:00
URL https://carlsteins.com/robots.txt
Domain IPs 185.15.121.100
Response IP 185.15.121.100
Found Yes
Hash 69c9f5a2e2e804385d69ebec437a85b40d4165a3d51085c02b19eb2017cf140f
SimHash 481cdd60ee93

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://carlsteins.com/index.php?feed=xmlsitemap2518