toedam.com
robots.txt

Robots Exclusion Standard data for toedam.com

Resource Scan

Scan Details

Site Domain toedam.com
Base Domain toedam.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-12-03T09:38:27+00:00
Next Scan 2025-12-10T09:38:27+00:00

Last Successful Scan

Scanned2025-01-19T10:27:57+00:00
URL https://toedam.com/robots.txt
Domain IPs 104.21.15.49, 172.67.161.178, 2606:4700:3032::ac43:a1b2, 2606:4700:3037::6815:f31
Response IP 172.67.161.178
Found Yes
Hash 049b66ac5fe0c60b3bd8d0fc337788df3e4a9b4e92e2973e1c49480779f21e95
SimHash 1904dd86f110

Groups

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

*

Rule Path
Allow /

googlebot-news

Rule Path
Allow /rss/showcase

googlebot

Rule Path
Allow /rss/showcase

semrushbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /