chlodnictwo.biz
robots.txt

Robots Exclusion Standard data for chlodnictwo.biz

Resource Scan

Scan Details

Site Domain chlodnictwo.biz
Base Domain chlodnictwo.biz
Scan Status Ok
Last Scan6/4/2025, 12:26:24 AM
Next Scan 6/11/2025, 12:26:24 AM

Last Scan

Scanned6/4/2025, 12:26:24 AM
URL https://chlodnictwo.biz/robots.txt
Redirect https://www.chlodnictwo.biz/robots.txt
Redirect Domain www.chlodnictwo.biz
Redirect Base chlodnictwo.biz
Domain IPs 104.21.56.21, 172.67.175.251, 2606:4700:3032::ac43:affb, 2606:4700:3035::6815:3815
Redirect IPs 104.21.56.21, 172.67.175.251, 2606:4700:3032::ac43:affb, 2606:4700:3035::6815:3815
Response IP 104.21.56.21
Found Yes
Hash ad930cbf8da81d1ef025248687cf887d42859cc9ccf262d763f42b61a941bb5b
SimHash 001c9d42f1c2

Groups

mj12bot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Product Comment
amazonbot Amazon's user agent
Rule Path
Disallow /

siteauditbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

semrushbot-ba

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claudebot/1.0

Rule Path
Disallow /

senuto

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Allow /

*

Rule Path
Allow /
Disallow /newsletter

Other Records

Field Value
crawl-delay 10