travelpolonia.com
robots.txt

Robots Exclusion Standard data for travelpolonia.com

Resource Scan

Scan Details

Site Domain travelpolonia.com
Base Domain travelpolonia.com
Scan Status Ok
Last Scan2025-04-10T05:45:52+00:00
Next Scan 2025-04-17T05:45:52+00:00

Last Scan

Scanned2025-04-10T05:45:52+00:00
URL https://travelpolonia.com/robots.txt
Domain IPs 104.21.86.88, 172.67.217.49, 2606:4700:3030::6815:5658, 2606:4700:3035::ac43:d931
Response IP 172.67.217.49
Found Yes
Hash ec47682f90960c9cdf12c32c65b7a4b4c23559f50ca05723e1d232fedbef01d7
SimHash e20cd0e1e9b1

Groups

*

Rule Path
Disallow /*/cfc/
Disallow /CFIDE/*
Disallow /*/index.cfm*

Other Records

Field Value
crawl-delay 5

amazonbot
ccbot
dataforseobot
dotbot
gptbot
grapeshot
mj12bot
obot
petalbot
semrushbot
yandex

Rule Path
Disallow /

bingbot
slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://travelpolonia.com/sitemap_index.xml