basilegiocattoli.com
robots.txt

Robots Exclusion Standard data for basilegiocattoli.com

Resource Scan

Scan Details

Site Domain basilegiocattoli.com
Base Domain basilegiocattoli.com
Scan Status Ok
Last Scan2025-03-17T00:25:37+00:00
Next Scan 2025-04-16T00:25:37+00:00

Last Scan

Scanned2025-03-17T00:25:37+00:00
URL https://basilegiocattoli.com/robots.txt
Domain IPs 104.26.8.41, 104.26.9.41, 172.67.71.112, 2606:4700:20::681a:829, 2606:4700:20::681a:929, 2606:4700:20::ac43:4770
Response IP 172.67.71.112
Found Yes
Hash 87c7bb28b811b390124b722f6ad28fc13db62328d848ec688c6a9b1b777f143b
SimHash 563cc070a7d8

Groups

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

amazonbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

yandexbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

dotbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

mj12bot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

semrushbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

bytespider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

aliapp

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

blexbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

zoominfobot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

ccbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

dataforseobot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

webprosbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

tinytestbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap http://www.basilegiocattoli.com/sitemap.xml