shop.biollamotors.it
robots.txt

Robots Exclusion Standard data for shop.biollamotors.it

Resource Scan

Scan Details

Site Domain shop.biollamotors.it
Base Domain biollamotors.it
Scan Status Ok
Last Scan2024-10-21T15:41:25+00:00
Next Scan 2024-11-20T15:41:25+00:00

Last Scan

Scanned2024-10-21T15:41:25+00:00
URL https://shop.biollamotors.it/robots.txt
Domain IPs 104.21.17.136, 172.67.176.205, 2606:4700:3030::6815:1188, 2606:4700:3033::ac43:b0cd
Response IP 104.21.17.136
Found Yes
Hash 9149ffb30efd64c0bbeb25645df1323a3edeb123f5ba602485a1b43c923a4f03
SimHash 78554954ccd3

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /admin/

etaospider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://shop.biollamotors.it/pub/sitemap_products_new.php
sitemap https://shop.biollamotors.it/pub/sitemap_categories_new_v1.php
sitemap https://shop.biollamotors.it/pub/sitemap-index.xml
sitemap https://shop.biollamotors.it/pub/sitemap_manufacturers_new_v1.php