lavori.co.it
robots.txt

Robots Exclusion Standard data for lavori.co.it

Resource Scan

Scan Details

Site Domain lavori.co.it
Base Domain lavori.co.it
Scan Status Ok
Last Scan2024-05-29T01:52:28+00:00
Next Scan 2024-06-05T01:52:28+00:00

Last Scan

Scanned2024-05-29T01:52:28+00:00
URL https://lavori.co.it/robots.txt
Domain IPs 104.21.43.24, 172.67.216.49, 2606:4700:3035::6815:2b18, 2606:4700:3037::ac43:d831
Response IP 172.67.216.49
Found Yes
Hash 20d1f54706c6349b9b3644a356adfc0e41c33b01636a0d698659d9f549f00831
SimHash 09441150c681

Groups

mediapartners-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile-apps

Rule Path
Allow /

adidxbot

Rule Path
Allow /

*

Rule Path
Disallow /oc-admin/
Disallow /adpointer/
Disallow /display/
Disallow *pattern%2C*
Disallow *contact?v=*
Disallow *sShowAs*
Disallow *sOrder%2Ci_price*
Disallow *iPage*
Disallow *job/mark*
Disallow *job/send-friend*
Disallow *item-prev*
Disallow *item-next*
Disallow *page%3Dajax*
Disallow *languages*

bingbot

Rule Path
Disallow *sFeed%2Crss*

Other Records

Field Value
crawl-delay 80

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://lavori.co.it/map-cit
sitemap https://lavori.co.it/map-img

Comments

  • DaumWebMasterTool:88daf99681e9d147db9e51dafd87e4cdb2b924ebb2c56c3c50f1764ca013e812:elCazkMJjYjxKQyXLeIlvw==