firmania.it
robots.txt

Robots Exclusion Standard data for firmania.it

Resource Scan

Scan Details

Site Domain firmania.it
Base Domain firmania.it
Scan Status Ok
Last Scan2024-11-09T02:58:51+00:00
Next Scan 2024-11-16T02:58:51+00:00

Last Scan

Scanned2024-11-09T02:58:51+00:00
URL https://firmania.it/robots.txt
Domain IPs 104.18.20.20, 104.18.21.20, 2606:4700::6812:1414, 2606:4700::6812:1514
Response IP 104.18.20.20
Found Yes
Hash cdcc3034a20e6d83af840faeea225195317459d2f40530d3fd33166b302333dd
SimHash 651fd070c331

Groups

*

Rule Path
Allow /
Disallow /search*
Disallow /contact*
Disallow /customer-care*
Disallow /cdn-cgi/*

mauibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

gptbot

Rule Path
Disallow /

Comments

  • Custom project specific