Log In Sign Up

bartorelli.it
robots.txt

Robots Exclusion Standard data for bartorelli.it

Resource Scan

Scan Details

Site Domain bartorelli.it
Base Domain bartorelli.it
Scan Status Ok
Last Scan2025-05-28T14:25:29+00:00
Next Scan 2025-06-27T14:25:29+00:00

Last Scan

Scanned2025-05-28T14:25:29+00:00
URL https://bartorelli.it/robots.txt
Redirect http://www.bartorelli.it/robots.txt
Redirect Domain www.bartorelli.it
Redirect Base bartorelli.it
Domain IPs 104.21.46.207, 172.67.141.203, 2606:4700:3033::ac43:8dcb, 2606:4700:3037::6815:2ecf
Redirect IPs 104.21.46.207, 172.67.141.203, 2606:4700:3033::ac43:8dcb, 2606:4700:3037::6815:2ecf
Response IP 172.67.141.203
Found Yes
Hash 945505e554b2ad26b18c63b9c696ae47ca3ee0f61e049c52f6f453d95019a407
SimHash ef1c18a0e748

Groups

teleport

Rule Path
Disallow /

googlebot

Rule Path
Disallow /modena/

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

siteauditbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

Rule Path
Disallow /modena/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top

Comments

  • Escludo dall'intero sito Teleport
  • Escludo google dalla cartella modena
Back to top