calcolofacile.it
robots.txt

Robots Exclusion Standard data for calcolofacile.it

Resource Scan

Scan Details

Site Domain calcolofacile.it
Base Domain calcolofacile.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-11-08T04:30:51+00:00
Next Scan 2024-11-22T04:30:51+00:00

Last Successful Scan

Scanned2024-10-24T03:52:30+00:00
URL https://calcolofacile.it/robots.txt
Redirect https://www.calcolofacile.it/robots.txt
Redirect Domain www.calcolofacile.it
Redirect Base calcolofacile.it
Domain IPs 89.46.105.36
Redirect IPs 89.46.105.36
Response IP 89.46.105.36
Found Yes
Hash 47fc4bf65a1d842ced0568c988e1d40f7d2cde5dc599a2ecfc933e52c0172ce8
SimHash 8f5b81032191

Groups

*

Rule Path
Disallow /errore
Disallow /temp/
Disallow /test/

ahrefsbot

Rule Path
Disallow /public
Disallow /images
Disallow /documenti

Other Records

Field Value
crawl-delay 259200

yandex

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

sputnik

Rule Path
Disallow /

sputnikbot/2.3

Rule Path
Disallow /

site.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yeti-mobile

Rule Path
Disallow /

pi-monster

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

steeler

Rule Path
Disallow /

steeler/3.5

Rule Path
Disallow /

pandalytics/1.0

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

Comments

  • robots.txt v. 1.01
  • AhrefsBot
  • Other