Log In Sign Up

bonificamarche.it
robots.txt

Robots Exclusion Standard data for bonificamarche.it

Resource Scan

Scan Details

Site Domain bonificamarche.it
Base Domain bonificamarche.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-05T07:09:11+00:00
Next Scan 2024-10-06T07:09:11+00:00

Last Successful Scan

Scanned2024-09-05T07:08:52+00:00
URL https://bonificamarche.it/robots.txt
Redirect https://www.bonificamarche.it/robots.txt
Redirect Domain www.bonificamarche.it
Redirect Base bonificamarche.it
Domain IPs 46.254.39.103
Redirect IPs 46.254.39.103
Response IP 46.254.39.103
Found Yes
Hash e084121ff3512c8d060721f334d43d30d36442b3cc30823bc9b00b38787682a2
SimHash d8189d10d932

Groups

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot
mj12bot
seobility
dotbot
screaming frog seo spider
semrushbot
semrushbot-ba
semrushbot-ct
semrushbot-bm
semrushbot-sa
semrushbot-swa
semrushbot-si
siteauditbot
splitsignalbot
proximic
rogerbot
yandexmetrika
xenu's
sistrix
seokicks
seokicks-robot
yisouspider
qwantify

Rule Path
Disallow /

ruby
python-requests
libwww-perl
mail.ru_bot
copyrightcheck
flaming attackbot
foobot
httplib
keyword density
linkscan
linkwalker
python-urllib
pyton-requests
seznambot
woorankreview

Rule Path
Disallow /

*

Rule Path
Disallow /_/fragments/
Back to top

Other Records

Field Value
sitemap https://www.bonificamarche.it/sitemap.xml
Back to top

Comments

  • SEOTOOLS
  • https://it.semrush.com/bot/
  • OTHER
Back to top

Warnings

  • 1 invalid line.
Back to top