notino.it
robots.txt

Robots Exclusion Standard data for notino.it

Resource Scan

Scan Details

Site Domain notino.it
Base Domain notino.it
Scan Status Ok
Last Scan2024-06-24T07:32:39+00:00
Next Scan 2024-07-08T07:32:39+00:00

Last Scan

Scanned2024-06-24T07:32:39+00:00
URL https://notino.it/robots.txt
Redirect https://www.notino.it/robots.txt
Redirect Domain www.notino.it
Redirect Base notino.it
Domain IPs 104.18.37.135, 172.64.150.121
Redirect IPs 104.18.37.135, 172.64.150.121
Response IP 172.64.150.121
Found Yes
Hash 46e3e75a939b541f95e6b05d0cff1d4470510d8b57e2b520dd45eee033cce054
SimHash 49bd0732c6e2

Groups

mj12bot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

curious george

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

npbot-1/2.0

Rule Path
Disallow /

npbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /order.asp*
Disallow /order-multistep.asp*
Disallow /order-summary.asp*
Disallow /orderFrame.asp*
Disallow /detailsend.asp*
Disallow /addvote.asp*
Disallow /newpassword.asp*
Disallow /myaccount.asp*
Disallow /mynotino/*
Disallow /try-and-buy/error*
Disallow /cart/*
Disallow /upselling*
Disallow /checkout*
Disallow /.well-known*
Disallow /api/
Disallow /productDetail
Disallow /thankyou*
Disallow /delivery-and-payment*
Allow /.well-known/assetlinks.json
Allow /api/beautyblog

bingbot
yandexbot
megaindex.ru

Rule Path
Disallow /order.asp*
Disallow /order-multistep.asp*
Disallow /order-summary.asp*
Disallow /orderFrame.asp*
Disallow /detailsend.asp*
Disallow /addvote.asp*
Disallow /newpassword.asp*
Disallow /myaccount.asp*
Disallow /mynotino/*
Disallow /try-and-buy/error*
Disallow /cart/*
Disallow /upselling*
Disallow /checkout*
Disallow /.well-known*
Disallow /api/
Disallow /productDetail
Disallow /thankyou*
Disallow /delivery-and-payment*
Allow /.well-known/assetlinks.json
Allow /api/beautyblog

Other Records

Field Value
crawl-delay 4

*

Rule Path
Disallow /order.asp*
Disallow /order-multistep.asp*
Disallow /order-summary.asp*
Disallow /orderFrame.asp*
Disallow /detailsend.asp*
Disallow /addvote.asp*
Disallow /newpassword.asp*
Disallow /myaccount.asp*
Disallow /mynotino/*
Disallow /try-and-buy/error*
Disallow /cart/*
Disallow /upselling*
Disallow /checkout*
Disallow /.well-known*
Disallow /api/
Disallow /productDetail
Disallow /thankyou*
Disallow /delivery-and-payment*
Allow /.well-known/assetlinks.json
Allow /api/beautyblog

Other Records

Field Value
sitemap https://www.notino.it/sitemap.xml

Warnings

  • `request-rate` is not a known field.