Log In Sign Up

b2b.odplus.it
robots.txt

Robots Exclusion Standard data for b2b.odplus.it

Resource Scan

Scan Details

Site Domain b2b.odplus.it
Base Domain odplus.it
Scan Status Ok
Last Scan2026-02-27T16:51:22+00:00
Next Scan 2026-03-29T16:51:22+00:00

Last Scan

Scanned2026-02-27T16:51:22+00:00
URL https://b2b.odplus.it/robots.txt
Domain IPs 20.71.148.147
Response IP 20.71.148.147
Found Yes
Hash 0c2a175a4ca390efc8251eb954791451c230fe45439e5c78a6f1ceec132f21b9
SimHash 354dca51ea1c

Groups

*

Rule Path
Disallow *SearchParameter%3D*
Disallow *PageNumber%3D
Disallow /WFS/*/*/-/viewdata
Disallow /INTERSHOP/
Disallow /online/web/WFS/*/*/-/
Disallow /online/web/BOS/*/*/-/
Allow /online/web/WFS/*/it_IT/-/EUR/ViewUserAccount-ShowLogin
Allow /WFS/*/it_IT/-/EUR/ViewUserAccount-ShowLogin

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 35

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

istellabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 45

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90

meta-externalagent

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

crawler

Rule Path
Disallow /
Back to top

Comments

  • Stop for filtered pages
  • Stop for paging pages
  • Stop for checkout urls
  • Stop for standard IS Url
  • Stop for not rewrited url
  • Stop for backoffice urls
Back to top