bjornberry.com
robots.txt

Robots Exclusion Standard data for bjornberry.com

Resource Scan

Scan Details

Site Domain bjornberry.com
Base Domain bjornberry.com
Scan Status Ok
Last Scan2024-06-14T04:36:58+00:00
Next Scan 2024-06-28T04:36:58+00:00

Last Scan

Scanned2024-06-14T04:36:58+00:00
URL https://bjornberry.com/robots.txt
Redirect https://www.bjornberry.com/robots.txt
Redirect Domain www.bjornberry.com
Redirect Base bjornberry.com
Domain IPs 192.121.104.141
Redirect IPs 192.121.104.141
Response IP 192.121.104.141
Found Yes
Hash 206ae1d033844c997d0d8ea505cc4af56282e8665caf4be0f2d0b1416ce4602b
SimHash e200dc642a11

Groups

*

Rule Path
Disallow */editor
Disallow */admin
Disallow */pay.php
Disallow /backend
Disallow */done.php
Disallow */basket.php
Disallow */order.php
Disallow */tunnel.php
Disallow */captcha.png.php
Disallow */redirect/
Disallow */buyer_login.php

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.bjornberry.com/sitemap.xml