Log In Sign Up

bitofbritainusa.com
robots.txt

Robots Exclusion Standard data for bitofbritainusa.com

Resource Scan

Scan Details

Site Domain bitofbritainusa.com
Base Domain bitofbritainusa.com
Scan Status Ok
Last Scan2024-05-21T07:37:55+00:00
Next Scan 2024-06-20T07:37:55+00:00

Last Scan

Scanned2024-05-21T07:37:55+00:00
URL https://bitofbritainusa.com/robots.txt
Redirect https://www.bitofbritainusa.com/robots.txt
Redirect Domain www.bitofbritainusa.com
Redirect Base bitofbritainusa.com
Domain IPs 99.84.66.127, 99.84.66.54, 99.84.66.56, 99.84.66.65
Redirect IPs 108.156.133.43, 108.156.133.65, 108.156.133.74, 108.156.133.92, 2600:9000:2755:2c00:1d:9fc8:b6c0:93a1, 2600:9000:2755:3a00:1d:9fc8:b6c0:93a1, 2600:9000:2755:3e00:1d:9fc8:b6c0:93a1, 2600:9000:2755:5a00:1d:9fc8:b6c0:93a1, 2600:9000:2755:7c00:1d:9fc8:b6c0:93a1, 2600:9000:2755:8200:1d:9fc8:b6c0:93a1, 2600:9000:2755:9400:1d:9fc8:b6c0:93a1, 2600:9000:2755:a800:1d:9fc8:b6c0:93a1
Response IP 108.156.133.74
Found Yes
Hash e3f081e5fb46396c3c76ad741f41a6e03d160a654beced2efa131fe24372ecdc
SimHash 212c4f574d90

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*

adsbot-google
googlebot

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://www.bitofbritainusa.com/sitemap.xml
Back to top

Comments

  • Disallow all crawlers access to certain pages.
  • Disallow AdsBot-Google from certain pages
Back to top

Warnings

  • `noindex` is not a known field.
Back to top