Log In Sign Up

landlantbruk.se
robots.txt

Robots Exclusion Standard data for landlantbruk.se

Resource Scan

Scan Details

Site Domain landlantbruk.se
Base Domain landlantbruk.se
Scan Status Ok
Last Scan2024-10-03T15:28:06+00:00
Next Scan 2024-10-10T15:28:06+00:00

Last Scan

Scanned2024-10-03T15:28:06+00:00
URL https://landlantbruk.se/robots.txt
Redirect https://www.landlantbruk.se/robots.txt
Redirect Domain www.landlantbruk.se
Redirect Base landlantbruk.se
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.164, 76.76.21.98
Response IP 76.76.21.93
Found Yes
Hash 5522f8fc4311112b2ab8aef9231c85a9b19e75fcbce19dc335aa455236fd5fae
SimHash 6f34ca67e137

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.landlantbruk.se/sitemap.xml
sitemap https://www.landlantbruk.se/server-articles-sitemap.xml
sitemap https://www.landlantbruk.se/server-articles2-sitemap.xml
sitemap https://www.landlantbruk.se/server-categories-sitemap.xml
sitemap https://www.landlantbruk.se/server-news-sitemap.xml
Back to top

Comments

  • GPTBot
  • Google-Extended
  • CCBot
  • anthropic-ai
  • cohere-ai
  • Host
  • Sitemaps
Back to top

Warnings

  • `host` is not a known field.
Back to top