flexispot.de
robots.txt

Robots Exclusion Standard data for flexispot.de

Resource Scan

Scan Details

Site Domain flexispot.de
Base Domain flexispot.de
Scan Status Ok
Last Scan2024-05-20T10:20:35+00:00
Next Scan 2024-06-19T10:20:35+00:00

Last Scan

Scanned2024-05-20T10:20:35+00:00
URL https://flexispot.de/robots.txt
Redirect https://www.flexispot.de/robots.txt
Redirect Domain www.flexispot.de
Redirect Base flexispot.de
Domain IPs 23.202.33.130, 23.202.33.209, 2600:1413:b000:1e::17d1:2e50, 2600:1413:b000:1e::17d1:2e52
Redirect IPs 23.47.190.153, 23.47.190.154, 2600:1413:b000:1e::17d1:2e47, 2600:1413:b000:1e::17d1:2e5b
Response IP 184.27.123.105
Found Yes
Hash 5e92f1d190fd9643f861f55f85a85e8fec40d496a1303940ff57d88d089f53b2
SimHash ac313d318ce7

Groups

googlebot

Rule Path
Disallow /buyer/
Disallow /checkout/
Disallow /bbs/
Disallow /order-tracking
Disallow /point
Disallow /blog/Workplace-Health/*
Disallow *?utm_source=awin*
Disallow */7th-anniversary
Disallow /game-center/

*

Rule Path
Disallow /buyer/
Disallow /checkout/
Disallow /bbs/
Disallow /order-tracking
Disallow /point
Disallow /blog/Workplace-Health/*
Disallow *?utm_source=awin*
Disallow */7th-anniversary
Disallow /game-center/

Other Records

Field Value
sitemap https://www.flexispot.de/sitemap.xml

Comments

  • This robots.txt file controls crawling of URLs under https://example.com.
  • All crawlers are disallowed to crawl files in the "includes" directory, such
  • as .css, .js, but Google needs them for rendering, so Googlebot is allowed
  • to crawl them.