Log In Sign Up

fleximounts.com
robots.txt

Robots Exclusion Standard data for fleximounts.com

Resource Scan

Scan Details

Site Domain fleximounts.com
Base Domain fleximounts.com
Scan Status Ok
Last Scan2024-09-08T09:42:29+00:00
Next Scan 2024-10-08T09:42:29+00:00

Last Scan

Scanned2024-09-08T09:42:29+00:00
URL https://fleximounts.com/robots.txt
Redirect https://www.fleximounts.com/robots.txt
Redirect Domain www.fleximounts.com
Redirect Base fleximounts.com
Domain IPs 23.46.230.140, 23.46.230.158, 2600:1413:b000:1e::17d1:2e57, 2600:1413:b000:1e::17d1:2e58
Redirect IPs 125.56.219.49, 2600:1413:b000:1e::17d1:2e4b, 2600:1413:b000:1e::17d1:2e60, 96.17.72.72
Response IP 23.45.207.171
Found Yes
Hash 70fb700f2b349115a87640268e3f6798a879685ed2ad36b1b2b461d1743b9a20
SimHash bc313d318ce7

Groups

googlebot

Rule Path
Disallow /buyer/
Disallow /checkout/
Disallow /bbs/
Disallow /order-tracking
Disallow /point
Disallow /game-center/

*

Rule Path
Disallow /buyer/
Disallow /checkout/
Disallow /bbs/
Disallow /order-tracking
Disallow /point
Disallow /game-center/
Back to top

Other Records

Field Value
sitemap https://www.fleximounts.com/sitemap.xml
Back to top

Comments

  • This robots.txt file controls crawling of URLs under https://example.com.
  • All crawlers are disallowed to crawl files in the "includes" directory, such
  • as .css, .js, but Google needs them for rendering, so Googlebot is allowed
  • to crawl them.
Back to top