Log In Sign Up

garmentory.com
robots.txt

Robots Exclusion Standard data for garmentory.com

Resource Scan

Scan Details

Site Domain garmentory.com
Base Domain garmentory.com
Scan Status Ok
Last Scan2024-10-05T03:11:51+00:00
Next Scan 2024-10-19T03:11:51+00:00

Last Scan

Scanned2024-10-05T03:11:51+00:00
URL https://garmentory.com/robots.txt
Redirect http://www.garmentory.com/robots.txt
Redirect Domain www.garmentory.com
Redirect Base garmentory.com
Domain IPs 34.193.3.121, 52.44.72.241
Redirect IPs 34.193.3.121, 52.44.72.241
Response IP 52.44.72.241
Found Yes
Hash 816cc93caf55c74c07614ff37eb25206a6ddee96c3514f0b49b60b10f6afe0aa
SimHash 765d8907e440

Groups

ahrefsbot
amazonbot
baiduspider
baiduspider-video
baiduspider-image
blexbot
bytespider
claudebot
dataforseobot
gptbot
imagesiftbot
mj12bot
petalbot
semrushbot
yandex

Rule Path
Disallow /

*

Rule Path
Disallow /checkout
Disallow /cart
Disallow /orders
Disallow /countries
Disallow /line_items
Disallow /password_resets
Disallow /states
Disallow /user_sessions
Disallow /user_registrations
Disallow /users
Disallow /account
Disallow /product_views
Disallow /sale/intentionally-__________/
Back to top

Other Records

Field Value
sitemap https://www.garmentory.com/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /
Back to top