Log In Sign Up

patelmagnets.com
robots.txt

Robots Exclusion Standard data for patelmagnets.com

Resource Scan

Scan Details

Site Domain patelmagnets.com
Base Domain patelmagnets.com
Scan Status Ok
Last Scan2024-09-12T11:30:33+00:00
Next Scan 2024-10-12T11:30:33+00:00

Last Scan

Scanned2024-09-12T11:30:33+00:00
URL https://patelmagnets.com/robots.txt
Domain IPs 2a02:4780:11:946:0:287a:d6e7:2, 82.180.140.187
Response IP 82.180.140.187
Found Yes
Hash 41a934de259d8b58a72354e876ba2e80c14977b787a010ca996318f78cdc05b8
SimHash c633e4239fb4

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-json/
Disallow *?s=*
Disallow *?p=*
Disallow *?ver=*
Disallow *?wc-ajax=*
Disallow *?orderby=*
Disallow *add-to-cart%3D*
Disallow *?min_price=*
Disallow *?rating_filter=*
Disallow *?attachment_id=*
Disallow *?add_to_wishlist=*
Disallow *?gclid=*
Disallow *?action=*
Disallow *?grade=*
Disallow *?_wpnonce=*
Disallow *?post_type=*
Disallow *product%26rating_filter%3D*
Disallow /product/
Disallow /widgets/
Disallow /cache/
Disallow /feed/
Disallow /wordpress*
Disallow *?condition=*
Disallow *?color=*
Disallow /product-tag/
Disallow /page/
Disallow /blog/
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /ajay/
Disallow /api/
Disallow /.well-known/*
Disallow /ads.txt
Disallow /app-ads.txt

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://patelmagnets.com/sitemap_index.xml
Back to top

Comments

  • Global rules and wordpress roborts
  • -----------------
  • We're experimenting with blocking search results to prevent search result spam
  • Ban bots that don't benefit us.
  • --------------------------------
Back to top