weedmaps.com
robots.txt
Robots Exclusion Standard data for weedmaps.com
Resource Scan
Scan Details
| Site Domain | weedmaps.com |
| Base Domain | weedmaps.com |
| Scan Status | Ok |
| Last Scan | 2024-11-08T22:02:32+00:00 |
| Next Scan | 2024-11-22T22:02:32+00:00 |
Last Scan
| Scanned | 2024-11-08T22:02:32+00:00 |
| URL | https://weedmaps.com/robots.txt |
| Domain IPs | 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133 |
| Response IP | 151.101.130.133 |
| Found | Yes |
| Hash | 145941fb3d57a64d2afcf716ede329b31e5304353bd5774961666a64df556060 |
| SimHash | 0e0de9e0cd10 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /user/* |
| Disallow | /users/* |
| Disallow | /auth/* |
| Disallow | /login*?* |
| Disallow | /signup*?* |
| Disallow | /listings/* |
| Disallow | /results?* |
| Disallow | */menu/* |
| Disallow | *?*search=* |
| Disallow | *?*filter |
| Disallow | *?*any_tags |
| Disallow | /*/cgi-bin/ |
| Disallow | /*/wp-admin/ |
| Disallow | /*/trackback/ |
| Disallow | /*/search/ |
| Disallow | /*/tag/ |
| Disallow | /*/category/ |
| Allow | /brands/category/ |
| Disallow | /*/uncategorized/ |
| Disallow | /learn/*/comment-page |
| Disallow | /learn/*/order/ |
| Disallow | /learn/*/feed/ |
| Disallow | /learn/*/xmlrpc.php |
| Disallow | /learn/*/trackback/ |
| Disallow | /learn/*?wptheme= |
| Disallow | /learn/*?comments= |
| Disallow | /learn/*?replytocom |
| Disallow | /learn/*?s= |
| Disallow | /learn/*%26s%3D |
| Disallow | /news/*/comment-page |
| Disallow | /news/*/page |
| Disallow | /news/*/order/ |
| Disallow | /news/*/feed/ |
| Disallow | /news/*/xmlrpc.php |
| Disallow | /news/*/trackback/ |
| Disallow | /news/*?wptheme= |
| Disallow | /news/*?comments= |
| Disallow | /news/*?replytocom |
| Disallow | /news/*?s= |
| Disallow | /news/*%26s%3D |
| Disallow | /openca/*/comment-page |
| Disallow | /openca/*/page |
| Disallow | /openca/*/order/ |
| Disallow | /openca/*/feed/ |
| Disallow | /openca/*/xmlrpc.php |
| Disallow | /openca/*/trackback/ |
| Disallow | /openca/*?wptheme= |
| Disallow | /openca/*?comments= |
| Disallow | /openca/*?replytocom |
| Disallow | /openca/*?s= |
| Disallow | /sports/*/comment-page |
| Disallow | /sports/*/page |
| Disallow | /sports/*/order/ |
| Disallow | /sports/*/feed/ |
| Disallow | /sports/*/xmlrpc.php |
| Disallow | /sports/*/trackback/ |
| Disallow | /sports/*?wptheme= |
| Disallow | /sports/*?comments= |
| Disallow | /sports/*?replytocom |
| Disallow | /sports/*?s= |
| Disallow | /verified/*/comment-page |
| Disallow | /verified/*/page |
| Disallow | /verified/*/order/ |
| Disallow | /verified/*/feed/ |
| Disallow | /verified/*/xmlrpc.php |
| Disallow | /verified/*/trackback/ |
| Disallow | /verified/*?wptheme= |
| Disallow | /verified/*?comments= |
| Disallow | /verified/*?replytocom |
| Disallow | /verified/*?s= |
| Disallow | /weedfacts/*/comment-page |
| Disallow | /weedfacts/*/page |
| Disallow | /weedfacts/*/order/ |
| Disallow | /weedfacts/*/feed/ |
| Disallow | /weedfacts/*/xmlrpc.php |
| Disallow | /weedfacts/*/trackback/ |
| Disallow | /weedfacts/*?wptheme= |
| Disallow | /weedfacts/*?comments= |
| Disallow | /weedfacts/*?replytocom |
| Disallow | /weedfacts/*?s= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://weedmaps.com/sitemap.xml.gz |
Warnings
- 1 invalid line.
Comments