desertusa.com
robots.txt
Robots Exclusion Standard data for desertusa.com
Resource Scan
Scan Details
Site Domain | desertusa.com |
Base Domain | desertusa.com |
Scan Status | Ok |
Last Scan | 2024-11-11T00:22:00+00:00 |
Next Scan | 2024-11-18T00:22:00+00:00 |
Last Scan
Scanned | 2024-11-11T00:22:00+00:00 |
URL | https://desertusa.com/robots.txt |
Redirect | https://www.desertusa.com/robots.txt |
Redirect Domain | www.desertusa.com |
Redirect Base | desertusa.com |
Domain IPs | 200.69.25.171 |
Redirect IPs | 200.69.25.171 |
Response IP | 200.69.25.171 |
Found | Yes |
Hash | 2d5013b4fad0d9e0587247949624e15827a2726f1330aabf01fb959848ebc830 |
SimHash | 6875ed05e7d2 |
Groups
*
Rule | Path |
---|---|
Disallow | /stats/ |
Disallow | /mint/ |
Disallow | /includes/*.html |
Disallow | /includes-b/*.html |
Disallow | /includes-c/*.html |
Disallow | /includes_store/*.html |
Disallow | /cgi-bin/ |
Disallow | /ad_serving/*.html |
Disallow | /mb3/memberlist.php |
Disallow | /dusablog/wp-content/plugins/ |
Disallow | /dusablog/wp-admin/ |
Disallow | /stripe-php-5.2.2/ |
Disallow | /store2/ |
Disallow | /store/ |
Disallow | /vendor/ |
Disallow | /dusablog/wp-json/ |
Disallow | /mb3/search.php?* |
Disallow | /mb3/vendor/ |
Disallow | /mb3/phpbb/ |
Disallow | /APT/ |
Disallow | /DUSAstore/ |
Disallow | /web_cart/db/templates/ |
Disallow | /mb3/adm/ |
Disallow | /zarchive/ |
Disallow | /feed |
Disallow | /comments/feed |
Disallow | /feed/$ |
Disallow | /*/feed/$ |
Disallow | /*/feed/rss/$ |
Disallow | /*/trackback/$ |
Disallow | /*/*/feed/$ |
Disallow | /*/*/feed/rss/$ |
Disallow | /*/*/trackback/$ |
Disallow | /*/*/*/feed/$ |
Disallow | /*/*/*/feed/rss/$ |
Disallow | /*/*/*/trackback/$ |
Comments