stores-locator.com
robots.txt
Robots Exclusion Standard data for stores-locator.com
Resource Scan
Scan Details
Site Domain | stores-locator.com |
Base Domain | stores-locator.com |
Scan Status | Ok |
Last Scan | 2024-11-04T14:10:28+00:00 |
Next Scan | 2024-11-11T14:10:28+00:00 |
Last Scan
Scanned | 2024-11-04T14:10:28+00:00 |
URL | https://stores-locator.com/robots.txt |
Redirect | https://www.stores-locator.com/robots.txt |
Redirect Domain | www.stores-locator.com |
Redirect Base | stores-locator.com |
Domain IPs | 91.121.45.253 |
Redirect IPs | 91.121.45.253 |
Response IP | 91.121.45.253 |
Found | Yes |
Hash | 9759dacdb9f3b7d68420df97334fc89b5318c90d654d287dd2f96af2ee227beb |
SimHash | 0dca4d82c013 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /login |
Disallow | /index.php |
Disallow | /news/tag/* |
Disallow | /news/chainstores-* |
Disallow | /search/ |
Disallow | /add-a-store |
Disallow | /wp-login.php |
Disallow | /wp-admin |
Disallow | /api/xmlrpc |
Disallow | /*/api/xmlrpc |
Disallow | /.git/config |
Disallow | /*/.git/config |
Other Records
Field | Value |
---|---|
sitemap | https://www.stores-locator.com/sitemap.xml |
Comments