gazetteller.com
robots.txt
Robots Exclusion Standard data for gazetteller.com
Resource Scan
Scan Details
| Site Domain | gazetteller.com |
| Base Domain | gazetteller.com |
| Scan Status | Ok |
| Last Scan | 2026-03-04T17:45:46+00:00 |
| Next Scan | 2026-03-11T17:45:46+00:00 |
Last Scan
| Scanned | 2026-03-04T17:45:46+00:00 |
| URL | https://gazetteller.com/robots.txt |
| Domain IPs | 104.21.63.142, 172.67.146.84, 2606:4700:3031::6815:3f8e, 2606:4700:3035::ac43:9254 |
| Response IP | 104.21.63.142 |
| Found | Yes |
| Hash | b31bafdd1f13bca1151ec51cfe71e03747ce3b0865c8800da4185e5137db041b |
| SimHash | e6010912e6b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-content/uploads/wc-logs/ |
| Disallow | /wp-content/uploads/woocommerce_transient_files/ |
| Disallow | /wp-content/uploads/woocommerce_uploads/ |
| Disallow | /*?add-to-cart= |
| Disallow | /*?*add-to-cart= |
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /xmlrpc.php |
| Disallow | /*/feed/ |
| Disallow | /*/comments/ |
| Disallow | */trackback |
| Disallow | /feed/ |
| Disallow | /comments/ |
| Disallow | /*? |
| Disallow | /wp-login.php |
| Disallow | *?s=* |
| Disallow | *?p=* |
| Disallow | *%26p%3D* |
| Disallow | *%26preview%3D* |
| Disallow | /taguri/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://gazetteller.com/sitemap.xml |
| sitemap | https://gazetteller.com/sitemap.rss |