chooserator.com
robots.txt
Robots Exclusion Standard data for chooserator.com
Resource Scan
Scan Details
| Site Domain | chooserator.com |
| Base Domain | chooserator.com |
| Scan Status | Ok |
| Last Scan | 2025-06-23T15:22:43+00:00 |
| Next Scan | 2025-06-30T15:22:43+00:00 |
Last Scan
| Scanned | 2025-06-23T15:22:43+00:00 |
| URL | https://chooserator.com/robots.txt |
| Domain IPs | 104.21.8.58, 172.67.138.153, 2606:4700:3031::ac43:8a99, 2606:4700:3033::6815:83a |
| Response IP | 172.67.138.153 |
| Found | Yes |
| Hash | 722dc28686ff6e8825cbdbb673c6c5ee80ed0a1797cb99dfab4632c7a8080603 |
| SimHash | 96494b419915 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /blog/feed/ |
| Disallow | */go/ |
| Disallow | */go.php |
| Disallow | */walk.php |
| Disallow | *?mode=* |
| Allow | /pictures/ |
| Allow | /sitemap/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://chooserator.com/sitemap/sitemapindex.xml |