top-catalogues.sg
robots.txt
Robots Exclusion Standard data for top-catalogues.sg
Resource Scan
Scan Details
| Site Domain | top-catalogues.sg |
| Base Domain | top-catalogues.sg |
| Scan Status | Ok |
| Last Scan | 2024-09-20T18:25:41+00:00 |
| Next Scan | 2024-09-27T18:25:41+00:00 |
Last Scan
| Scanned | 2024-09-20T18:25:41+00:00 |
| URL | https://top-catalogues.sg/robots.txt |
| Domain IPs | 104.21.75.67, 172.67.215.254, 2606:4700:3030::6815:4b43, 2606:4700:3035::ac43:d7fe |
| Response IP | 104.21.75.67 |
| Found | Yes |
| Hash | 65f10a7cfa43c176d7d4549f63a537a96ab26d435371482a1d193c37a3df7494 |
| SimHash | 00455cb48913 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /n/* |
| Disallow | *taghash* |
| Disallow | *cutterhash* |
| Disallow | *open-street-map* |
| Disallow | /user* |
| Disallow | *?*hash=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://top-catalogues.sg/sitemap-index.xml |