forums.warptome.net
robots.txt
Robots Exclusion Standard data for forums.warptome.net
Resource Scan
Scan Details
| Site Domain | forums.warptome.net |
| Base Domain | warptome.net |
| Scan Status | Ok |
| Last Scan | 4/22/2025, 6:37:42 PM |
| Next Scan | 5/22/2025, 6:37:42 PM |
Last Scan
| Scanned | 4/22/2025, 6:37:42 PM |
| URL | https://forums.warptome.net/robots.txt |
| Domain IPs | 104.21.13.251, 172.67.133.144, 2606:4700:3030::ac43:8590, 2606:4700:3037::6815:dfb |
| Response IP | 104.21.13.251 |
| Found | Yes |
| Hash | 15cb30862cb8c7776c6127218eff467b9cb8cb180065609d0da00b06331cea6f |
| SimHash | 6b1efc56ef77 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search* |
*
| Rule | Path |
|---|---|
| Disallow | /index.php* |
*
| Rule | Path |
|---|---|
| Disallow | /profile* |
*
| Rule | Path |
|---|---|
| Disallow | /leaderboard* |
*
| Rule | Path |
|---|---|
| Disallow | /pastleaders* |
*
| Rule | Path |
|---|---|
| Disallow | /login* |
*
| Rule | Path |
|---|---|
| Disallow | /register* |
*
| Rule | Path |
|---|---|
| Disallow | /forum/register* |
*
| Rule | Path |
|---|---|
| Disallow | /online* |
*
| Rule | Path |
|---|---|
| Disallow | * |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://forums.warptome.net/sitemap.php |