gay-area.org
robots.txt
Robots Exclusion Standard data for gay-area.org
Resource Scan
Scan Details
| Site Domain | gay-area.org |
| Base Domain | gay-area.org |
| Scan Status | Ok |
| Last Scan | 2025-04-26T10:21:35+00:00 |
| Next Scan | 2025-05-26T10:21:35+00:00 |
Last Scan
| Scanned | 2025-04-26T10:21:35+00:00 |
| URL | https://gay-area.org/robots.txt |
| Domain IPs | 104.21.13.199, 172.67.157.82, 2606:4700:3030::6815:dc7, 2606:4700:3031::ac43:9d52 |
| Response IP | 104.21.13.199 |
| Found | Yes |
| Hash | 5b458240b924b37c6c6b6b7c8b9b9e2b667a6de38d19b0a3a23fc61f022dd60a |
| SimHash | ea5de5d49b11 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /shoutbox/ |
| Disallow | /bitbucket/ |
| Disallow | /css/ |
| Disallow | /addons/ |
| Disallow | /include/ |
| Disallow | /language/ |
| Disallow | /include/ |
| Disallow | /blocks/ |
| Disallow | /sql/ |
| Disallow | /style/ |
| Disallow | /upgrade/ |
| Disallow | /account.php |
| Disallow | /account_change.php |
| Disallow | /admincp.php |
| Disallow | /announce.php |
| Disallow | /badwords.txt |
| Disallow | /banners.txt |
| Disallow | /changelog.txt |
| Disallow | /comment.php |
| Disallow | /cookies.js |
| Disallow | /delete.php |
| Disallow | /edit.php |
| Disallow | /extra-stats.php |
| Disallow | /info.php |
| Disallow | /moresmiles.php |
| Disallow | /news.php |
| Disallow | /overlib.js |
| Disallow | /peers.php |
| Disallow | /readme.txt |
| Disallow | /recover.php |
| Disallow | /scrape.php |
| Disallow | /searchusers.php |
| Disallow | /spam.php |
| Disallow | /torrent_history.php |
| Disallow | /upload.php |
| Disallow | /usercp.php |
| Disallow | /userdetails.php |
| Disallow | /users.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://gay-torrents.org/sitemap/sitemap.php |
Comments