discordbotlist.com
robots.txt
Robots Exclusion Standard data for discordbotlist.com
Resource Scan
Scan Details
| Site Domain | discordbotlist.com |
| Base Domain | discordbotlist.com |
| Scan Status | Ok |
| Last Scan | 2024-10-28T07:16:10+00:00 |
| Next Scan | 2024-11-04T07:16:10+00:00 |
Last Scan
| Scanned | 2024-10-28T07:16:10+00:00 |
| URL | https://discordbotlist.com/robots.txt |
| Domain IPs | 104.26.10.203, 104.26.11.203, 172.67.73.81, 2606:4700:20::681a:acb, 2606:4700:20::681a:bcb, 2606:4700:20::ac43:4951 |
| Response IP | 172.67.73.81 |
| Found | Yes |
| Hash | 47761dd3995fa528756d124c07d9a454078cf10471d575eb6c7033b888bf62f8 |
| SimHash | 6fb5b864ee92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /callback |
| Disallow | /callback-bot |
| Disallow | /servers/mine |
| Disallow | /users/* |
| Disallow | /auth |
| Disallow | /search |
| Disallow | /bots/*/report |
| Disallow | /servers/*/join |
Other Records
| Field | Value |
|---|---|
| sitemap | https://discordbotlist.com/sitemap.xml |