nerdbot.com
robots.txt
Robots Exclusion Standard data for nerdbot.com
Resource Scan
Scan Details
| Site Domain | nerdbot.com |
| Base Domain | nerdbot.com |
| Scan Status | Ok |
| Last Scan | 2024-10-03T05:14:26+00:00 |
| Next Scan | 2024-10-10T05:14:26+00:00 |
Last Scan
| Scanned | 2024-10-03T05:14:26+00:00 |
| URL | https://nerdbot.com/robots.txt |
| Domain IPs | 104.21.10.126, 172.67.190.39, 2606:4700:3034::6815:a7e, 2606:4700:3036::ac43:be27 |
| Response IP | 104.21.10.126 |
| Found | Yes |
| Hash | 4048c8bf73cdd6e8ce8d0b2e7145b8f42c5fe10c79a282071d867bd8372c713b |
| SimHash | d8095c408d93 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://nerdbot.com/sitemap_index.xml |