nsmb.com
robots.txt
Robots Exclusion Standard data for nsmb.com
Resource Scan
Scan Details
| Site Domain | nsmb.com |
| Base Domain | nsmb.com |
| Scan Status | Ok |
| Last Scan | 2024-11-15T10:40:20+00:00 |
| Next Scan | 2024-11-22T10:40:20+00:00 |
Last Scan
| Scanned | 2024-11-15T10:40:20+00:00 |
| URL | https://nsmb.com/robots.txt |
| Domain IPs | 104.21.22.37, 172.67.202.109, 2606:4700:3030::6815:1625, 2606:4700:3033::ac43:ca6d |
| Response IP | 104.21.22.37 |
| Found | Yes |
| Hash | ae25525160272addcf4cd63cfcd79afe1a3e2456eb8090daa30d1c23344cd9e2 |
| SimHash | d01c4c82c291 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /search/ |
| Disallow | /messages/ |
| Disallow | /profile/ |
| Disallow | /forum/new/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Comments