nflbox.me
robots.txt
Robots Exclusion Standard data for nflbox.me
Resource Scan
Scan Details
Site Domain | nflbox.me |
Base Domain | nflbox.me |
Scan Status | Ok |
Last Scan | 2024-11-06T04:46:04+00:00 |
Next Scan | 2024-11-13T04:46:04+00:00 |
Last Scan
Scanned | 2024-11-06T04:46:04+00:00 |
URL | https://nflbox.me/robots.txt |
Domain IPs | 2803:c660:1000:2508::6029, 2803:c660:1000:73::114, 2803:c660:2000:1740::6014, 45.178.5.196, 45.178.6.105 |
Response IP | 45.178.5.196 |
Found | Yes |
Hash | 14f9a3d2581eabe094b4d52d4a161c3bdfb5519ffc7e3a597979e56917dddd11 |
SimHash | 6900dc14e493 |
Groups
*
Rule | Path |
---|---|
Disallow | /partytown |
Disallow |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://nflbox.me/sitemap.xml |