vulkanstars.buzz
robots.txt
Robots Exclusion Standard data for vulkanstars.buzz
Resource Scan
Scan Details
Site Domain | vulkanstars.buzz |
Base Domain | vulkanstars.buzz |
Scan Status | Ok |
Last Scan | 2024-11-15T02:48:40+00:00 |
Next Scan | 2024-12-15T02:48:40+00:00 |
Last Scan
Scanned | 2024-11-15T02:48:40+00:00 |
URL | https://vulkanstars.buzz/robots.txt |
Domain IPs | 104.21.4.132, 172.67.132.28, 2606:4700:3033::6815:484, 2606:4700:3035::ac43:841c |
Response IP | 172.67.132.28 |
Found | Yes |
Hash | a8082991baa191893fc32fb5e2a261f444d618113afcb8ebb895eb627f59a538 |
SimHash | 4ca0deb063b2 |
Groups
*
Rule | Path |
---|---|
Disallow | /go |
Disallow | /go.php |
Disallow | /reg |
Disallow | /reg.php |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://vulkanstars.buzz/sitemap.xml |
Warnings
- `host` is not a known field.