netunia.net
robots.txt
Robots Exclusion Standard data for netunia.net
Resource Scan
Scan Details
Site Domain | netunia.net |
Base Domain | netunia.net |
Scan Status | Ok |
Last Scan | 2024-09-06T00:06:12+00:00 |
Next Scan | 2024-10-06T00:06:12+00:00 |
Last Scan
Scanned | 2024-09-06T00:06:12+00:00 |
URL | https://netunia.net/robots.txt |
Domain IPs | 149.56.242.136 |
Response IP | 149.56.242.136 |
Found | Yes |
Hash | 9499cea34d50842f7a87652335a5b3e114c2f37a3901ccf490a32cecf19b11bd |
SimHash | 10089d426621 |
Groups
*
Rule | Path |
---|---|
Disallow | /ajax/ |
Disallow | /phpmailer/ |
Disallow | /config/ |
Disallow | /paypal/ |
Disallow | /images/ |
Disallow | /signatures/ |
Disallow | /pot/ |
Disallow | /cache/ |
Disallow | /frameworks/ |
Allow | / |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Comments