sunznx.is-programmer.com
robots.txt
Robots Exclusion Standard data for sunznx.is-programmer.com
Resource Scan
Scan Details
Site Domain | sunznx.is-programmer.com |
Base Domain | is-programmer.com |
Scan Status | Ok |
Last Scan | 2024-09-20T04:27:14+00:00 |
Next Scan | 2024-10-20T04:27:14+00:00 |
Last Scan
Scanned | 2024-09-20T04:27:14+00:00 |
URL | http://sunznx.is-programmer.com/robots.txt |
Domain IPs | 198.58.112.156 |
Response IP | 198.58.112.156 |
Found | Yes |
Hash | 939323c758875d1ed32ccc0374b6be98d031d471b89ec3e89df6c040b4add60f |
SimHash | 533ecca0eeb0 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /login |
Disallow | /comments/*/mark_as_spam.js |
Disallow | /simple_captcha/simple_captcha |
Other Records
Field | Value |
---|---|
crawl-delay | 200 |