pwnews.net
robots.txt
Robots Exclusion Standard data for pwnews.net
Resource Scan
Scan Details
Site Domain | pwnews.net |
Base Domain | pwnews.net |
Scan Status | Ok |
Last Scan | 2024-06-28T16:06:28+00:00 |
Next Scan | 2024-07-05T16:06:28+00:00 |
Last Scan
Scanned | 2024-06-28T16:06:28+00:00 |
URL | https://pwnews.net/robots.txt |
Domain IPs | 213.174.157.151 |
Response IP | 213.174.157.151 |
Found | Yes |
Hash | aa3fb4d35bd79bb2f46868d63b63a6c5fbdc756ad5b2e5832cfc146424275a8b |
SimHash | 00d98d02f6b3 |
Groups
*
Rule | Path |
---|---|
Disallow | /a/ |
Disallow | /stat/ |
Disallow | /index/1 |
Disallow | /index/2 |
Disallow | /index/3 |
Disallow | /index/5 |
Disallow | /index/7 |
Disallow | /index/8 |
Disallow | /index/9 |
Disallow | /panel/ |
Disallow | /admin/ |
Disallow | /secure/ |
Disallow | /informer/ |
Disallow | /mchat |
Disallow | /search |
Disallow | /*0-*-0-17$ |
Disallow | /*-0-0- |
Disallow | /*? |
Disallow | /*-*-*-*-987$ |
Disallow | /*_escaped_fragment_ |
Disallow | /_uplvid |
Allow | /news/rssya_zen |
Allow | /blog/rssya_zen |
Allow | /*?page |
Allow | /*.js |
Allow | /*.css |
Allow | /*.jpg |
Allow | /*.png |
Allow | /*.gif |
Allow | /_nw/* |
Allow | /_ld/* |
Other Records
Field | Value |
---|---|
sitemap | https://pwnews.net/sitemap.xml |
sitemap | https://pwnews.net/sitemap-forum.xml |
Warnings
- `host` is not a known field.