rusisrael.org
robots.txt
Robots Exclusion Standard data for rusisrael.org
Resource Scan
Scan Details
Site Domain | rusisrael.org |
Base Domain | rusisrael.org |
Scan Status | Ok |
Last Scan | 2024-11-12T20:39:33+00:00 |
Next Scan | 2024-11-19T20:39:33+00:00 |
Last Scan
Scanned | 2024-11-12T20:39:33+00:00 |
URL | https://rusisrael.org/robots.txt |
Domain IPs | 3.248.14.149, 34.247.98.113 |
Response IP | 34.247.98.113 |
Found | Yes |
Hash | 8a3a3b687c2122dd4b166cfbc855b6cf353b163ced048a09a33e3d3aaeceef1c |
SimHash | 8d18d643d732 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /?action= |
Allow | /?action=landing* |
Disallow | /*/?genre |
Disallow | /?tid= |
Disallow | /r/ |
Other Records
Field | Value |
---|---|
sitemap | https://rusisrael.org/sitemap.xml.gz |
sitemap | https://rusisrael.org/sitemap.xml.gz |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.