krokodil.rs
robots.txt
Robots Exclusion Standard data for krokodil.rs
Resource Scan
Scan Details
Site Domain | krokodil.rs |
Base Domain | krokodil.rs |
Scan Status | Ok |
Last Scan | 2024-11-06T04:44:12+00:00 |
Next Scan | 2024-12-06T04:44:12+00:00 |
Last Scan
Scanned | 2024-11-06T04:44:12+00:00 |
URL | https://krokodil.rs/robots.txt |
Redirect | https://www.krokodil.rs/robots.txt |
Redirect Domain | www.krokodil.rs |
Redirect Base | krokodil.rs |
Domain IPs | 2a02:250:0:8::53, 93.188.2.51 |
Redirect IPs | 2a02:250:0:8::53, 93.188.2.51 |
Response IP | 93.188.2.51 |
Found | Yes |
Hash | 85a8a43c4fdd6e2386260bc35efacf7ad2b6798686f4565020ace00f9609c17b |
SimHash | c30098008992 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
*
Rule | Path |
---|---|
Disallow | /wp-content/uploads/wpo-plugins-tables-list.json |
Other Records
Field | Value |
---|---|
sitemap | https://www.krokodil.rs/wp-sitemap.xml |