oferlo.rs
robots.txt
Robots Exclusion Standard data for oferlo.rs
Resource Scan
Scan Details
Site Domain | oferlo.rs |
Base Domain | oferlo.rs |
Scan Status | Ok |
Last Scan | 2024-09-30T00:28:40+00:00 |
Next Scan | 2024-10-07T00:28:40+00:00 |
Last Scan
Scanned | 2024-09-30T00:28:40+00:00 |
URL | https://oferlo.rs/robots.txt |
Redirect | https://www.oferlo.rs/robots.txt |
Redirect Domain | www.oferlo.rs |
Redirect Base | oferlo.rs |
Domain IPs | 77.91.72.156 |
Redirect IPs | 77.91.72.156 |
Response IP | 77.91.72.156 |
Found | Yes |
Hash | 8375c40538292442ca6709b7b71b45d8e6335134364c7b1fabdd8254be4d758a |
SimHash | da284854edb2 |
Groups
*
Rule | Path |
---|---|
Disallow | /api/ |
Disallow | /site/ |
Disallow | /exit/ |
Disallow | /brochure/brochure-page/ |
Disallow | */?login-token= |
Disallow | */user-admin/* |
Disallow | */nove-heslo/ |
Disallow | */?page= |
Disallow | */offers/* |
Disallow | */detail/* |
Disallow | /27957108/* |
Disallow | /js/joined/bub.min.js |
Other Records
Field | Value |
---|---|
sitemap | https://www.oferlo.rs/sitemap_index.xml |