oferlo.rs
robots.txt

Robots Exclusion Standard data for oferlo.rs

Resource Scan

Scan Details

Site Domain oferlo.rs
Base Domain oferlo.rs
Scan Status Ok
Last Scan2024-09-30T00:28:40+00:00
Next Scan 2024-10-07T00:28:40+00:00

Last Scan

Scanned2024-09-30T00:28:40+00:00
URL https://oferlo.rs/robots.txt
Redirect https://www.oferlo.rs/robots.txt
Redirect Domain www.oferlo.rs
Redirect Base oferlo.rs
Domain IPs 77.91.72.156
Redirect IPs 77.91.72.156
Response IP 77.91.72.156
Found Yes
Hash 8375c40538292442ca6709b7b71b45d8e6335134364c7b1fabdd8254be4d758a
SimHash da284854edb2

Groups

*

Rule Path
Disallow /api/
Disallow /site/
Disallow /exit/
Disallow /brochure/brochure-page/
Disallow */?login-token=
Disallow */user-admin/*
Disallow */nove-heslo/
Disallow */?page=
Disallow */offers/*
Disallow */detail/*
Disallow /27957108/*
Disallow /js/joined/bub.min.js

Other Records

Field Value
sitemap https://www.oferlo.rs/sitemap_index.xml