webtaja.rs
robots.txt

Robots Exclusion Standard data for webtaja.rs

Resource Scan

Scan Details

Site Domain webtaja.rs
Base Domain webtaja.rs
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-11T02:06:08+00:00
Next Scan 2025-09-09T02:06:08+00:00

Last Successful Scan

Scanned2025-04-19T23:37:45+00:00
URL https://webtaja.rs/robots.txt
Domain IPs 45.80.132.60
Response IP 45.80.132.60
Found Yes
Hash b82ea10c6c9a11c606ae9c31b6ba186ef91ba557dd51c7fd9219f4b7678232f8
SimHash 4e0cf0d1aa3f

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://xn--cvrak-jya.rs/ironicalnessevy.xml
sitemap https://xn--cvrak-jya.rs/companiedvhq.xml
sitemap https://xn--cvrak-jya.rs/splashedjjc.xml
sitemap https://xn--cvrak-jya.rs/cherinxge.xml
sitemap https://xn--cvrak-jya.rs/hashimjfp.xml
sitemap https://xn--cvrak-jya.rs/clingrascalroj.xml
sitemap https://xn--cvrak-jya.rs/selfwinexvn.xml
sitemap https://xn--cvrak-jya.rs/kibbalbsv.xml
sitemap https://xn--cvrak-jya.rs/semitoneonb.xml
sitemap https://xn--cvrak-jya.rs/aplacophoranooy.xml
sitemap https://xn--cvrak-jya.rs/benzanthroneuhm.xml
sitemap https://xn--cvrak-jya.rs/patriarchedvxs.xml
sitemap https://xn--cvrak-jya.rs/salomoniajgf.xml
sitemap https://xn--cvrak-jya.rs/poutyhkz.xml
sitemap https://xn--cvrak-jya.rs/meuserxkl.xml
sitemap https://xn--cvrak-jya.rs/sitemap.xml