reisijuht.ee
robots.txt

Robots Exclusion Standard data for reisijuht.ee

Resource Scan

Scan Details

Site Domain reisijuht.ee
Base Domain reisijuht.ee
Scan Status Ok
Last Scan2024-05-24T23:50:27+00:00
Next Scan 2024-05-31T23:50:27+00:00

Last Scan

Scanned2024-05-24T23:50:27+00:00
URL https://reisijuht.ee/robots.txt
Redirect https://reisijuht.delfi.ee/robots.txt
Redirect Domain reisijuht.delfi.ee
Redirect Base delfi.ee
Domain IPs 185.20.100.192, 185.20.100.193, 185.20.100.194, 185.20.100.195
Redirect IPs 104.22.74.73, 104.22.75.73, 172.67.28.62
Response IP 172.67.28.62
Found Yes
Hash 69628bf181aacebe28e68144e3bde8e175f5e9cdd1e5303c2a7d3a02c5cd768a
SimHash 7908ba49ce03

Groups

*

Rule Path
Allow /
Disallow /search?*
Disallow /otsing?*
Disallow /poisk?*
Disallow /*comments
Disallow /*kommentaarid
Disallow /*kommentarii
Disallow /*%26utm_source%3Dfeedburner*
Disallow /*promotions/*/click
Disallow /*%26com%3D*
Disallow /*mailto%3Ainfo%40delfi.ee
Disallow /*common/survey*
Disallow *admp-tc.delfi.ee*

Other Records

Field Value
sitemap https://reisijuht.delfi.ee/sitemap/index.xml