tevudarzelis.lt
robots.txt
Robots Exclusion Standard data for tevudarzelis.lt
Resource Scan
Scan Details
Site Domain | tevudarzelis.lt |
Base Domain | tevudarzelis.lt |
Scan Status | Ok |
Last Scan | 2024-11-02T07:07:41+00:00 |
Next Scan | 2024-11-09T07:07:41+00:00 |
Last Scan
Scanned | 2024-11-02T07:07:41+00:00 |
URL | https://tevudarzelis.lt/robots.txt |
Redirect | https://www.tevu-darzelis.lt/robots.txt |
Redirect Domain | www.tevu-darzelis.lt |
Redirect Base | tevu-darzelis.lt |
Domain IPs | 104.21.37.139, 172.67.209.39, 2606:4700:3033::ac43:d127, 2606:4700:3034::6815:258b |
Redirect IPs | 104.26.8.131, 104.26.9.131, 172.67.73.156, 2606:4700:20::681a:883, 2606:4700:20::681a:983, 2606:4700:20::ac43:499c |
Response IP | 172.67.73.156 |
Found | Yes |
Hash | cc2ba4e96b49369ad1d90d56e7cbeeb1d59e5f8cf47871daa4a37376ab0099dd |
SimHash | 69248c048a92 |
Groups
*
Rule | Path |
---|---|
Disallow | /ads/ |
Disallow | /nestumas/data/ |
Disallow | /skaiciuokles/data/ |
Disallow | /vaiku-vardai/data/babyname_graph.php |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.tevu-darzelis.lt/sitemap/sitemap.xml |