anglija.lt
robots.txt

Robots Exclusion Standard data for anglija.lt

Resource Scan

Scan Details

Site Domain anglija.lt
Base Domain anglija.lt
Scan Status Ok
Last Scan2024-05-20T20:56:37+00:00
Next Scan 2024-05-27T20:56:37+00:00

Last Scan

Scanned2024-05-20T20:56:37+00:00
URL https://anglija.lt/robots.txt
Redirect https://www.anglija.lt/robots.txt
Redirect Domain www.anglija.lt
Redirect Base anglija.lt
Domain IPs 13.35.121.119, 13.35.121.48, 13.35.121.59, 13.35.121.67
Redirect IPs 18.173.121.111, 18.173.121.114, 18.173.121.49, 18.173.121.50
Response IP 108.157.60.46
Found Yes
Hash 76a484b61339547755e01338126a0c0e663bdfd5bca464d2d7a9c0ecc2847f5c
SimHash bb548f454755

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.anglija.lt/sitemap.xml

Comments

  • Robots.txt file
  • All robots will spider the domain