dienoshoroskopai.lt
robots.txt

Robots Exclusion Standard data for dienoshoroskopai.lt

Resource Scan

Scan Details

Site Domain dienoshoroskopai.lt
Base Domain dienoshoroskopai.lt
Scan Status Ok
Last Scan2024-10-27T15:48:49+00:00
Next Scan 2024-11-03T15:48:49+00:00

Last Scan

Scanned2024-10-27T15:48:49+00:00
URL https://dienoshoroskopai.lt/robots.txt
Domain IPs 104.21.41.44, 172.67.159.244, 2606:4700:3032::6815:292c, 2606:4700:3033::ac43:9ff4
Response IP 104.21.41.44
Found Yes
Hash 2d224a2f8e15dbaf28392bdecb8d32c6c4198beeddb36a16a44cc3f2cd7520de
SimHash 6558dc54e513

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://dienoshoroskopai.lt/sitemap.xml