smjestaj24.com
robots.txt

Robots Exclusion Standard data for smjestaj24.com

Resource Scan

Scan Details

Site Domain smjestaj24.com
Base Domain smjestaj24.com
Scan Status Ok
Last Scan2024-05-31T19:58:54+00:00
Next Scan 2024-06-07T19:58:54+00:00

Last Scan

Scanned2024-05-31T19:58:54+00:00
URL https://smjestaj24.com/robots.txt
Domain IPs 104.21.51.208, 172.67.185.228, 2606:4700:3032::ac43:b9e4, 2606:4700:3035::6815:33d0
Response IP 104.21.51.208
Found Yes
Hash 57d5c8d512b2c142f4d0f32d8f242e53cef6d80c66207afc3af00080a82dad26
SimHash 4b08c8d2c733

Groups

*

Rule Path
Allow /

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap /sitemap-categories.xml
sitemap /sitemap-objects.xml
sitemap /sitemap-objects-2.xml