jakubsteiner.webnode.sk
robots.txt

Robots Exclusion Standard data for jakubsteiner.webnode.sk

Resource Scan

Scan Details

Site Domain jakubsteiner.webnode.sk
Base Domain webnode.sk
Scan Status Ok
Last Scan2024-09-24T20:52:03+00:00
Next Scan 2024-10-24T20:52:03+00:00

Last Scan

Scanned2024-09-24T20:52:03+00:00
URL https://jakubsteiner.webnode.sk/robots.txt
Domain IPs 18.185.25.67, 3.79.173.192
Response IP 18.185.25.67
Found Yes
Hash fd66cad962eb0f686f05af04aa48c5ef21726cb0996e89c2e5a863866b3913a6
SimHash 6c5cd8108353

Groups

psbot

Rule Path
Disallow /

*

Rule Path
Disallow /servers/frontend/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap http://jakubsteiner.webnode.sk/sitemap.xml