pesjanar.si
robots.txt

Robots Exclusion Standard data for pesjanar.si

Resource Scan

Scan Details

Site Domain pesjanar.si
Base Domain pesjanar.si
Scan Status Ok
Last Scan2025-04-16T09:34:04+00:00
Next Scan 2025-04-23T09:34:04+00:00

Last Scan

Scanned2025-04-16T09:34:04+00:00
URL https://pesjanar.si/robots.txt
Domain IPs 104.21.65.226, 172.67.193.135, 2606:4700:3030::6815:41e2, 2606:4700:3037::ac43:c187
Response IP 104.21.65.226
Found Yes
Hash 73112bcae87b94c93324a04e31738629b3850b8406b11a7f629d82d8b9b86d6d
SimHash 011cd0c147b0

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

amazonbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /