Log In Sign Up

valami.info
robots.txt

Robots Exclusion Standard data for valami.info

Resource Scan

Scan Details

Site Domain valami.info
Base Domain valami.info
Scan Status Ok
Last Scan2025-09-03T10:30:31+00:00
Next Scan 2025-09-10T10:30:31+00:00

Last Scan

Scanned2025-09-03T10:30:31+00:00
URL https://valami.info/robots.txt
Redirect https://holmivan.valami.info/robots.txt
Redirect Domain holmivan.valami.info
Redirect Base valami.info
Domain IPs 104.21.12.125, 172.67.194.126, 2606:4700:3030::6815:c7d, 2606:4700:3036::ac43:c27e
Redirect IPs 104.21.12.125, 172.67.194.126, 2606:4700:3030::6815:c7d, 2606:4700:3036::ac43:c27e
Response IP 104.21.12.125
Found Yes
Hash 58c719f29a85238cdb2326b538f3bc65f74b104da84ba961fc39b19fb31b6a17
SimHash 525dd900d038

Groups

yandex

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 10 specifies a 10 second timeout

mj12bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

megaindex.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15
Back to top

Warnings

  • 2 invalid lines.
Back to top