bkv-jaratok.altalanos.info
robots.txt

Robots Exclusion Standard data for bkv-jaratok.altalanos.info

Resource Scan

Scan Details

Site Domain bkv-jaratok.altalanos.info
Base Domain altalanos.info
Scan Status Ok
Last Scan2024-11-07T12:41:57+00:00
Next Scan 2024-11-21T12:41:57+00:00

Last Scan

Scanned2024-11-07T12:41:57+00:00
URL https://bkv-jaratok.altalanos.info/robots.txt
Domain IPs 151.101.1.195, 151.101.65.195
Response IP 151.101.65.195
Found Yes
Hash aa84ebb80fce92f644828cf640f57dfe2972bca0bfdedfb109dc5b92dddb11e9
SimHash 315cd81041b4

Groups

mj12bot

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Warnings

  • 2 invalid lines.