Log In Sign Up

verkami.com
robots.txt

Robots Exclusion Standard data for verkami.com

Resource Scan

Scan Details

Site Domain verkami.com
Base Domain verkami.com
Scan Status Ok
Last Scan2024-06-21T18:55:47+00:00
Next Scan 2024-07-05T18:55:47+00:00

Last Scan

Scanned2024-06-21T18:55:47+00:00
URL https://verkami.com/robots.txt
Domain IPs 104.26.10.88, 104.26.11.88, 172.67.70.213, 2606:4700:20::681a:a58, 2606:4700:20::681a:b58, 2606:4700:20::ac43:46d5
Response IP 172.67.70.213
Found Yes
Hash 3054fbcfe0ff6a63ff8118499b9501cb2babb8bddc622bed5ec53193002eb2fe
SimHash 929d2d856450

Groups

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /
Back to top