wlaps.com
robots.txt

Robots Exclusion Standard data for wlaps.com

Resource Scan

Scan Details

Site Domain wlaps.com
Base Domain wlaps.com
Scan Status Ok
Last Scan2024-09-20T06:23:26+00:00
Next Scan 2024-09-27T06:23:26+00:00

Last Scan

Scanned2024-09-20T06:23:26+00:00
URL https://wlaps.com/robots.txt
Domain IPs 2001:41d0:1:1b00:213:186:33:19, 46.105.204.10
Response IP 46.105.204.10
Found Yes
Hash 9f10a6ee361dbff050beca83dc92e5c6a7364f8a64c234522230eb78c982956f
SimHash 421c5970e133

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
crawl-delay 5

grapeshotcrawler

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

stackoverflow

Rule Path
Disallow /

riddler

Rule Path
Disallow /

ru_bot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

tineye

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

sputnikbot/2.3

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

npbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.wlaps.com/sitemap_index.xml

Comments

  • Allow: /wp-admin/admin-ajax.php
  • Hits many times per second, not acceptable
  • http://www.nameprotect.com/botinfo.html