Log In Sign Up

wakwb.com
robots.txt

Robots Exclusion Standard data for wakwb.com

Resource Scan

Scan Details

Site Domain wakwb.com
Base Domain wakwb.com
Scan Status Ok
Last Scan2024-10-04T23:56:30+00:00
Next Scan 2024-10-11T23:56:30+00:00

Last Scan

Scanned2024-10-04T23:56:30+00:00
URL https://wakwb.com/robots.txt
Domain IPs 104.21.90.104, 172.67.199.218, 2606:4700:3030::6815:5a68, 2606:4700:3031::ac43:c7da
Response IP 172.67.199.218
Found Yes
Hash 5d40a11bb1f78fa46a1cd36968dbc275bc003d56b3a24102311d9092a5e3cc16
SimHash d2144351bf9f

Groups

criteobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

wordpress

Rule Path
Disallow /

datanyze

Rule Path
Disallow /

woorankreview

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

bpimagewalker

Rule Path
Disallow /

sabsimbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

slurpchina

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.wakwb.com/sitemap.xml
Back to top

Warnings

  • 2 invalid lines.
Back to top