wuanto.com
robots.txt

Robots Exclusion Standard data for wuanto.com

Resource Scan

Scan Details

Site Domain wuanto.com
Base Domain wuanto.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-11T02:05:21+00:00
Next Scan 2024-12-10T02:05:21+00:00

Last Successful Scan

Scanned2024-02-14T17:52:51+00:00
URL https://wuanto.com/robots.txt
Redirect https://www.wuanto.com/robots.txt
Redirect Domain www.wuanto.com
Redirect Base wuanto.com
Domain IPs 104.21.92.239, 172.67.200.31, 2606:4700:3033::6815:5cef, 2606:4700:3037::ac43:c81f
Redirect IPs 104.21.92.239, 172.67.200.31, 2606:4700:3033::6815:5cef, 2606:4700:3037::ac43:c81f
Response IP 104.21.92.239
Found Yes
Hash 1532b3b6acd7a613f33787906e49c8c64ffcb5927aa2d4f9189d824fbe3ca863
SimHash f6da5a40c5f1

Groups

*

Rule Path
Disallow /contact
Disallow /about-us
Disallow /policy
Disallow /go*
Disallow /bids/*
Disallow /nobids/*
Disallow /mostwatched/*
Disallow /sold/*
Disallow /search/*
Disallow /popularsearches.php

bingbot

No rules defined. All paths allowed.

unisterbot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

maxpoint.crawler

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

deusu

Rule Path
Disallow /

meds-online24.com

Rule Path
Disallow /

seoscanners

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

addthis.com

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

businessbot

Rule Path
Disallow /

bixolabs

Rule Path
Disallow /

discobot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

sindicebot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yahooseeker/m1a1-r2d2

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

Warnings

  • 5 invalid lines.