wetest.net
robots.txt

Robots Exclusion Standard data for wetest.net

Resource Scan

Scan Details

Site Domain wetest.net
Base Domain wetest.net
Scan Status Ok
Last Scan2024-05-18T15:58:23+00:00
Next Scan 2024-06-17T15:58:23+00:00

Last Scan

Scanned2024-05-18T15:58:23+00:00
URL https://wetest.net/robots.txt
Redirect https://www.wetest.net/robots.txt
Redirect Domain www.wetest.net
Redirect Base wetest.net
Domain IPs 43.130.30.232
Redirect IPs 43.156.255.145
Response IP 43.156.255.145
Found Yes
Hash bee6686673165ca9a06f7dec9549b62018822cf7697b7855069def235d5de0dc
SimHash d361d6fc8630

Groups

*

Rule Path
Disallow /cgi/
Disallow /pltfms/
Disallow /auth/
Disallow /apiv1/
Disallow /site/
Disallow /account/*
Disallow /app/
Disallow /apps/
Disallow /search*?*
Disallow /n/buy*?*
Disallow /dashboard/
Disallow /corp/
Disallow /documents/search?keyword=*
Disallow /n/console/
Disallow /n/auth/

almaden

Rule Path
Disallow /

aspseek

Rule Path
Disallow /

axmo

Rule Path
Disallow /

booch

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

downloader

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

expired domain sleuth

Rule Path
Disallow /

franklin locator

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

grub

Rule Path
Disallow /

hughcrawler

Rule Path
Disallow /

iaea.org

Rule Path
Disallow /

lcabotaccept

Rule Path
Disallow /

iconsurf

Rule Path
Disallow /

iltrovatore-setaccio

Rule Path
Disallow /

indy library

Rule Path
Disallow /

iupui

Rule Path
Disallow /

kittiecentral

Rule Path
Disallow /

iaea.org

Rule Path
Disallow /

larbin

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

metatagrobot

Rule Path
Disallow /

missigua locator

Rule Path
Disallow /

netresearchserver

Rule Path
Disallow /

nextgensearch

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

objectssearch

Rule Path
Disallow /

oracle ultra search

Rule Path
Disallow /

peerbot

Rule Path
Disallow /

pictureofinternet

Rule Path
Disallow /

plantynet

Rule Path
Disallow /

quepasacreep

Rule Path
Disallow /

scspider

Rule Path
Disallow /

soft411

Rule Path
Disallow /

spider.acont.de

Rule Path
Disallow /

sqworm

Rule Path
Disallow /

ssm agent

Rule Path
Disallow /

tamu

Rule Path
Disallow /

theusefulbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

tutorial crawler

Rule Path
Disallow /

tutorgig

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webzip

Rule Path
Disallow /

zipppbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

wget

Rule Path
Disallow /

mozdex

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

spyglassbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

digext

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.wetest.net/sitemap.xml