tomtop.com
robots.txt

Robots Exclusion Standard data for tomtop.com

Resource Scan

Scan Details

Site Domain tomtop.com
Base Domain tomtop.com
Scan Status Ok
Last Scan2024-05-18T02:34:18+00:00
Next Scan 2024-06-01T02:34:18+00:00

Last Scan

Scanned2024-05-18T02:34:18+00:00
URL https://tomtop.com/robots.txt
Redirect https://www.tomtop.com/robots.txt
Redirect Domain www.tomtop.com
Redirect Base tomtop.com
Domain IPs 52.25.255.25, 52.38.247.116
Redirect IPs 52.25.255.25, 52.38.247.116
Response IP 52.25.255.25
Found Yes
Hash ba04df8d3fc096a342c834fa3aab7893ee1152d9cb0c31f947e971e63b52e84e
SimHash d73997fcc671

Groups

*

Rule Path
Disallow */electronic-cigarettes-290702/
Disallow */atomizers-290703/
Disallow */apor-accessories-290704/
Disallow */apor-kits-290705/
Disallow */apor-mods-290706/
Disallow /cart*
Disallow /checkout*
Disallow /member*
Disallow /payment*
Disallow /sysadmin*
Disallow /fb*
Disallow /paypal*
Disallow /google*
Disallow /affiliate/
Disallow /*/base/cms/

neevabot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

molokaibot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

almaden

Rule Path
Disallow /

aspseek

Rule Path
Disallow /

axmo

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

booch

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

downloader

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

expired domain sleuth

Rule Path
Disallow /

franklin locator

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

grub

Rule Path
Disallow /

hughcrawler

Rule Path
Disallow /

iaea.org

Rule Path
Disallow /

lcabotaccept

Rule Path
Disallow /

iconsurf

Rule Path
Disallow /

iltrovatore-setaccio

Rule Path
Disallow /

indy library

Rule Path
Disallow /

iupui

Rule Path
Disallow /

kittiecentral

Rule Path
Disallow /

iaea.org

Rule Path
Disallow /

larbin

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

metatagrobot

Rule Path
Disallow /

missigua locator

Rule Path
Disallow /

netresearchserver

Rule Path
Disallow /

nextgensearch

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

objectssearch

Rule Path
Disallow /

oracle ultra search

Rule Path
Disallow /

peerbot

Rule Path
Disallow /

pictureofinternet

Rule Path
Disallow /

plantynet

Rule Path
Disallow /

quepasacreep

Rule Path
Disallow /

scspider

Rule Path
Disallow /

soft411

Rule Path
Disallow /

spider.acont.de

Rule Path
Disallow /

sqworm

Rule Path
Disallow /

ssm agent

Rule Path
Disallow /

tamu

Rule Path
Disallow /

theusefulbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

tutorial crawler

Rule Path
Disallow /

tutorgig

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webzip

Rule Path
Disallow /

zipppbot

Rule Path
Disallow /

xenu

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

wget

Rule Path
Disallow /

mozdex

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.tomtop.com/sitemap.xml