podmultivs.net
robots.txt
Robots Exclusion Standard data for podmultivs.net
Resource Scan
Scan Details
| Site Domain | podmultivs.net |
| Base Domain | podmultivs.net |
| Scan Status | Ok |
| Last Scan | 2025-08-30T18:17:22+00:00 |
| Next Scan | 2025-09-29T18:17:22+00:00 |
Last Scan
| Scanned | 2025-08-30T18:17:22+00:00 |
| URL | https://podmultivs.net/robots.txt |
| Domain IPs | 104.21.58.76, 172.67.202.26, 2606:4700:3030::ac43:ca1a, 2606:4700:3034::6815:3a4c |
| Response IP | 172.67.202.26 |
| Found | Yes |
| Hash | 8b68e38fd571379a71af49fdcac0fb57a482553f083467b6ed8d4f8799d6a4b2 |
| SimHash | 63be52fbe791 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /cart/ |
| Disallow | /checkout/ |
| Disallow | /my-account/ |
| Disallow | /add-to-cart/ |
| Disallow | /wc-ajax/ |
| Disallow | /order-received/ |
| Disallow | /view-order/ |
| Disallow | /search/ |
| Disallow | /xmlrpc.php |
| Disallow | /wp-json/ |
| Disallow | /feed/ |
| Disallow | /product-feed/ |
| Disallow | /?s= |
| Disallow | /*?add-to-cart= |
| Disallow | /*?orderby= |
| Disallow | /*?order= |
| Disallow | /*?min_price= |
| Disallow | /*?max_price= |
| Disallow | /*?rating_filter= |
| Disallow | /*?session= |
| Disallow | /*?paged= |
| Disallow | /*?page= |
| Disallow | /*filter_ |
| Allow | /product/ |
| Allow | /product-category/ |
| Disallow | /product-category/*?paged= |
| Disallow | /product-category/*?orderby= |
| Disallow | /product-tag/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-content/uploads/ |
| Allow | /wp-content/plugins/*.css |
| Allow | /wp-content/plugins/*.js |
| Allow | /wp-content/themes/*.css |
| Allow | /wp-content/themes/*.js |
blexbot
wget/1.6
wget/1.5.3
fairad client
url_spider_pro
mozilla
turingos
python-urllib
teleport
stanford comp sci
grub-client
webbandit/3.50
ia_archiver/1.6
propowerbot/2.14
naver
repomonkey
mozilla/4.0 (compatible; msie 4.0; windows 2000)
spankbot
webzip
moget/2.1
gigabot
xenu's link sleuth 1.1c
spanner
netmechanic
cheesebot
zeus 32297 webster pro v2.9 win32
jetbot
mozilla/4.0 (compatible; msie 4.0; windows 98)
sootle
webcopier
lnspiderguy
mozilla/4.0 (compatible; bullseye; windows 95)
copyrightcheck
mozilla
emailwolf
keyword density/0.9
webmasterworld extractor
cherrypickerse/1.0
moget
es
webster pro
extractorpro
microsoft url control - 5.01.4511
openfind
exabot
hatena antenna
psbot
thenomad
ahrefsbot
http://www.searchengineworld.com bot
rogerbot
suzuran
www-collector-e
emailcollector
perman
webauto
getright/4.2
mozilla/4
vci webviewer vci webviewer win32
xenu's
ia_archiver
backdoorbot/1.0
jetbot/1.0
humanlinks
webenhancer
dittospyder
harvest/1.5
teleportpro
rma
becomebot
mozilla/3
scooter
true_robot
aqua_products
b2w/0.1
botalot
webmasterworldforumbot
linkscan/8.1a unix
enterprise_search/1.0
copernic
flaming attackbot
cosmos
nicerspro
openbot
microsoft url control
emailsiphon
grub
stanford compclub
teoma
kenjin spider
foobot
true_robot/1.0
lexibot
stanford
cherrypickerelite/1.0
msiecrawler
oracle ultra search
mozilla/5
linkwalker
larbin
zeus link scout
stanford spiderboys
alexibot
crescent
blekkobot
mister pix
website quester
searchpreview
http://www.webmasterworld.com bot
wget
crescent internet toolpak http ole control v.1.0
web image collector
lwp-trivial/1.34
cherrypicker
queryn metasearch
nutch
mata hari
dotbot
bookmark search tool
the intraformant
tocrawl/urldispatcher
gaisbot
webbandit
repomonkey bait & tackle/v1.01
miixpc/4.2
bullseye/1.0
builtbottough
enterprise_search
blowfish/1.0
asterias
lwp-trivial
dumbot
iron33/1.0.2
zeus
jennybot
vci
url control
hloader
mozilla/4.0 (compatible; msie 4.0; windows 95)
erocrawler
bunnyslippers
libweb/clshttp
radiation retriever 1.1
microsoft url control - 6.00.8169
offline explorer
mj12bot
stanford compsciclub
linkextractorpro
mozilla/4.0 (compatible; msie 4.0; windows xp)
szukacz/1.4
sitesnagger
prowebwalker
netants
infonavirobot
telesoft
webzip/4.0
websauger
miixpc
httplib
webstripper
webvac
urly warning
mozilla/4.0 (compatible; msie 4.0; windows nt)
openfind data gatherer
looksmart
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://podmultivs.net/sitemap.xml |
Comments