primefocuslab.com
robots.txt

Robots Exclusion Standard data for primefocuslab.com

Resource Scan

Scan Details

Site Domain primefocuslab.com
Base Domain primefocuslab.com
Scan Status Ok
Last Scan2025-11-04T16:26:53+00:00
Next Scan 2025-12-04T16:26:53+00:00

Last Scan

Scanned2025-11-04T16:26:53+00:00
URL https://primefocuslab.com/robots.txt
Domain IPs 104.21.23.209, 172.67.213.165, 2606:4700:3030::ac43:d5a5, 2606:4700:3033::6815:17d1
Response IP 104.21.23.209
Found Yes
Hash 289c6dd0428be344df542b7eaf39c91874442a6659ce8a35e19d9a7bdc557941
SimHash 719f52f3cfb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

teoma
lexibot
the intraformant
propowerbot/2.14
erocrawler
webvac
mozilla/4
dittospyder
oracle ultra search
jetbot/1.0
dumbot
getright/4.2
netants
web image collector
rma
scooter
spankbot
nutch
mister pix
webster pro
httplib
xenu's link sleuth 1.1c
url_spider_pro
ahrefsbot
mozilla/4.0 (compatible; bullseye; windows 95)
semrushbot
bookmark search tool
emailsiphon
microsoft url control - 6.00.8169
jetbot
exabot
ia_archiver/1.6
teleport
blekkobot
repomonkey bait & tackle/v1.01
miixpc/4.2
zeus link scout
webstripper
stanford comp sci
mozilla/4.0 (compatible; msie 4.0; windows xp)
tocrawl/urldispatcher
telesoft
stanford
wget
mozilla/4.0 (compatible; msie 4.0; windows 2000)
hatena antenna
crescent
zeus
webbandit
mj12bot
openfind data gathere
psbot
iron33/1.0.2
es
gigabot
webmasterworld extractor
msiecrawler
larbin
queryn metasearch
copernic
http://www.searchengineworld.com bot
offline explorer
teleportpro
hloader
fairad client
perman
mozilla/4.0 (compatible; msie 4.0; windows nt)
naver
webzip
botalot
urly warning
thenomad
website quester
mozilla/4.0 (compatible; msie 4.0; windows 98)
szukacz/1.4
enterprise_search
turingos
moget
blexbot
alexibot
searchpreview
grub-client
infonavirobot
bunnyslippers
enterprise_search/1.0
looksmart
lnspiderguy
webzip/4.0
crescent internet toolpak http ole control v.1.0
vci webviewer vci webviewer win32
keyword density/0.9
wget/1.5.3
stanford compsciclub
harvest/1.5
flaming attackbot
kenjin spider
spanner
dotbot
linkscan/8.1a unix
mozilla/3
foobot
mozilla
builtbottough
moget/2.1
humanlinks
websauger
nicerspro
sootle
mozilla/5
suzuran
lwp-trivial
mozilla
miixpc
vci
cherrypickerse/1.0
cosmos
ia_archiver
linkextractorpro
rogerbot
cherrypicker
gaisbot
bullseye/1.0
backdoorbot/1.0
emailcollector
aqua_products
cherrypickerelite/1.0
jennybot
libweb/clshttp
webcopier
extractorpro
webmasterworldforumbot
stanford spiderboys
lwp-trivial/1.34
radiation retriever 1.1
microsoft url control - 5.01.4511
grub
python-urllib
blowfish/1.0
true_robot
webbandit/3.50
copyrightcheck
webauto
becomebot
webenhancer
netmechanic
mozilla/4.0 (compatible; msie 4.0; windows 95)
http://www.webmasterworld.com bot
www-collector-e
stanford compclub
repomonkey
linkwalker
openbot
asterias
sitesnagger
microsoft url control
cheesebot
wget/1.6
b2w/0.1
xenu's
emailwolf
prowebwalker
url control
zeus 32297 webster pro v2.9 win32
true_robot/1.0
openfind
mata hari

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.primefocuslab.com/sitemap_index.xml