modernpathshala.com
robots.txt
Robots Exclusion Standard data for modernpathshala.com
Resource Scan
Scan Details
| Site Domain | modernpathshala.com |
| Base Domain | modernpathshala.com |
| Scan Status | Ok |
| Last Scan | 2025-10-14T17:06:18+00:00 |
| Next Scan | 2025-11-13T17:06:18+00:00 |
Last Scan
| Scanned | 2025-10-14T17:06:18+00:00 |
| URL | https://modernpathshala.com/robots.txt |
| Domain IPs | 104.21.95.14, 172.67.169.38, 2606:4700:3031::6815:5f0e, 2606:4700:3034::ac43:a926 |
| Response IP | 172.67.169.38 |
| Found | Yes |
| Hash | 1bedc21609120910c036d71985b1efd9f62e6082d2faa47ebdc8a6f22d670d2d |
| SimHash | 719f52f3cfb2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
es
xenu's
erocrawler
radiation retriever 1.1
spankbot
stanford
asterias
cosmos
cherrypickerelite/1.0
builtbottough
sootle
vci webviewer vci webviewer win32
dumbot
jetbot/1.0
flaming attackbot
libweb/clshttp
emailwolf
mozilla/4.0 (compatible; msie 4.0; windows xp)
python-urllib
repomonkey bait & tackle/v1.01
www-collector-e
webstripper
xenu's link sleuth 1.1c
cherrypicker
naver
vci
http://www.searchengineworld.com bot
mozilla
botalot
webzip
searchpreview
cheesebot
ahrefsbot
emailcollector
becomebot
wget/1.6
teleport
msiecrawler
backdoorbot/1.0
rma
keyword density/0.9
copernic
openfind
openbot
webster pro
mozilla/3
prowebwalker
ia_archiver/1.6
the intraformant
mozilla/4.0 (compatible; msie 4.0; windows 98)
stanford compsciclub
cherrypickerse/1.0
copyrightcheck
repomonkey
b2w/0.1
wget
looksmart
kenjin spider
queryn metasearch
mozilla/4.0 (compatible; msie 4.0; windows 2000)
webbandit/3.50
semrushbot
ia_archiver
webcopier
oracle ultra search
bookmark search tool
websauger
true_robot
crescent
url control
fairad client
true_robot/1.0
hloader
website quester
stanford compclub
crescent internet toolpak http ole control v.1.0
bullseye/1.0
httplib
jetbot
propowerbot/2.14
enterprise_search/1.0
linkextractorpro
blowfish/1.0
mozilla/4.0 (compatible; msie 4.0; windows nt)
zeus link scout
mj12bot
turingos
webauto
stanford comp sci
spanner
humanlinks
webvac
dotbot
mozilla/5
zeus 32297 webster pro v2.9 win32
zeus
rogerbot
telesoft
wget/1.5.3
dittospyder
webmasterworld extractor
blekkobot
tocrawl/urldispatcher
lexibot
grub-client
teoma
hatena antenna
webmasterworldforumbot
lnspiderguy
webzip/4.0
scooter
miixpc
mister pix
linkscan/8.1a unix
netants
perman
exabot
grub
iron33/1.0.2
gaisbot
microsoft url control - 5.01.4511
offline explorer
szukacz/1.4
nicerspro
psbot
suzuran
nutch
jennybot
mozilla
enterprise_search
lwp-trivial/1.34
webenhancer
foobot
blexbot
extractorpro
emailsiphon
urly warning
openfind data gathere
aqua_products
mozilla/4
harvest/1.5
web image collector
moget
infonavirobot
http://www.webmasterworld.com bot
lwp-trivial
bunnyslippers
stanford spiderboys
mozilla/4.0 (compatible; msie 4.0; windows 95)
gigabot
linkwalker
netmechanic
moget/2.1
miixpc/4.2
sitesnagger
microsoft url control
mozilla/4.0 (compatible; bullseye; windows 95)
microsoft url control - 6.00.8169
getright/4.2
mata hari
teleportpro
alexibot
url_spider_pro
thenomad
webbandit
larbin
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.modernpathshala.com/sitemap_index.xml |