jpubb.com
robots.txt
Robots Exclusion Standard data for jpubb.com
Resource Scan
Scan Details
| Site Domain | jpubb.com |
| Base Domain | jpubb.com |
| Scan Status | Ok |
| Last Scan | 2024-11-15T21:06:15+00:00 |
| Next Scan | 2024-11-22T21:06:15+00:00 |
Last Scan
| Scanned | 2024-11-15T21:06:15+00:00 |
| URL | https://jpubb.com/robots.txt |
| Domain IPs | 153.127.78.208 |
| Response IP | 153.127.78.208 |
| Found | Yes |
| Hash | d6462979cf44555c7877d8a0d112e86f7d65d4a7a0ea8a5ec347106460b5bb28 |
| SimHash | 6b1689540eb0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
*
| Rule | Path |
|---|---|
| Disallow | /press/934237/ |
a12
ahrefsbot
amznkassocbot
askpeterbot
backlink-check
baiduspider
bingbot
claritybot
coccoc
contentdetection
crystalsemanticsbot
diffbot
discoverybot
ec2linkfinder
engine catalog crowler
exabot
ezooms
fastseek
findlinks
friendfeedbot
grapeshotcrawler
gsa-crawler
hubspot
ia_archiver
ichiro
icjobs
infohelfer
istellabot
java
kraken
linkchecker
linkdex
linkman
magpie-crawler
miadev
mj12bot
monozilla
netestate
netseer
ning/1.0
nutch
obot
ocelli
omgilibot
oppo
plukkie
poster
procogbot
proximic
psbot
semager
seznambot
sibot
socialayer
stan
steeler
suchmaschineninstitut
synthesio
tencenttraveler
toplistbot
trendiction
twiceler
unisterbot
vagabondo
vbseo
voilabot
wbsearchbot
wscheck
yandexbot
yandeximages
yeti
y!j-brw
mappy
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.jpubb.com/sitemap_today.xml |
Warnings
- 2 invalid lines.
Comments