iolaregister.com
robots.txt
Robots Exclusion Standard data for iolaregister.com
Resource Scan
Scan Details
| Site Domain | iolaregister.com |
| Base Domain | iolaregister.com |
| Scan Status | Ok |
| Last Scan | 2024-11-12T00:15:31+00:00 |
| Next Scan | 2024-11-19T00:15:31+00:00 |
Last Scan
| Scanned | 2024-11-12T00:15:31+00:00 |
| URL | https://iolaregister.com/robots.txt |
| Redirect | https://www.iolaregister.com/robots.txt |
| Redirect Domain | www.iolaregister.com |
| Redirect Base | iolaregister.com |
| Domain IPs | 216.55.186.162 |
| Redirect IPs | 104.26.4.90, 104.26.5.90, 172.67.68.56, 2606:4700:20::681a:45a, 2606:4700:20::681a:55a, 2606:4700:20::ac43:4438 |
| Response IP | 104.26.4.90 |
| Found | Yes |
| Hash | 96c83346c2d22a154beca5b022fb0adcb6267bfee809151471966eee6df00c46 |
| SimHash | 424848105e92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
a6-indexer
ahrefsbot
aliveadvisorcrawler
alphaseobot
alphaseobot-sa
anonymous coward
apollobot
baiduspider
baiduspider-image
baiduspider-video
barkrowler
bitvorebot
blekkobot
blexbot
brandverity/1.0
btcrawler
bubing
buck
buck/2.2
caam
clarsentiabot
clinecrawler
cliqzbot
companybook-crawler
dataprovider.com
domaincrawler
elefent
exabot
exabot-thumbnails
expo9
ezooms
fairshare.cc
fast enterprise crawler
flamingo_searchengine
flipboard
flipboardproxy
fr_crawler
garlikcrawler
genieo
gigabot
g-i-g-a-b-o-t
gnowitnewsbot
goodzer
grapeshot
heritrix
integromedb
laserlikebot
linguee bot
ltx71
lumtelbot
magpie-crawler
mail.ru_bot
mandalay
mauibot
maxpointcrawler
mediawords
meltwaternews
memonewsbot
mj12bot
mojeekbot
moreoverbot
netestate ne crawler
newslookup-bot
newsnow
panscient.com
paperlibot
psbot
piplbot
proximic
rssingbot
qwantify
qwant-news/2.0
r6_commentreader
r6_feedfetcher
rediffnewsbot
riddler
rogerbot
scalaj-http
scalaj-http/1.0
scrapy
semrushbot
seokicks-robot
shakoo
smartbriefbot
sogou spider
sosospider
spbot
spinn3r
superfeedr
superfeedr bot
synthesio
tencenttraveler
test bot
the knowledge ai
toscrawler
toutiaospider
trendictionbot
trendkite-akashic-crawler
turnitinbot
uipbot
vegi bot
veooz
veooz/1.0
vocusbot
wikido
wotbox
yandex
yandexbot
yandeximages
yandexnews
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://iolaregister.com/sitemap.xml |
| sitemap | https://iolaregister.com/news-sitemap.xml |
Warnings
- 1 invalid line.