signification-noms-prenoms.com
robots.txt

Robots Exclusion Standard data for signification-noms-prenoms.com

Resource Scan

Scan Details

Site Domain signification-noms-prenoms.com
Base Domain signification-noms-prenoms.com
Scan Status Ok
Last Scan2024-06-11T05:34:13+00:00
Next Scan 2024-06-18T05:34:13+00:00

Last Scan

Scanned2024-06-11T05:34:13+00:00
URL https://signification-noms-prenoms.com/robots.txt
Redirect https://www.signification-noms-prenoms.com/robots.txt
Redirect Domain www.signification-noms-prenoms.com
Redirect Base signification-noms-prenoms.com
Domain IPs 104.21.15.126, 172.67.162.158, 2606:4700:3030::ac43:a29e, 2606:4700:3031::6815:f7e
Redirect IPs 104.21.15.126, 172.67.162.158, 2606:4700:3030::ac43:a29e, 2606:4700:3031::6815:f7e
Response IP 172.67.162.158
Found Yes
Hash d6b6a5140c26c09d84b8417bb3b0ec71c73ebd408ad2bb14b6e1ff1d9a1154ad
SimHash 430f8bc14ab2

Groups

*

Rule Path
Disallow /ajax/
Disallow /files/
Disallow /core/

cliqzbot
ntentbot
garlikcrawler
megaindex.ru
nutch
skimbot
yeti
vagabondo
coccoc
sistrix
mojeekbot
xovibot
spbot
domainappender
bubing
riddler
dotbot
tweetmemebot
ias_crawler
domainstatsbot
linguee
magpie-crawler
grapeshot
blexbot
infopath
wesee
smtbot
idmarch
larbin
maxpoint bot
maxpointcrawler
mj12bot
new zealand search
httrack
proximic
netseer
linkdexbot/2.0
genieo
java/1.7.0_11
infopath.2
grapeshot
ccbot
xenu's
backlink-check.de
backlinkcrawler
extractorpro
fasterfox
linkextractorpro
linkwalker
openbot
rogerbot
searchpreview
seodat
seoengbot
seokicks-robot
sistrix
tineye
true_robot
url control
url_spider_pro
xovi
meanpathbot
wikido
worldbrewbot
linkfluence
ahrefsbot
petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.signification-noms-prenoms.com/sitemap-index-prenoms.xml
sitemap https://www.signification-noms-prenoms.com/sitemap-index-noms.xml
sitemap https://www.signification-noms-prenoms.com/sitemap-index-stars.xml
sitemap https://www.signification-noms-prenoms.com/news/sitemap_index.xml
sitemap https://www.signification-noms-prenoms.com/news/news-sitemap.xml

Warnings

  • 1 invalid line.