frenchmusicblog.com
robots.txt
Robots Exclusion Standard data for frenchmusicblog.com
Resource Scan
Scan Details
| Site Domain | frenchmusicblog.com |
| Base Domain | frenchmusicblog.com |
| Scan Status | Ok |
| Last Scan | 2024-09-29T14:16:44+00:00 |
| Next Scan | 2024-10-06T14:16:44+00:00 |
Last Scan
| Scanned | 2024-09-29T14:16:44+00:00 |
| URL | https://frenchmusicblog.com/robots.txt |
| Redirect | https://www.frenchmusicblog.com/robots.txt |
| Redirect Domain | www.frenchmusicblog.com |
| Redirect Base | frenchmusicblog.com |
| Domain IPs | 192.185.36.121 |
| Redirect IPs | 192.185.36.121 |
| Response IP | 192.185.36.121 |
| Found | Yes |
| Hash | 9a5eb16143fa5b409291785f0d1d4eb9244170fa0c55357dcc3516502a1e5db1 |
| SimHash | 2a3cd8fa46c3 |
Groups
aboundexbot
a6-indexer
admantx platform semantic analyzer - admantx inc. - www.admantx.com - support@admantx.com
ahrefsbot
baiduspider
baiduspider-image
baiduspider-video
ccbot
coccoc
dotbot
exabot
ezooms
easouspider
eventmachine
gimme60bot
httrack
feedzirra
ia_archiver
magpie-crawler
mail.ru_bot/2.0
majestic12
mj12bot
moreoverbot
moreoverbot/5.1
nerdybot
newslebot
paperlibot/2.1
r6_feedfetcher
r6_commentreader
semantic-visions.com crawler
semrush
seznam screenshot-generator 2.0
sogou pic spider
sosospider
solomonobot
sosospider
spinn3r
sbider
squidoo/link_quality
rogerbot
sistrix
sogou web spider
seznambot
smtbot/1.0
wesee
wesee:ads/pagebot
yandex
yandexbot
yandexmedia
youdaobot
tweetmemebot
naverbot
xovibot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /musique |
| Disallow | /shp/ |
| Disallow | /cgi-bin |
| Disallow | /contact |
| Disallow | /comments |
| Disallow | /test/ |
| Disallow | /register.php |
| Disallow | /category-thumbnails |
| Disallow | /test-2-ignore |
| Disallow | /test-3-ignore |
| Disallow | /test-4-ignore |
| Disallow | /test-5-ignore |
| Disallow | /trackback/ |
| Disallow | /uploads/ |
| Disallow | /pracitce-new-release-slider |
| Disallow | /french-folk-pop-polar/comment-page-1 |
| Disallow | /artists-tags |
| Disallow | /learn-french |
| Disallow | /newsletter-subscriber-poll |
| Disallow | /newsletter-subscriber-poll/ |
| Disallow | /thank-you |
| Disallow | /subscribe |
| Disallow | /disclaimer |
| Disallow | /advertise |
| Disallow | /rss/ |
| Disallow | */rss/ |
| Disallow | /xmlrpc.php |
| Disallow | /cse |
| Disallow | /search |
| Disallow | /comment-page-1 |
| Disallow | /labels.rdf |
| Disallow | /privacy-policy.html |
| Disallow | /help |
| Disallow | /various |
| Disallow | /tom-frager-french-reggae |
| Disallow | /etyl |
| Disallow | /store.php |
| Disallow | /quinze-french-rb-singer/quinze-french-rb |
| Disallow | /alexandre-kinn-bluesy-french-pop |
| Disallow | /wallen-french-r-b-trailblazer |
| Disallow | /lea-castel-is-french-alicia-keys |
| Disallow | /eilijah-neo-soul-inspired-french-r-b/eilijah-french-rb-singer |
| Disallow | /island-influenced-french-rb-gage |
| Disallow | /shp-the-teenagers-itunes |
| Disallow | /thanks-for-subscribing |
| Disallow | /wallen-french-r-b-trailblazer |
| Disallow | /other |
| Disallow | /eilijah-neo-soul-inspired-french-r-b |
| Disallow | /french-music-uk |
| Disallow | /melodic-french-pop-gerome-gallo |
| Disallow | /radio |
| Disallow | /isabelle-boulay-fin-octobre |
| Disallow | /buridane |
| Disallow | /speedy-laisser-partir |
| Disallow | /charlie-le-sapin |
| Disallow | /dominique-a-rendez-nous |
| Disallow | /melanie-laurent-kiss |
| Disallow | /axelle-red-naive |
| Disallow | /felipecha-quelque-part |
| Disallow | /april-march-mignonette |
| Disallow | /barbara-carlotti-le-vent |
| Disallow | /ycare-lap-dance |
| Disallow | /perle-lama-elle-toi |
| Disallow | /uploads/clear-fibre-optic-christmas-tree.jpg |
| Disallow | /tag/ |
| Disallow | /?replytocom |
| Disallow | /?utm |
| Disallow | /*? |
| Disallow | /*?* |
| Disallow | /?p= |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.frenchmusicblog.com/sitemap_index.xml |
Warnings
- 13 invalid lines.
- `​disallow` is not a known field.