Log In Sign Up

paroles.cc
robots.txt

Robots Exclusion Standard data for paroles.cc

Resource Scan

Scan Details

Site Domain paroles.cc
Base Domain paroles.cc
Scan Status Ok
Last Scan2025-08-24T12:13:46+00:00
Next Scan 2025-08-31T12:13:46+00:00

Last Scan

Scanned2025-08-24T12:13:46+00:00
URL https://paroles.cc/robots.txt
Redirect https://www.paroles.cc/robots.txt
Redirect Domain www.paroles.cc
Redirect Base paroles.cc
Domain IPs 46.105.57.169
Redirect IPs 46.105.57.169
Response IP 46.105.57.169
Found Yes
Hash 50f45f99ebea363aef0c053f8cc3eee6739c92886d1defd4569361aabd7774fa
SimHash 537adca2f3a6

Groups

ia_archiver

Rule Path
Disallow /

dnslookup.fr

Rule Path
Disallow /

off_ahrefsbot

Rule Path
Disallow /

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

off_dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

off_semrushbot

Rule Path
Disallow /

off_yandexbot
off_yandex

Rule Path
Disallow /

httrack
java
libwww
looksmart
msiecrawler
newspaper/0.2.8
offline explorer
python-urllib
sitesucker/2.0
teleport
teleportpro
webcopier
webzip
wget
winhttrack
zyborg

Rule Path
Disallow /

*

Rule Path
Disallow /adform/
Disallow /admin
Disallow /blog/
Disallow /cache/
Disallow /cgi-bin/
Disallow /drupal/
Disallow /forum/
Disallow /honeypot
Disallow /joomla/
Disallow /login
Disallow /openmr/
Disallow /plus/
Disallow /trackback/
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-login/
Disallow /noc/
Disallow /rtm/
Back to top

Other Records

Field Value
sitemap https://www.paroles.cc/sitemap.xml
Back to top

Comments

  • 29/12/2020 paroles.cc/www/robots.txt: text/plain; charset=ütf-8
  • 07/01/2021
  • "Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)"
  • "Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)"
  • "Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)"
  • https://moz.com/help/moz-procedures/crawlers/dotbot
  • "Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)"
  • "Mozilla/5.0 (compatible; SemrushBot/7~bl; +http://www.semrush.com/bot.html)"
  • "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
  • others
  • Disallow: /fr/
  • Disallow: /*,tous
Back to top