ctendance.fr
robots.txt

Robots Exclusion Standard data for ctendance.fr

Resource Scan

Scan Details

Site Domain ctendance.fr
Base Domain ctendance.fr
Scan Status Ok
Last Scan2024-11-09T10:16:04+00:00
Next Scan 2024-11-16T10:16:04+00:00

Last Scan

Scanned2024-11-09T10:16:04+00:00
URL https://ctendance.fr/robots.txt
Redirect https://www.ctendance.fr/robots.txt
Redirect Domain www.ctendance.fr
Redirect Base ctendance.fr
Domain IPs 162.19.96.14
Redirect IPs 162.19.96.14
Response IP 162.19.96.14
Found Yes
Hash a91730f62179ec4e3d0fd1aa386ce53b841c6d3d49eafb535625ae5c6a165016
SimHash 51315ca26eb8

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /fr/
Disallow /1000/
Disallow /*?count-views=
Disallow /serviceworker.js

ahrefsbot
aspiegelbot
blexbot
barkrowler
dotbot
mj12bot
mauibot
nimbostratus-bot
petalbot
semrushbot
seznambot
sogou
serpstatbot
trendiction

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 180

Other Records

Field Value
sitemap https://www.ctendance.fr/sitemap_index.xml
sitemap https://www.ctendance.fr/sitemap-news.xml

Warnings

  • 1 invalid line.