waxoo.fr
robots.txt

Robots Exclusion Standard data for waxoo.fr

Resource Scan

Scan Details

Site Domain waxoo.fr
Base Domain waxoo.fr
Scan Status Ok
Last Scan2024-11-11T08:39:37+00:00
Next Scan 2024-11-18T08:39:37+00:00

Last Scan

Scanned2024-11-11T08:39:37+00:00
URL https://waxoo.fr/robots.txt
Domain IPs 78.40.8.95
Response IP 78.40.8.95
Found Yes
Hash 22d5715d5d8d0025c4062373d4800f1e931b562869f9e5577cbe951dc5683e7e
SimHash 538d5c204eb1

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /*css?*
Allow /*js?*

ahrefsbot
aspiegelbot
blexbot
barkrowler
dotbot
mj12bot
mauibot
nimbostratus-bot
petalbot
semrushbot
seznambot
sogou
serpstatbot
trendiction

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 180

Other Records

Field Value
sitemap https://waxoo.fr/sitemaps.xml
sitemap https://waxoo.fr/news.xml

Warnings

  • 1 invalid line.