100metiersenregionlr.fr
robots.txt

Robots Exclusion Standard data for 100metiersenregionlr.fr

Resource Scan

Scan Details

Site Domain 100metiersenregionlr.fr
Base Domain 100metiersenregionlr.fr
Scan Status Ok
Last Scan2024-09-29T08:19:41+00:00
Next Scan 2024-10-06T08:19:41+00:00

Last Scan

Scanned2024-09-29T08:19:41+00:00
URL https://100metiersenregionlr.fr/robots.txt
Domain IPs 109.234.167.98
Response IP 109.234.167.98
Found Yes
Hash c4b7eb7a52547f435e9dfd8522d70890503f18b2bdb4b04a5f56ab2c1cef7cda
SimHash 7906dc226ab9

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Allow /wp-admin/admin-ajax.php

awariosmartbot
ahrefsbot
aspiegelbot
blexbot
barkrowler
dotbot
mj12bot
mauibot
nimbostratus-bot
petalbot
semrushbot
seznambot
sogou
serpstatbot
trendiction
criteobot
twitterbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 180

nerdybot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.100metiersenregionlr.fr/sitemaps.xml
sitemap https://www.100metiersenregionlr.fr/news.xml

Warnings

  • 1 invalid line.