quel-salaire.fr
robots.txt

Robots Exclusion Standard data for quel-salaire.fr

Resource Scan

Scan Details

Site Domain quel-salaire.fr
Base Domain quel-salaire.fr
Scan Status Ok
Last Scan2024-10-31T05:05:51+00:00
Next Scan 2024-11-07T05:05:51+00:00

Last Scan

Scanned2024-10-31T05:05:51+00:00
URL https://quel-salaire.fr/robots.txt
Domain IPs 185.246.44.121
Response IP 185.246.44.121
Found Yes
Hash 1da22b2ae0e55d5651557381cc93154b21ebd5d5a9ba5297ea2b2700c2f20a7f
SimHash 7905dd126ab1

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow *?PageSpeed=noscript
Allow /wp-admin/admin-ajax.php

awariosmartbot
ahrefsbot
aspiegelbot
blexbot
barkrowler
dotbot
mj12bot
mauibot
nimbostratus-bot
petalbot
semrushbot
seznambot
sogou
serpstatbot
trendiction
criteobot
twitterbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 180

nerdybot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.quel-salaire.fr/sitemap.xml
sitemap https://www.quel-salaire.fr/sitemap-news.xml

Warnings

  • 1 invalid line.