mesrecettes.info
robots.txt

Robots Exclusion Standard data for mesrecettes.info

Resource Scan

Scan Details

Site Domain mesrecettes.info
Base Domain mesrecettes.info
Scan Status Ok
Last Scan2024-06-29T02:53:21+00:00
Next Scan 2024-07-06T02:53:21+00:00

Last Scan

Scanned2024-06-29T02:53:21+00:00
URL https://mesrecettes.info/robots.txt
Redirect https://www.mesrecettes.info/robots.txt
Redirect Domain www.mesrecettes.info
Redirect Base mesrecettes.info
Domain IPs 104.21.16.138, 172.67.212.236, 2606:4700:3031::ac43:d4ec, 2606:4700:3035::6815:108a
Redirect IPs 104.21.16.138, 172.67.212.236, 2606:4700:3031::ac43:d4ec, 2606:4700:3035::6815:108a
Response IP 104.21.16.138
Found Yes
Hash bb67cff62fa85c01e60d7ad4b4687d07859497debd8ac62be3716fda1c21df1e
SimHash 7107dc224eb1

Groups

aspiegelbot
blexbot
barkrowler
dotbot
mauibot
nimbostratus-bot
petalbot
seznambot
sogou
serpstatbot
trendiction
textbulkerbot

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 180

gptbot
google-extended

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.mesrecettes.info/sitemap.xml

Warnings

  • 1 invalid line.