Log In Sign Up

lundi.am
robots.txt

Robots Exclusion Standard data for lundi.am

Resource Scan

Scan Details

Site Domain lundi.am
Base Domain lundi.am
Scan Status Ok
Last Scan2024-09-30T21:30:53+00:00
Next Scan 2024-10-30T21:30:53+00:00

Last Scan

Scanned2024-09-30T21:30:53+00:00
URL https://lundi.am/robots.txt
Domain IPs 178.32.107.71
Response IP 178.32.107.71
Found Yes
Hash 7d9ecfe10238e19d325336ea10b6ee538616006dc3e4bfa057729ce0b772687f
SimHash 6b0fd0209f30

Groups

*

Rule Path
Allow /local/cache-css/
Allow /local/cache-js/
Disallow /ecrire/
Disallow /lib/
Disallow /oembed.api/
Disallow /spip.php?action=*
Disallow /spip.php?page=login*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

ltx11

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://lundi.am/sitemap.xml
Back to top

Comments

  • robots.txt
  • @url: https://lundi.am
  • @generator: SPIP 4.2.16
  • @template: plugins-dist/dist/nursit/ariel/robots.txt.html
Back to top

Warnings

  • `noindex` is not a known field.
Back to top