infos.fr
robots.txt

Robots Exclusion Standard data for infos.fr

Resource Scan

Scan Details

Site Domain infos.fr
Base Domain infos.fr
Scan Status Ok
Last Scan2024-05-29T03:46:07+00:00
Next Scan 2024-06-05T03:46:07+00:00

Last Scan

Scanned2024-05-29T03:46:07+00:00
URL https://infos.fr/robots.txt
Domain IPs 104.21.51.147, 172.67.181.182, 2606:4700:3033::ac43:b5b6, 2606:4700:3036::6815:3393
Response IP 104.21.51.147
Found Yes
Hash 37b709fa91ff4bdc2bd755c7991d69cae7c9fff2891b33aaee694c80e0bdca01
SimHash e927da00cab2

Groups

startmebot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /*?preview=
Allow /wp-admin/admin-ajax.php
Disallow /*.swf$

Other Records

Field Value
sitemap https://www.infos.fr/sitemap_index.xml
sitemap https://www.infos.fr/google-news-sitemap.xml

Comments

  • wp stuff
  • Disallow: /tag/
  • files