postthem.fr
robots.txt

Robots Exclusion Standard data for postthem.fr

Resource Scan

Scan Details

Site Domain postthem.fr
Base Domain postthem.fr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-09-21T13:53:20+00:00
Next Scan 2024-10-21T13:53:20+00:00

Last Successful Scan

Scanned2024-08-23T09:47:48+00:00
URL https://postthem.fr/robots.txt
Domain IPs 89.116.228.185
Response IP 89.116.228.185
Found Yes
Hash 7675dc0ff365038ff8c5e68755a283385c5929efe775ad7154d214cbd7a7459e
SimHash 69008c2e0381

Groups

*

Rule Path
Disallow /admin/
Disallow /user-data/

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.postthem.com/sitemap.xml

Comments

  • robots.txt pour PostThem
  • Bloque tous les robots d'explorer toutes les pages
  • Permet à tous les robots d'explorer le reste du site
  • Indique l'emplacement du sitemap