thiriet.com
robots.txt

Robots Exclusion Standard data for thiriet.com

Resource Scan

Scan Details

Site Domain thiriet.com
Base Domain thiriet.com
Scan Status Ok
Last Scan2024-11-03T23:44:47+00:00
Next Scan 2024-12-03T23:44:47+00:00

Last Scan

Scanned2024-11-03T23:44:47+00:00
URL https://www.thiriet.com/robots.txt
Redirect https://www.thiriet.com/robots-www.txt
Domain IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 59894d548f7e02cc873b51fc82fd1ea7ff6132730e3af5742b5ff2dfb1a7b384
SimHash 2e495a12ad41

Groups

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /accueil/votre-offre-consigne-refrigeree
Disallow /newsletters/
Disallow /*.pdf$
Disallow /*.xls$
Disallow /*.xlsx$
Disallow /gallery_files/site/24265/61492/gallery_files/site/24265/61492/85543.pdf
Disallow /gallery_files/site/24265/61492/gallery_files/site/24265/61492/85542.pdf
Disallow /gallery_files/site/24265/61492/gallery_files/site/24265/61492/85544.pdf
Disallow /gallery_files/site/24265/61492/gallery_files/site/24265/61492/85545.pdf

Other Records

Field Value
sitemap https://www.thiriet.com/sitemap.xml

Comments

  • robots.txt www