maxi-mag.fr
robots.txt

Robots Exclusion Standard data for maxi-mag.fr

Resource Scan

Scan Details

Site Domain maxi-mag.fr
Base Domain maxi-mag.fr
Scan Status Ok
Last Scan2024-09-20T21:43:03+00:00
Next Scan 2024-09-27T21:43:03+00:00

Last Scan

Scanned2024-09-20T21:43:03+00:00
URL https://maxi-mag.fr/robots.txt
Domain IPs 65.52.155.229
Response IP 65.52.155.229
Found Yes
Hash 4684aa2d7020d8fe5c9d89d217e9f290b169e8b3badc3d08f02c740fc008b6b5
SimHash 6d2808c4e1ba

Groups

*

Rule Path
Disallow /*?s=*
Disallow *utm_

*

Rule Path
Disallow

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.maxi-mag.fr/google-news-sitemap.xml
sitemap https://www.maxi-mag.fr/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK