karos.fr
robots.txt

Robots Exclusion Standard data for karos.fr

Resource Scan

Scan Details

Site Domain karos.fr
Base Domain karos.fr
Scan Status Ok
Last Scan2024-06-02T08:44:08+00:00
Next Scan 2024-06-16T08:44:08+00:00

Last Scan

Scanned2024-06-02T08:44:08+00:00
URL https://karos.fr/robots.txt
Redirect https://www.karos.fr/robots.txt
Redirect Domain www.karos.fr
Redirect Base karos.fr
Domain IPs 213.186.33.16
Redirect IPs 213.186.33.16
Response IP 213.186.33.16
Found Yes
Hash 140a1a98c474541c4b703f97e06329ce9ee5104ab958a31e7b415f2c735da4b9
SimHash 69055f504513

Groups

*

Rule Path
Disallow

*

Rule Path
Disallow /presse_pagination/
Disallow /nous_pagination/

Other Records

Field Value
sitemap http://www.karos.fr/sitemap.xml
sitemap http://www.karos.fr/magazine/sitemap-mag.xml

Comments

  • www.robotstxt.org/
  • Allow crawling of all content