Log In Sign Up

gofer.fr
robots.txt

Robots Exclusion Standard data for gofer.fr

Resource Scan

Scan Details

Site Domain gofer.fr
Base Domain gofer.fr
Scan Status Ok
Last Scan2025-10-11T07:48:24+00:00
Next Scan 2025-11-10T07:48:24+00:00

Last Scan

Scanned2025-10-11T07:48:24+00:00
URL https://gofer.fr/robots.txt
Redirect https://www.gofer.fr/robots.txt
Redirect Domain www.gofer.fr
Redirect Base gofer.fr
Domain IPs 104.21.0.248, 172.67.151.128, 2606:4700:3030::6815:f8, 2606:4700:3031::ac43:9780
Redirect IPs 18.181.31.166, 54.248.227.74
Response IP 18.176.133.53
Found Yes
Hash 2ab17730723910df9fd1bba83ca949ab0d4dd103d4ae95dab0e9afad31d16b9e
SimHash a20d2f8d6440

Groups

semrushbot

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.gofer.fr/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /
Back to top