eriks.nl
robots.txt

Robots Exclusion Standard data for eriks.nl

Resource Scan

Scan Details

Site Domain eriks.nl
Base Domain eriks.nl
Scan Status Ok
Last Scan2024-11-02T18:29:39+00:00
Next Scan 2024-12-02T18:29:39+00:00

Last Scan

Scanned2024-11-02T18:29:39+00:00
URL https://eriks.nl/robots.txt
Domain IPs 151.101.131.10, 151.101.195.10, 151.101.3.10, 151.101.67.10
Response IP 151.101.3.10
Found Yes
Hash 2dcd0b6a6a9096b5129f4c99a3df54ab05c5eec8b7d09f0445c917fd27208ed5
SimHash 905cdf50801a

Groups

dotbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Comments

  • See: https://moz.com/help/moz-procedures/crawlers/dotbot
  • See: http://de.wetena.com/bot/seokicks-robot
  • See: https://platform.openai.com/docs/gptbot