eriks.nl
robots.txt

Robots Exclusion Standard data for eriks.nl

Resource Scan

Scan Details

Site Domain eriks.nl
Base Domain eriks.nl
Scan Status Ok
Last Scan2024-09-03T14:37:17+00:00
Next Scan 2024-10-03T14:37:17+00:00

Last Scan

Scanned2024-09-03T14:37:17+00:00
URL https://eriks.nl/robots.txt
Domain IPs 152.199.39.108
Response IP 152.199.39.108
Found Yes
Hash 2dcd0b6a6a9096b5129f4c99a3df54ab05c5eec8b7d09f0445c917fd27208ed5
SimHash 905cdf50801a

Groups

dotbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Comments

  • See: https://moz.com/help/moz-procedures/crawlers/dotbot
  • See: http://de.wetena.com/bot/seokicks-robot
  • See: https://platform.openai.com/docs/gptbot