Log In Sign Up

onfirstup.eu
robots.txt

Robots Exclusion Standard data for onfirstup.eu

Resource Scan

Scan Details

Site Domain onfirstup.eu
Base Domain onfirstup.eu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-09-20T17:27:10+00:00
Next Scan 2025-09-21T17:27:10+00:00

Last Successful Scan

Scanned2025-09-06T17:26:19+00:00
URL https://onfirstup.eu/robots.txt
Domain IPs 108.128.237.44, 52.215.10.62, 54.78.226.231
Response IP 108.128.237.44
Found Yes
Hash 04b111fd159d70ce899b362d48819ed7ee301e5b673bf4f2d49d84ffa55b9ec5
SimHash aa808b8d4575

Groups

linkedinbot

Rule Path
Allow /

*

Rule Path
Disallow /
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To unban all spiders from the entire site, comment the next two lines:
Back to top