Log In Sign Up

goplatform.io
robots.txt

Robots Exclusion Standard data for goplatform.io

Resource Scan

Scan Details

Site Domain goplatform.io
Base Domain goplatform.io
Scan Status Ok
Last Scan2025-09-19T15:14:28+00:00
Next Scan 2025-10-19T15:14:28+00:00

Last Scan

Scanned2025-09-19T15:14:28+00:00
URL https://goplatform.io/robots.txt
Redirect http://www.goplatform.io/robots.txt
Redirect Domain www.goplatform.io
Redirect Base goplatform.io
Domain IPs 104.21.80.60, 172.67.174.184, 2606:4700:3035::6815:503c, 2606:4700:3037::ac43:aeb8
Redirect IPs 104.21.80.60, 172.67.174.184, 2606:4700:3035::6815:503c, 2606:4700:3037::ac43:aeb8
Response IP 104.21.80.60
Found Yes
Hash 2fdd1b7f5591273338818419fad762b4be129e519319e2cfad0c2e61a0c262a2
SimHash aa0d6fa56450

Groups

semrushbot

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.goplatform.io/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /
Back to top