instaplus.me
robots.txt

Robots Exclusion Standard data for instaplus.me

Resource Scan

Scan Details

Site Domain instaplus.me
Base Domain instaplus.me
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-05-09T15:00:02+00:00
Next Scan 2025-06-08T15:00:02+00:00

Last Successful Scan

Scanned2025-03-18T14:58:47+00:00
URL https://instaplus.me/robots.txt
Domain IPs 104.21.51.199, 172.67.185.128, 2606:4700:3032::6815:33c7, 2606:4700:3032::ac43:b980
Response IP 104.21.51.199
Found Yes
Hash 175ec4f5dfb5335b3e39b0179bf78d8090d1805e914c9a194054f58f049bff7a
SimHash b2840dad6350

Groups

*

Rule Path
Disallow /password/
Disallow /auth
Disallow /register
Disallow /me
Disallow /freereg
Disallow /paysign
Disallow /admin
Disallow /thank-you
Disallow /posts

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /

Warnings

  • `host` is not a known field.