Log In Sign Up

nextengine.com
robots.txt

Robots Exclusion Standard data for nextengine.com

Resource Scan

Scan Details

Site Domain nextengine.com
Base Domain nextengine.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-06-17T20:46:54+00:00
Next Scan 2025-09-15T20:46:54+00:00

Last Successful Scan

Scanned2023-02-06T12:05:15+00:00
URL http://nextengine.com/robots.txt
Redirect http://www.nextengine.com/robots.txt
Redirect Domain www.nextengine.com
Redirect Base nextengine.com
Domain IPs 69.16.206.4
Redirect IPs 69.16.206.4
Response IP 69.16.206.4
Found Yes
Hash 9f854e33a143ef36309cfb3a1e44fff99bb7113e817daf97b335dab673311854
SimHash b28d2d8d6450

Groups

*

Rule Path
Disallow /api
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top