tnext.org
robots.txt
Robots Exclusion Standard data for tnext.org
Resource Scan
Scan Details
Site Domain | tnext.org |
Base Domain | tnext.org |
Scan Status | Ok |
Last Scan | 2025-06-28T17:48:50+00:00 |
Next Scan | 2025-07-05T17:48:50+00:00 |
Last Scan
Scanned | 2025-06-28T17:48:50+00:00 |
URL | https://tnext.org/robots.txt |
Domain IPs | 104.21.1.26, 172.67.151.226, 2606:4700:3034::ac43:97e2, 2606:4700:3035::6815:11a |
Response IP | 104.21.1.26 |
Found | Yes |
Hash | fa236da0163df22007f77cc4f5c3b47d388ceb052b7651e0ade012c11c1c5214 |
SimHash | 62c4dc6b2912 |
Groups
*
Rule | Path |
---|---|
Allow | /wp-admin/admin-ajax.php |
Allow | /*/*.css |
Allow | /*/*.js |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /wp-content/uploads |
Disallow | /readme.html |
Disallow | /license.txt |
Disallow | /xmlrpc.php |
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | */disclaimer/* |
Disallow | *?attachment_id= |
Disallow | /privacy-policy |
Disallow | /member/markshaw |
Disallow | /member/markshaw/* |
Disallow | /membership_checkout |
Disallow | /register/?type=login |
*
Rule | Path |
---|---|
Disallow | /member_payment_instructions |
Disallow | /paytest |
Disallow | /wishlist |
Disallow | /groups |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Comments