trustnodes.com
robots.txt
Robots Exclusion Standard data for trustnodes.com
Resource Scan
Scan Details
Site Domain | trustnodes.com |
Base Domain | trustnodes.com |
Scan Status | Ok |
Last Scan | 2024-09-22T06:47:52+00:00 |
Next Scan | 2024-09-29T06:47:52+00:00 |
Last Scan
Scanned | 2024-09-22T06:47:52+00:00 |
URL | https://trustnodes.com/robots.txt |
Domain IPs | 34.111.138.58 |
Response IP | 34.111.138.58 |
Found | Yes |
Hash | a97fd9518b0efc4883acb0917509291e4223f6ce8c8b579c20909633d54c9654 |
SimHash | a99a50d26ab3 |
Groups
*
Rule | Path |
---|---|
Disallow | /privacy-policy/privacy-policy/ |
Disallow | /privacy-policy/subscription/ |
Disallow | /subscription/subscription/ |
Disallow | /privacy-policy/page/ |
Disallow | /account/ |
Disallow | /admin/ |
Disallow | /login/ |
Disallow | /*? |
Disallow | /xmlrpc |
Disallow | /wp-includes/js/ |
Disallow | /wp-content/plugins/ |
Disallow | /wp-content/themes/ |
Disallow | /wp-includes/css |
Disallow | /database.php.bak |
Disallow | /database.sql.tar |
Disallow | /database.tar |
Disallow | /database.tar.gz |
Disallow | /*.tar$ |
Disallow | /*.tar.gz$ |
Disallow | /*.sql$ |
Disallow | /*%E2%80%A6 |
Disallow | /news/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |