the80guy.com
robots.txt
Robots Exclusion Standard data for the80guy.com
Resource Scan
Scan Details
Site Domain | the80guy.com |
Base Domain | the80guy.com |
Scan Status | Ok |
Last Scan | 2025-06-07T13:48:54+00:00 |
Next Scan | 2025-06-14T13:48:54+00:00 |
Last Scan
Scanned | 2025-06-07T13:48:54+00:00 |
URL | https://the80guy.com/robots.txt |
Domain IPs | 104.21.20.5, 172.67.190.189, 2606:4700:3032::6815:1405, 2606:4700:3034::ac43:bebd |
Response IP | 104.21.20.5 |
Found | Yes |
Hash | 55ba0bbb3b8dbee2a813ecd41ff30f21f1f478a109ec43d1fb4e88e565bb39a2 |
SimHash | 430c5687e553 |
Groups
oai-searchbot
Rule | Path | Comment |
---|---|---|
Allow | / | - |
Disallow | /wp-admin | - |
Disallow | /wp-content/plugins/ | block access to plugins |
Disallow | /wp-login.php | block access to management |
Disallow | /feed | block feeds |
Disallow | /search/ | block internal search results |
Disallow | /?s= | block access to internal search result pages |
Disallow | /?p= | block access to pages for which permalinks fails |
Disallow | /%26p%3D | block access to pages for which permalinks fails |
Disallow | /%26preview%3D | block preview |
Disallow | /tag/ | block tags |
Disallow | /author/ | blocking author pages |
chatgpt-user
Rule | Path | Comment |
---|---|---|
Allow | / | - |
Disallow | /wp-admin | - |
Disallow | /wp-content/plugins/ | block access to plugins |
Disallow | /wp-login.php | block access to management |
Disallow | /feed | block feeds |
Disallow | /search/ | block internal search results |
Disallow | /?s= | block access to internal search result pages |
Disallow | /?p= | block access to pages for which permalinks fails |
Disallow | /%26p%3D | block access to pages for which permalinks fails |
Disallow | /%26preview%3D | block preview |
Disallow | /tag/ | block tags |
Disallow | /author/ | blocking author pages |
gptbot
Rule | Path | Comment |
---|---|---|
Allow | / | - |
Disallow | /wp-admin | - |
Disallow | /wp-content/plugins/ | block access to plugins |
Disallow | /wp-login.php | block access to management |
Disallow | /feed | block feeds |
Disallow | /search/ | block internal search results |
Disallow | /?s= | block access to internal search result pages |
Disallow | /?p= | block access to pages for which permalinks fails |
Disallow | /%26p%3D | block access to pages for which permalinks fails |
Disallow | /%26preview%3D | block preview |
Disallow | /tag/ | block tags |
Disallow | /author/ | blocking author pages |
*
Rule | Path | Comment |
---|---|---|
Allow | / | - |
Disallow | /wp-admin | - |
Disallow | /wp-content/plugins/ | block access to plugins |
Disallow | /wp-login.php | block access to management |
Disallow | /feed | block feeds |
Disallow | /search/ | block internal search results |
Disallow | /?s= | block access to internal search result pages |
Disallow | /?p= | block access to pages for which permalinks fails |
Disallow | /%26p%3D | block access to pages for which permalinks fails |
Disallow | /%26preview%3D | block preview |
Disallow | /tag/ | block tags |
Disallow | /author/ | blocking author pages |
Other Records
Field | Value |
---|---|
sitemap | https://the80guy.com/sitemap_index.xml |