djtoptips.com
robots.txt
Robots Exclusion Standard data for djtoptips.com
Resource Scan
Scan Details
| Site Domain | djtoptips.com |
| Base Domain | djtoptips.com |
| Scan Status | Ok |
| Last Scan | 2024-10-12T07:18:58+00:00 |
| Next Scan | 2024-10-19T07:18:58+00:00 |
Last Scan
| Scanned | 2024-10-12T07:18:58+00:00 |
| URL | https://djtoptips.com/robots.txt |
| Domain IPs | 104.21.59.62, 172.67.216.158, 2606:4700:3031::6815:3b3e, 2606:4700:3035::ac43:d89e |
| Response IP | 172.67.216.158 |
| Found | Yes |
| Hash | 111817b387e4a99ae56fa3844ad513818760c956c1052c2cd1c2b45ec71bbd9e |
| SimHash | 6a241a86afb3 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /wp-admin/ | block access to admin section |
| Disallow | /wp-login.php | block access to admin section |
| Disallow | /search/ | block access to internal search result pages |
| Disallow | *?s=* | block access to internal search result pages |
| Disallow | *?p=* | block access to pages for which permalinks fails |
| Disallow | *%26p%3D* | block access to pages for which permalinks fails |
| Disallow | *%26preview%3D* | block access to preview pages |
| Disallow | /tag/ | block access to tag pages |
| Disallow | /author/ | block access to author pages |
| Disallow | /404-error/ | block access to 404 page |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.djtoptips.com/sitemap_index.xml |