techwalls.com
robots.txt
Robots Exclusion Standard data for techwalls.com
Resource Scan
Scan Details
Site Domain | techwalls.com |
Base Domain | techwalls.com |
Scan Status | Ok |
Last Scan | 2024-09-24T13:23:05+00:00 |
Next Scan | 2024-10-01T13:23:05+00:00 |
Last Scan
Scanned | 2024-09-24T13:23:05+00:00 |
URL | https://techwalls.com/robots.txt |
Redirect | https://www.techwalls.com/robots.txt |
Redirect Domain | www.techwalls.com |
Redirect Base | techwalls.com |
Domain IPs | 104.21.45.202, 172.67.218.187 |
Redirect IPs | 104.21.45.202, 172.67.218.187 |
Response IP | 172.67.218.187 |
Found | Yes |
Hash | 77dbc4d0647cd8fc2de48a4b66d38e38b33c56c1e69d6b05a1b47f0d84b6d32a |
SimHash | 611449da5ef3 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /recommended/ |
Disallow | /comments/feed/ |
Disallow | /trackback/ |
Disallow | /index.php |
Disallow | /xmlrpc.php |
Disallow | *?wptheme |
Disallow | /search? |
Disallow | /?p=* |
*
Rule | Path |
---|---|
Disallow | /wp-content/cache/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.techwalls.com/sitemap.xml |
Warnings
- 1 invalid line.
Comments