techgremlin.com
robots.txt
Robots Exclusion Standard data for techgremlin.com
Resource Scan
Scan Details
| Site Domain | techgremlin.com |
| Base Domain | techgremlin.com |
| Scan Status | Ok |
| Last Scan | 2024-11-11T06:35:07+00:00 |
| Next Scan | 2024-11-18T06:35:07+00:00 |
Last Scan
| Scanned | 2024-11-11T06:35:07+00:00 |
| URL | https://techgremlin.com/robots.txt |
| Domain IPs | 104.21.39.31, 172.67.142.212, 2606:4700:3036::ac43:8ed4, 2606:4700:3037::6815:271f |
| Response IP | 104.21.39.31 |
| Found | Yes |
| Hash | 7dcce3b75144f54fd04fe8b3e4b3b1fd429c1b7bd806c90ada615e40ac9a54b5 |
| SimHash | 0a274d932704 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /dlm_uploads/ |
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/ben-translate-cache |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/themes |
| Disallow | /wp-content/upgrade |
| Disallow | /wp-config.php.sample |
| Disallow | /license.txt |
| Disallow | /readme.html |
| Disallow | /webstat |
| Disallow | /gallery |
| Disallow | /category/uncategorized |
| Disallow | /error_log |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.techgremlin.com/sitemap.xml |
Comments