linuxwebdevelopment.com
robots.txt
Robots Exclusion Standard data for linuxwebdevelopment.com
Resource Scan
Scan Details
| Site Domain | linuxwebdevelopment.com |
| Base Domain | linuxwebdevelopment.com |
| Scan Status | Ok |
| Last Scan | 2025-11-26T17:59:39+00:00 |
| Next Scan | 2025-12-03T17:59:39+00:00 |
Last Scan
| Scanned | 2025-11-26T17:59:39+00:00 |
| URL | https://linuxwebdevelopment.com/robots.txt |
| Domain IPs | 104.21.60.238, 172.67.202.138, 2606:4700:3034::6815:3cee, 2606:4700:3036::ac43:ca8a |
| Response IP | 172.67.202.138 |
| Found | Yes |
| Hash | ad1857a31618edf6cc776986057a0c5bd53268045325575db716cea082b1b1cf |
| SimHash | 7b185a76cf11 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */trackback/ |
| Disallow | */xmlrpc.php |
| Disallow | /wp-*.php |
| Disallow | /cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /wp-content/themes/ |
| Allow | */wp-content/uploads/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://linuxwebdevelopment.com/sitemap.xml |
| sitemap | https://linuxwebdevelopment.com/sitemap-home.xml |
| sitemap | https://linuxwebdevelopment.com/sitemap-product.xml |
| sitemap | https://linuxwebdevelopment.com/sitemap-posts.xml |
| sitemap | https://linuxwebdevelopment.com/sitemap-pages.xml |
| sitemap | https://linuxwebdevelopment.com/sitemap-categories.xml |
| sitemap | https://linuxwebdevelopment.com/sitemap-archives.xml |
Warnings
- 1 invalid line.
Comments