xombit.com
robots.txt
Robots Exclusion Standard data for xombit.com
Resource Scan
Scan Details
| Site Domain | xombit.com |
| Base Domain | xombit.com |
| Scan Status | Ok |
| Last Scan | 2024-11-09T14:58:19+00:00 |
| Next Scan | 2024-11-16T14:58:19+00:00 |
Last Scan
| Scanned | 2024-11-09T14:58:19+00:00 |
| URL | https://xombit.com/robots.txt |
| Domain IPs | 85.208.100.14 |
| Response IP | 85.208.100.14 |
| Found | Yes |
| Hash | b1e12cb09226072d43830cfdc4fad33d558f8d181fddc4e8f37211f263c9d1ec |
| SimHash | ecacd302ed52 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /?utm_ |
| Disallow | /?attachment |
| Disallow | /search/ |
| Disallow | /*?utm_ |
| Disallow | /*/*?utm_ |
| Disallow | /*/*/*?utm_ |
| Disallow | /page/ |
| Disallow | /*/page/ |
| Disallow | /*/*/page/ |
| Disallow | /*/*/*/page/ |
| Disallow | /*/*/*/comment-page- |
Other Records
| Field | Value |
|---|---|
| sitemap | http://xombit.com/sitemaps/xombit-com.xml |
| sitemap | http://xombit.com/sitemaps/xombit-com.xml.gz |