id.techinasia.com
robots.txt
Robots Exclusion Standard data for id.techinasia.com
Resource Scan
Scan Details
| Site Domain | id.techinasia.com |
| Base Domain | techinasia.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T05:07:35+00:00 |
| Next Scan | 2024-09-27T05:07:35+00:00 |
Last Scan
| Scanned | 2024-09-20T05:07:35+00:00 |
| URL | https://id.techinasia.com/robots.txt |
| Domain IPs | 152.42.204.65 |
| Response IP | 152.42.204.65 |
| Found | Yes |
| Hash | bf169997844b2102b76d872f6a8848d640c81b20ae085c08c8fac87b1a9eff8d |
| SimHash | eac239462d9c |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /core$ |
| Disallow | /core/ |
| Disallow | /vendor$ |
| Disallow | /vendor/ |
| Disallow | /tag$ |
| Disallow | /tag/ |
| Disallow | /category$ |
| Disallow | /category/ |
| Disallow | /wp-content/cache |
| Disallow | */trackback$ |
| Disallow | */feed$ |
| Disallow | */comments$ |
| Disallow | /story/ |
| Disallow | /jobs$ |
| Disallow | /jobs/ |
| Disallow | /companies$ |
| Disallow | /companies/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://id.techinasia.com/sitemap_index.xml |