techarp.com
robots.txt
Robots Exclusion Standard data for techarp.com
Resource Scan
Scan Details
| Site Domain | techarp.com |
| Base Domain | techarp.com |
| Scan Status | Ok |
| Last Scan | 2025-04-05T22:59:38+00:00 |
| Next Scan | 2025-04-12T22:59:38+00:00 |
Last Scan
| Scanned | 2025-04-05T22:59:38+00:00 |
| URL | https://techarp.com/robots.txt |
| Redirect | https://www.techarp.com/robots.txt |
| Redirect Domain | www.techarp.com |
| Redirect Base | techarp.com |
| Domain IPs | 104.21.46.73, 172.67.136.101 |
| Redirect IPs | 104.21.46.73, 172.67.136.101 |
| Response IP | 104.21.46.73 |
| Found | Yes |
| Hash | 79a37b1860633f4a9d307c189209c0cbfa63a72aeaa83cd7e96b927ec1ce0b71 |
| SimHash | 703808488212 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.techarp.com/sitemap_index.xml |