thetechlearn.com
robots.txt
Robots Exclusion Standard data for thetechlearn.com
Resource Scan
Scan Details
| Site Domain | thetechlearn.com |
| Base Domain | thetechlearn.com |
| Scan Status | Ok |
| Last Scan | 2025-10-13T21:15:27+00:00 |
| Next Scan | 2025-10-20T21:15:27+00:00 |
Last Scan
| Scanned | 2025-10-13T21:15:27+00:00 |
| URL | https://thetechlearn.com/robots.txt |
| Domain IPs | 104.21.33.243, 172.67.193.252, 2606:4700:3032::6815:21f3, 2606:4700:3037::ac43:c1fc |
| Response IP | 172.67.193.252 |
| Found | Yes |
| Hash | b245b83a117f6ff10bb187300b998c5ffc7087552f6e2035eefc638642687035 |
| SimHash | c2271011cdb2 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | *author* |
| Disallow | *?cat* |
| Disallow | *amp* |
| Disallow | *?u=* |
| Disallow | *?s=* |
| Disallow | /cdn |
| Disallow | *feed* |
| Disallow | *wp-content* |
| Disallow | *wp-admin* |
| Disallow | /2022 |
| Disallow | /2021 |
| Disallow | /2020 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.thetechlearn.com/sitemap_index.xml |
| sitemap | https://www.thetechlearn.com/video-downloader/sitemap_index.xml |