tech.us
robots.txt
Robots Exclusion Standard data for tech.us
Resource Scan
Scan Details
| Site Domain | tech.us |
| Base Domain | tech.us |
| Scan Status | Ok |
| Last Scan | 2025-09-09T10:14:36+00:00 |
| Next Scan | 2025-10-09T10:14:36+00:00 |
Last Scan
| Scanned | 2025-09-09T10:14:36+00:00 |
| URL | https://tech.us/robots.txt |
| Domain IPs | 199.60.103.154, 199.60.103.54 |
| Response IP | 199.60.103.54 |
| Found | Yes |
| Hash | 332589fe5b755c25fb1a2b4a81d2eb84fd5b2c27c2c7649d9ae49c8b4d8d83ad |
| SimHash | 6a4840d157d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /quiz-get-started |
| Disallow | /tech_quiz/quiz_v2/ |
| Disallow | /tech_quiz/quiz_v3/ |
| Disallow | /tech_quiz/quiz_v4/ |
| Disallow | /tech_quiz/quiz/api/ |
| Disallow | /tech_quiz/quiz/report/ |
| Disallow | /s/ |
| Disallow | /tech_quiz/ai_quiz1/ |
| Disallow | /tech_quiz/ai_quiz2/ |
| Disallow | /skyhawk/ |
| Disallow | /skyhawk_staging/ |
| Disallow | /data/ |
| Disallow | /blog-details/ |
| Disallow | /lp/ |
| Disallow | /hubfs/tech-stack/ |
| Disallow | /tag/ |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
| Disallow | /*?*hs_preview=* |
| Disallow | /*?*hsCacheBuster=* |
ia_archiver
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
| Disallow | /*?*hs_preview=* |
| Disallow | /*?*hsCacheBuster=* |
archive.org_bot
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
| Disallow | /*?*hs_preview=* |
| Disallow | /*?*hsCacheBuster=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://tech.us/sitemap.xml |