mysupergeek.com
robots.txt
Robots Exclusion Standard data for mysupergeek.com
Resource Scan
Scan Details
Site Domain | mysupergeek.com |
Base Domain | mysupergeek.com |
Scan Status | Ok |
Last Scan | 2025-09-28T18:07:35+00:00 |
Next Scan | 2025-10-12T18:07:35+00:00 |
Last Scan
Scanned | 2025-09-28T18:07:35+00:00 |
URL | https://mysupergeek.com/robots.txt |
Domain IPs | 104.26.12.34, 104.26.13.34, 172.67.72.88, 2606:4700:20::681a:c22, 2606:4700:20::681a:d22, 2606:4700:20::ac43:4858 |
Response IP | 104.26.13.34 |
Found | Yes |
Hash | 0d18204cacaaeee3203a4ff96092702ea19bd4b206593459c1f5b8e3d81c6d56 |
SimHash | 2d444c644740 |
Groups
*
Rule | Path |
---|---|
Allow | */favicon/*? |
Allow | /js/*.js? |
Allow | /css/*.css? |
Allow | /blog?* |
Disallow | /*? |
Disallow | /terms |
Disallow | /acceptable-use-policy |
Disallow | /privacy |
Disallow | /customer/ |
Disallow | /writer/ |
Disallow | /132testme |
Disallow | /132testme2 |
Disallow | /404 |
Disallow | /?login-first=1 |
Disallow | /ext-lib/zopim-get-library |
Disallow | /ext-lib/ws-get-connection |
Disallow | /ext-lib/get-data-layer |
Disallow | /user/security-social-auth/callback/%5Cd |
Disallow | /top-geeks |
Disallow | /geek/public/ |
Other Records
Field | Value |
---|---|
sitemap | https://mysupergeek.com/sitemap.xml |
Warnings
- `host` is not a known field.