wise-geek.com
robots.txt
Robots Exclusion Standard data for wise-geek.com
Resource Scan
Scan Details
| Site Domain | wise-geek.com |
| Base Domain | wise-geek.com |
| Scan Status | Ok |
| Last Scan | 2024-10-26T18:29:58+00:00 |
| Next Scan | 2024-11-02T18:29:58+00:00 |
Last Scan
| Scanned | 2024-10-26T18:29:58+00:00 |
| URL | https://wise-geek.com/robots.txt |
| Redirect | https://www.wise-geek.com/robots.txt |
| Redirect Domain | www.wise-geek.com |
| Redirect Base | wise-geek.com |
| Domain IPs | 13.56.63.160, 13.57.89.2 |
| Redirect IPs | 108.157.254.108, 108.157.254.50, 108.157.254.81, 108.157.254.93, 2600:9000:2753:4e00:9:2198:cb00:93a1, 2600:9000:2753:5200:9:2198:cb00:93a1, 2600:9000:2753:7800:9:2198:cb00:93a1, 2600:9000:2753:8200:9:2198:cb00:93a1, 2600:9000:2753:9000:9:2198:cb00:93a1, 2600:9000:2753:cc00:9:2198:cb00:93a1, 2600:9000:2753:e400:9:2198:cb00:93a1, 2600:9000:2753:e800:9:2198:cb00:93a1 |
| Response IP | 108.157.254.81 |
| Found | Yes |
| Hash | e6769e0c1c7e1d5ebd253e1003028469c59c45682e58b5d83796def3c333ca91 |
| SimHash | ab10d32c2311 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /s/ |
| Disallow | /templates/ |
| Disallow | /d/ |
| Disallow | /related/ |
| Disallow | /relevant/ |
| Disallow | /videos/ |
| Disallow | /captcha.php |
| Disallow | /*?expand_article |
| Disallow | /*.js?cb= |
| Disallow | /quizzes* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.wise-geek.com/sitemap-wise-geek.com-index.xml |