forum.wordreference.com
robots.txt
Robots Exclusion Standard data for forum.wordreference.com
Resource Scan
Scan Details
| Site Domain | forum.wordreference.com |
| Base Domain | wordreference.com |
| Scan Status | Ok |
| Last Scan | 2024-09-14T13:42:06+00:00 |
| Next Scan | 2024-10-14T13:42:06+00:00 |
Last Scan
| Scanned | 2024-09-14T13:42:06+00:00 |
| URL | https://forum.wordreference.com/robots.txt |
| Domain IPs | 2a01:4ff:f0:b7ac::1, 5.161.250.192 |
| Response IP | 5.161.250.192 |
| Found | Yes |
| Hash | 385d8da991a4d972d45cfa3c842840c3f9f70f94716e0c4a2a6e3b23e73485d2 |
| SimHash | 3e73ea8254ab |
Groups
mediapartners-google
googlebot-mobile
googlebot
teoma
slurp
yandex
baiduspider
naverbot
yeti
yandex
bingbot
applebot
facebookexternalhit
| Rule | Path |
|---|---|
| Disallow | /test/ |
| Disallow | /account/ |
| Disallow | /admin.php |
| Disallow | /ajax/ |
| Disallow | /conversations/ |
| Disallow | /events/birthdays/ |
| Disallow | /events/monthly |
| Disallow | /events/weekly |
| Disallow | /find-new/ |
| Disallow | /forums/-/ |
| Disallow | /forums/tweets/ |
| Disallow | /goto/ |
| Disallow | /help/ |
| Disallow | /login/ |
| Disallow | /lost-password/ |
| Disallow | /media/category/ |
| Disallow | /media/keyword/ |
| Disallow | /media/user/ |
| Disallow | /media/service/ |
| Disallow | /media/submit/ |
| Disallow | /misc/style?* |
| Disallow | /misc/quick-navigation-menu?* |
| Disallow | /online/ |
| Disallow | /pages/conduct/ |
| Disallow | /pages/privacy/ |
| Disallow | /posts/ |
| Disallow | /threads/tera-tweet-from-* |
| Disallow | /wiki/special/ |
| Disallow | /forums/*?order= |
| Disallow | /members/ |
| Disallow | *796189* |
| Disallow | *6248* |
| Disallow | *2454464* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
*
| Rule | Path |
|---|---|
| Disallow | / |
Comments