ethnologue.com
robots.txt
Robots Exclusion Standard data for ethnologue.com
Resource Scan
Scan Details
Site Domain | ethnologue.com |
Base Domain | ethnologue.com |
Scan Status | Ok |
Last Scan | 2024-05-26T08:44:45+00:00 |
Next Scan | 2024-06-25T08:44:45+00:00 |
Last Scan
Scanned | 2024-05-26T08:44:45+00:00 |
URL | https://ethnologue.com/robots.txt |
Redirect | https://www.ethnologue.com/robots.txt |
Redirect Domain | www.ethnologue.com |
Redirect Base | ethnologue.com |
Domain IPs | 172.66.40.159, 172.66.43.97, 2606:4700:3108::ac42:289f, 2606:4700:3108::ac42:2b61 |
Redirect IPs | 172.66.40.159, 172.66.43.97, 2606:4700:3108::ac42:289f, 2606:4700:3108::ac42:2b61 |
Response IP | 172.66.43.97 |
Found | Yes |
Hash | e3911d298458c2697809535f16233683605c02700711fe50cb51f99b1293eeda |
SimHash | e98d0888a992 |
Groups
*
Rule | Path |
---|---|
Disallow | /region/ |
Disallow | /browse/index.html |
Disallow | /country/index.html |
Disallow | /language/index.html |
Disallow | /subgroup/index.html |
Other Records
Field | Value |
---|---|
sitemap | https://www.ethnologue.com/sitemap.xml |