ar.forvo.com
robots.txt

Robots Exclusion Standard data for ar.forvo.com

Resource Scan

Scan Details

Site Domain ar.forvo.com
Base Domain forvo.com
Scan Status Ok
Last Scan2024-05-17T21:21:40+00:00
Next Scan 2024-05-24T21:21:40+00:00

Last Scan

Scanned2024-05-17T21:21:40+00:00
URL https://ar.forvo.com/robots.txt
Domain IPs 104.20.252.20, 104.20.253.20, 172.67.0.56, 2606:4700:10::6814:fc14, 2606:4700:10::6814:fd14, 2606:4700:10::ac43:38
Response IP 172.67.0.56
Found Yes
Hash f80dce910e8f503e32d1b75cab7f6b166aa940466e219017e06c0fcc156ee710
SimHash 5927f65054d8

Groups

*

Rule Path
Disallow /_presentation/
Disallow /_templates/
Disallow /_utils/
Disallow /private/
Disallow /rss/
Disallow /rss-pending/
Disallow /rss-tag/
Disallow /rss-user/
Disallow /messages/
Disallow /offline/
Disallow /word-report/
Disallow /votes-detail/
Disallow /notsatisfied/
Disallow /favorite/
Disallow /cron/
Disallow /demo/
Disallow /scripts/
Disallow /vendor/
Disallow /GeoData/
Disallow /search/
Disallow /search
Disallow /search-
Disallow /scots-magazine/
Disallow /translate-word-extra-info/
Disallow /*?yumingid=
Disallow /*?lineid=
Disallow /*?width=
Disallow /*?height=
Disallow /*?iframe=
Disallow /*?code=
Disallow /*?pagewanted=
Disallow /*?ved=
Disallow /*?usg=
Disallow /*?ei=
Disallow /*?sa=
Disallow /*?newsid=
Disallow /*%26yumingid%3D
Disallow /*%26lineid%3D
Disallow /*%26width%3D
Disallow /*%26height%3D
Disallow /*%26iframe%3D
Disallow /*%26code%3D
Disallow /*%26pagewanted%3D
Disallow /*%26ved%3D
Disallow /*%26usg%3D
Disallow /*%26ei%3D
Disallow /*%26sa%3D
Disallow /*%26newsid%3D
Allow /
Allow /_presentation/img/
Allow /_presentation/css/
Allow /_presentation/js/
Allow /_presentation/assets/

ia_archiver

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

twitterbot

Rule Path
Disallow

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4