adw-goe.academia.edu
robots.txt
Robots Exclusion Standard data for adw-goe.academia.edu
Resource Scan
Scan Details
| Site Domain | adw-goe.academia.edu |
| Base Domain | academia.edu |
| Scan Status | Ok |
| Last Scan | 2024-05-09T04:09:22+00:00 |
| Next Scan | 2024-05-23T04:09:22+00:00 |
Last Scan
| Scanned | 2024-05-09T04:09:22+00:00 |
| URL | https://adw-goe.academia.edu/robots.txt |
| Domain IPs | 108.157.254.49, 108.157.254.61, 108.157.254.8, 108.157.254.9 |
| Response IP | 108.157.254.9 |
| Found | Yes |
| Hash | ee72ec3f51afe74fcad76b04025b408ec2addf34b1228fc6208fcc2765c84d46 |
| SimHash | 62144110c591 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
msnbot
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
bingbot
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
slurp
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
duckduckbot
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
seznambot
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
naverbot
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
teoma
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
yandex
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
scoutjet
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
gurujibot
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
exabot
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
solbot
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
fast
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
voilabot
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
daumoa
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
architextspider
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
twitterbot
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
socscibot
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
ia_archiver
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
coccoc
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
browsershots
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
sitearc
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
cliqzbot
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
proximic
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
oncrawlbot
| Rule | Path |
|---|---|
| Disallow | /attachments/*/download_file |
| Disallow | /Jobs/Search |
| Disallow | /people/search |
| Disallow | /ac_search |
| Disallow | /users/search |
| Disallow | /ac_universities |
| Disallow | /ac_university_departments |
| Disallow | /document_viewer/build_vu_embeds/ |
| Disallow | /v0/* |
| Allow | /v0/users/*/following |
| Allow | /v0/users/*/coauthors |
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://sitemap.academia.edu/works_index.xml |
Comments