chineseinsfbay.com
robots.txt

Robots Exclusion Standard data for chineseinsfbay.com

Resource Scan

Scan Details

Site Domain chineseinsfbay.com
Base Domain chineseinsfbay.com
Scan Status Ok
Last Scan2024-11-08T20:54:01+00:00
Next Scan 2024-11-15T20:54:01+00:00

Last Scan

Scanned2024-11-08T20:54:01+00:00
URL https://www.chineseinsfbay.com/robots.txt
Domain IPs 52.8.152.70, 54.241.137.96
Response IP 52.8.152.70
Found Yes
Hash 961f0a3173b7ece3bca5827317d21d23ef16e075ccef7c98d2f3f878b44bbe18
SimHash c116b2fc49a0

Groups

*

Rule Path
Disallow /administrator/
Disallow /cache/
Disallow /editor/
Disallow /resume/
Disallow /mambots/
Disallow /media/
Disallow /modules/
Disallow /language/
Disallow /modules/
Disallow /components/
Disallow /installation/
Disallow /component/option%2Ccom_forum/Itemid%2C0/page%2Clogin/
Disallow /component/option%2Ccom_forum/Itemid%2C0/page%2Cposting/
Disallow /component/option%2Ccom_forum/Itemid%2C0/page%2Csearch/
Disallow /component/option%2Ccom_forum/Itemid%2C0/page%2Cprofile/mode%2Cviewprofile/
Disallow /component/option%2Ccom_forum/Itemid%2C37/page%2Clogin/
Disallow /component/option%2Ccom_forum/Itemid%2C37/page%2Cposting/
Disallow /component/option%2Ccom_forum/Itemid%2C37/page%2Csearch/
Disallow /component/option%2Ccom_forum/Itemid%2C37/page%2Cprofile/mode%2Cviewprofile/
Disallow /index3.php
Disallow /company/task_video/
Disallow /f/page_pppping/
Disallow /company/task_add3/
Disallow /accountant/task_add1/
Disallow /accountant/task_add3/
Disallow /accountant/task_video/
Disallow /travel/task_add1/
Disallow /travel/task_add3/
Disallow /travel/task_video/
Disallow /f/page_privmsg/mode_pppp/
Disallow /doctor/task_add3/
Disallow /doctor/task_add1/
Disallow /doctor/task_video/
Disallow /apartment/task_add1/
Disallow /apartment/task_add3/
Disallow /apartment/task_video/
Disallow /mb_convert_encoding%28%22/
Disallow /test/
Disallow /news/task_shownews/
Disallow /component/option%2Ccom_events/
Disallow /f/page_search/
Disallow /company/task_add1/
Disallow /company/task_add2/
Disallow /company/task_review/id*
Disallow /company/task_message/id*
Disallow /company/task_history/id*
Disallow /company/task_publishReview/id_*
Disallow /company/task_add3/id_*
Disallow /company/task_category/key*
Disallow /f/page_login.html
Disallow /f/page_login/
Disallow /f/page_grade.html
Disallow /f/page_masterapply.html
Disallow /f/page_privmsg/mode_pppp/u_*.html
Disallow /aboutus.html
Disallow /a.html
Disallow /user/task_myPersonalInfo.html
Disallow /company/task_guideline.html
Disallow /resume_company.html
Disallow /resume/task_manage.html
Disallow /type_topic.html
Disallow /type_reply.html
Disallow /type_company.html
Disallow /type_comment.html
Disallow /type_wiki.html
Disallow /aboutus/task_app.html
Disallow /register.html
Disallow /f/page_grade.html
Disallow /f/page_masterapply.html
Disallow /company/task_guideline.html
Disallow /resume_company.html
Disallow /resume/task_manage.html
Disallow /la_weblinks.html

dotbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

proximic

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

*

Rule Path
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /*.gif$
Disallow /*.png$
Disallow /*.bmp$

twitterbot

Rule Path
Disallow *
Allow /images
Allow /archives