Log In Sign Up

ar.y-axis.com
robots.txt

Robots Exclusion Standard data for ar.y-axis.com

Resource Scan

Scan Details

Site Domain ar.y-axis.com
Base Domain y-axis.com
Scan Status Ok
Last Scan2025-10-18T01:57:19+00:00
Next Scan 2025-11-17T01:57:19+00:00

Last Scan

Scanned2025-10-18T01:57:19+00:00
URL https://ar.y-axis.com/robots.txt
Domain IPs 2001:41d0:248:2500::888, 54.38.227.216
Response IP 54.38.227.216
Found Yes
Hash fd8331618cda15c2922cf1cc27b0755d8a0472eb4c9d3727cff4315e83e5984a
SimHash d2ad58638d42

Groups

*

Rule Path
Disallow /visa/invest/uk/start-up/visa/
Disallow /study-overseas/
Disallow /scholarship/australia/macquarie-vice-chancellors-international-scholarships/
Disallow /blog/australia-cancels-visas-of-violent-migrants/
Disallow /concierge/pre-post-landing-services/germany/
Disallow /migrate/dubai-job-seeker-visa/
Disallow /news/uae-extends-eligibility-uae-golden-visa/Dubai/
Disallow /news/us-reached-cap-count-for-additional-h-2b-visas-for-first-half-of-fy-2025/Cap/
Disallow /y-zapping/
Disallow /visa/work/china/
Disallow /visa/study/australia/macquarie-university-scholarships-for-international-students/
Disallow /search/
Disallow /2018/10/
Disallow /events/
Disallow /account/
Disallow /downloads/
Disallow /author/
Disallow /change-password/
Disallow /category/
Disallow /brochures/
Disallow /news/author/
Disallow /visa-frauds/author
Disallow /visa-frauds/2019
Disallow /visa-frauds/page
Disallow /visa-frauds/tag
Disallow /visa-frauds/category
Disallow /immigration-frauds/category
Disallow /immigration-frauds/2019
Disallow /immigration-frauds/tag
Disallow /immigration-frauds/page
Disallow /immigration-frauds/author
Disallow /wp-admin/
Disallow /wp-admin/admin-ajax.php
Disallow /wp-login.php
Disallow /events1/
Disallow /tighten/
Disallow /resumewriting/
Disallow /country/
Disallow /overseas-jobs/2016
Disallow /overseas-jobs/2019
Disallow /overseas-jobs/2017
Disallow /overseas-jobs/wp-login
Disallow /overseas-jobs/wp-admin
Disallow /overseas-jobs/category
Disallow /overseas-jobs/tag
Disallow /overseas-jobs/author
Disallow /overseas-jobs/page
Disallow /opp_industry/
Disallow /opp_country/
Disallow /opportunities/
Disallow /news/author/
Disallow /news/page/
Disallow /news/2014/
Disallow /news/2015/
Disallow /news/2016/
Disallow /news/2017/
Disallow /news/2018/
Disallow /news/2019
Disallow /news/tag/
Disallow /news/page
Disallow /news/category/
Disallow /form-template/
Disallow /?industry
Disallow /test/
Disallow /smart_faq/
Disallow /revised_tasmanian_skilled_occupation_list_2016-17_effective_3_july_2017-2/
Disallow /skillselect-invitation-results-26-10-2016-occupation-ceilings/
Disallow /skillselect-invitation-results-29-3-2017-occupation-ceilings/
Disallow /skillselect-invitation-results-6-9-2017-occupation-ceilings/
Disallow /skillselect-invitation-round-26-7-2017-occupation-ceilings/
Disallow /skillselect-invitation-round-results-10-5-2017-occupation-ceilings/
Disallow /skillselect-invitation-round-results-21-12-16-occupation-ceilings/
Disallow /skillselect-invitation-round-results-7-06-2017-occupation-ceilings/
Disallow /skillselect-invitation-round-results-8-6-2016-occupational-ceilings/
Disallow /skillselect-invitation-round-results-9-11-2016-occupation-ceilings/
Disallow /skill-select-invitation-round-results-as-on-14-september-2016/
Disallow /skillselect-invitation-rounds-21-6-2017-occupation-ceilings/
Disallow /skillselect-results-invitation-round-20-09-2017-occupation-ceilings/
Disallow /skillselect-update-invitation-results-22-06-2016-occupation-ceilings/
Disallow /skills-select-invitation-results-26-4-2017-occupation-ceilings/
Disallow /wp-content/uploads/2018/06/Skillselect-invitation-6-06-2018-ceilings.pdf
Disallow /wp-content/uploads/2018/08/Skillselect-Result-11-7-2018-Ceilings.pdf
Disallow /wp-content/uploads/2017/10/VETASSESS-General-Occupation-List-Revised-26-4-2017.pdf
Disallow /wp-content/uploads/2018/07/Queensland-Skilled-Occupation-Lists-02-07-2018.pdf
Disallow /wp-content/uploads/2017/11/Skillselect-20-12-2017-results-occupation-ceilings.pdf
Disallow /wp-content/uploads/2018/12/Skillselect-Invitation-Results-11-10-2018-Ceilings.pdf
Disallow /wp-content/uploads/2017/10/Skillselect-Invitation-Round-Results-7-06-2017-occupation-ceilings.pdf
Disallow /wp-content/uploads/2018/10/Skillselect-Results-11-09-2018-Ceilings.pdf
Disallow /wp-content/uploads/2017/10/skillselect-invitation-round-results-10-5-2017-occupation-ceilings.pdf
Disallow /wp-content/uploads/2017/10/Skillselect-Invitation-Round-26-7-2017-Occupation-Ceilings.pdf
Disallow /wp-content/uploads/2017/11/Skillselect-9-11-2017-results-occupation-ceilings.pdf
Disallow /wp-content/uploads/2017/10/Skillselect-update-invitation-results-22-06-2016-occupation-ceilings.pdf
Disallow /wp-content/uploads/2017/10/Queensland-List-2016-17.pdf
Disallow /wp-content/uploads/2018/06/Skillselect-results-23-05-2018-ceilings.pdf
Disallow /wp-content/uploads/2017/10/skillselect-results-invitation-round-20-09-2017-occupation-Ceilings.pdf
Disallow /wp-content/uploads/2018/01/Skillselect-18-01-2018-results-occupaiton-ceilings.pdf
Disallow /wp-content/uploads/2017/10/skillselect-invitation-round-results-8-6-2016-occupational-ceilings.pdf
Disallow /wp-content/uploads/2017/10/skillselect-update-invitation-results-12-April-2017-occupation-ceilings.pdf
Disallow /wp-content/uploads/2018/07/Victoria-University-Fee-Schedule-2018.pdf
Disallow /wp-content/uploads/2018/05/Skillselect-04-04-2018-results-ceilings.pdf
Disallow /wp-content/uploads/2018/08/Tasmanian_Skilled_Occupations_List_TSOL_2017-18_-_July_2018_update-1.pdf
Disallow /wp-content/uploads/2018/07/Occupational-Health-and-Safety-Adviser-Information-Sheet.pdf
Disallow /wp-content/uploads/2017/10/Skillselect-update-9-08-2017-Occupationa-Ceilings.pdf
Disallow /wp-content/uploads/2018/01/Skillselect-07-03-2018-Occupation-Ceilings.pdf
Disallow /wp-content/uploads/2017/10/NZ-New-Points-Test-LTSSL.pdf
Disallow /wp-content/uploads/2018/08/NT-15-AUG-2018.pdf
Disallow /wp-content/uploads/2018/05/Skillselect-09-05-2018-results-Ceilings.pdf
Disallow /skillselect-update-9-08-2017-occupationa-ceilings/
Disallow /skillselect-update-23-08-2017-occupation-ceilings/
Disallow /skillselect-update-20-07-2016-occupation-ceilings/
Disallow /skillselect-results-3-08-2016-occupation-ceilings/
Disallow /skillselect-results-24-may-2017-occupation-ceilings/
Disallow /skillselect-results-18-01-2017/
Disallow /skillselect-results-17-08-2016-occupation-ceilings/
Disallow /skillselect-results-1-3-2017-occupation-ceilings/
Disallow /skillselect-results-01-9-2016-occupation-ceilings/
Disallow /skillselect-results-01-02-2017-occupation-ceilings/
Disallow /sa-4-7-2017/
Disallow /removed-occupations-from-csol-effective-19-4-2017/
Disallow /queensland-state-occupations-list-dec-2016/
Disallow /queensland-list-2016-17/
Disallow /occupation-ceilings-for-2016-2017/
Disallow /occupation-ceilings-after-26-4-2017/
Disallow /occupation-ceilings/
Disallow /nsw-priority-sol-25-09-2017/
Disallow /nsw-orana-19-04-2017/
Disallow */?amp=1
Disallow /nsw-190-priority-skilled-occupation-list-2016-17-1/
Disallow /msa_feeschedule_2017-18/
Disallow /mltssl-called-as-sol-earlier/
Disallow /icaa-new-fee-details/
Disallow /flagged-occupations-on-the-sol-for-2016-17-1/
Disallow /designated-areas-2016/
Disallow /consolidated-list-16-01-2017/
Disallow /combined-list-called-as-csol-earlier/
Disallow /chinese-qlfns-verification-pricing-table-jan-2017/
Disallow /act-occupation-list-sept-16/
Disallow /act-occupation-list-july-17/
Disallow /act-occupation-list-5-july-17/
Disallow /vetassess-general-occupation-list-revised-26-4-2017/
Disallow /new-migrants-to-be-banned-from-sydney-and-melbourne/
Disallow /no-access/
Disallow /news-tags/
Disallow /test-news-one/
Disallow /function/
Disallow /location/
Disallow /openings/page/2/
Disallow /openings/page/3/
Disallow /immigration-frauds/category/
Disallow /immigration-frauds/tag/
Disallow /visa-frauds/category/
Disallow /visa-frauds/tag/
Disallow /immigration-frauds/2019/
Disallow /visa-frauds/page/
Disallow /freeassessmentpointscalculator/
Disallow /coaching-test/

googlebot-news

Rule Path
Disallow /news/tag/
Disallow /news/category/
Disallow /news/author
Disallow /news/page
Disallow /news/2014/
Disallow /news/2015/
Disallow /news/2016/
Disallow /news/2017/
Disallow /news/2018/
Disallow /news/2019
Disallow /news/author/

semrushbot

Rule Path
Disallow /visa-frauds/
Disallow /immigration-frauds/

ia_archiver

Rule Path Comment
Disallow /author/ -
Disallow /category/ -
Disallow /wp-content/uploads/2018/06/Skillselect-invitation-6-06-2018-ceilings.pdf -
Disallow /wp-content/uploads/2018/08/Skillselect-Result-11-7-2018-Ceilings.pdf -
Disallow /wp-content/uploads/2017/10/VETASSESS-General-Occupation-List-Revised-26-4-2017.pdf -
Disallow /wp-content/uploads/2018/07/Queensland-Skilled-Occupation-Lists-02-07-2018.pdf -
Disallow /wp-content/uploads/2017/11/Skillselect-20-12-2017-results-occupation-ceilings.pdf -
Disallow /wp-content/uploads/2018/12/Skillselect-Invitation-Results-11-10-2018-Ceilings.pdf -
Disallow /wp-content/uploads/2017/10/Skillselect-Invitation-Round-Results-7-06-2017-occupation-ceilings.pdf -
Disallow /wp-content/uploads/2018/10/Skillselect-Results-11-09-2018-Ceilings.pdf -
Disallow /wp-content/uploads/2017/10/skillselect-invitation-round-results-10-5-2017-occupation-ceilings.pdf -
Disallow /wp-content/uploads/2017/10/Skillselect-Invitation-Round-26-7-2017-Occupation-Ceilings.pdf -
Disallow /wp-content/uploads/2017/11/Skillselect-9-11-2017-results-occupation-ceilings.pdf -
Disallow /wp-content/uploads/2017/10/Skillselect-update-invitation-results-22-06-2016-occupation-ceilings.pdf -
Disallow /wp-content/uploads/2017/10/Queensland-List-2016-17.pdf -
Disallow /wp-content/uploads/2018/06/Skillselect-results-23-05-2018-ceilings.pdf -
Disallow /wp-content/uploads/2017/10/skillselect-results-invitation-round-20-09-2017-occupation-Ceilings.pdf -
Disallow /wp-content/uploads/2018/01/Skillselect-18-01-2018-results-occupaiton-ceilings.pdf -
Disallow /wp-content/uploads/2017/10/skillselect-invitation-round-results-8-6-2016-occupational-ceilings.pdf -
Disallow /wp-content/uploads/2017/10/skillselect-update-invitation-results-12-April-2017-occupation-ceilings.pdf -
Disallow /wp-content/uploads/2018/07/Victoria-University-Fee-Schedule-2018.pdf -
Disallow /wp-content/uploads/2018/05/Skillselect-04-04-2018-results-ceilings.pdf -
Disallow /wp-content/uploads/2018/08/Tasmanian_Skilled_Occupations_List_TSOL_2017-18_-_July_2018_update-1.pdf -
Disallow /wp-content/uploads/2018/07/Occupational-Health-and-Safety-Adviser-Information-Sheet.pdf -
Disallow /wp-content/uploads/2017/10/Skillselect-update-9-08-2017-Occupationa-Ceilings.pdf -
Disallow /wp-content/uploads/2018/01/Skillselect-07-03-2018-Occupation-Ceilings.pdf -
Disallow /wp-content/uploads/2017/10/NZ-New-Points-Test-LTSSL.pdf -
Disallow /wp-content/uploads/2018/08/NT-15-AUG-2018.pdf -
Disallow /wp-content/uploads/2018/05/Skillselect-09-05-2018-results-Ceilings.pdf -
Disallow /study-in-germany-visa/ -
Disallow /no-access/ -
Disallow /news/author/ -
Disallow /events/ -
Disallow /2018/10/ -
Disallow /opp_country/ -
Disallow /country/ -
Disallow /news/page -
Disallow /overseas-jobs/page -
Disallow /overseas-jobs/tag -
Disallow /news/category -
Disallow /study-2/ -
Disallow /news/tag -
Disallow /events/nggallery/ -
Disallow /overseas-jobs/category -
Disallow /function -
Disallow /location -
Disallow /openings/page/2 -
Disallow /openings/page/3 -
Disallow /immigration-frauds/ -
Disallow /visa-frauds/ -
Disallow /pointscalculator/images/loading.gif -
Disallow /wp-content/plugins/contact-form-7/images/ajax-loader.gif -
Disallow /wp-content/themes/iGtheme/images/logo.jpg -
Disallow /wp-content/ -
Disallow /openings/ -
Disallow /category/ -
Disallow /author/ -
Disallow /10-things-you-should-know-about-y-axis-study-abroad/ -
Disallow /?s=%7Bsearch_term_string%7D -
Disallow /aboutus/?highlight=%7Bsearch_term_string%7D -
Disallow /aboutus/?highlight=search_term_string -
Disallow /adyar-chennai/?highlight=%7Bsearch_term_string%7D -
Disallow /adyar-chennai/?highlight=search_term_string -
Disallow /ahmedabad/?highlight=%7Bsearch_term_string%7D -
Disallow /ahmedabad/?highlight=search_term_string -
Disallow /andheri-mumbai/?highlight=%7Bsearch_term_string%7D -
Disallow /andheri-mumbai/?highlight=search_term_string -
Disallow /australia-immigration-updates/feed/ -
Disallow /bandra-mumbai/?highlight=%7Bsearch_term_string%7D -
Disallow /bandra-mumbai/?highlight=search_term_string -
Disallow /baner-pune/?highlight=%7Bsearch_term_string%7D -
Disallow /baner-pune/?highlight=search_term_string -
Disallow /bangalore/?highlight=%7Bsearch_term_string%7D -
Disallow /bangalore/?highlight=search_term_string -
Disallow /banjara-hills/?highlight=%7Bsearch_term_string%7D -
Disallow /banjara-hills/?highlight=search_term_string -
Disallow /bund-garden-pune/?highlight=%7Bsearch_term_string%7D -
Disallow /bund-garden-pune/?highlight=search_term_string -
Disallow /camac-street-kolkata/?highlight=%7Bsearch_term_string%7D -
Disallow /camac-street-kolkata/?highlight=search_term_string -
Disallow /careers/?highlight=%7Bsearch_term_string%7D -
Disallow /careers/?highlight=search_term_string -
Disallow /chennai/?highlight=%7Bsearch_term_string%7D -
Disallow /chennai/?highlight=search_term_string -
Disallow /coimbatore/?highlight=%7Bsearch_term_string%7D -
Disallow /coimbatore/?highlight=search_term_string -
Disallow /concierge/?highlight=%7Bsearch_term_string%7D -
Disallow /concierge/?highlight=search_term_string -
Disallow /connaught-place-delhi/?highlight=%7Bsearch_term_string%7D -
Disallow /connaught-place-delhi/?highlight=search_term_string -
Disallow /delhi/?highlight=%7Bsearch_term_string%7D -
Disallow /delhi/?highlight=search_term_string -
Disallow /dubai/?highlight=%7Bsearch_term_string%7D -
Disallow /dubai/?highlight=search_term_string -
Disallow /dubai-jlt/?highlight=%7Bsearch_term_string%7D -
Disallow /dubai-jlt/?highlight=search_term_string -
Disallow /electronic-city-bangalore/?highlight=%7Bsearch_term_string%7D -
Disallow /electronic-city-bangalore/?highlight=search_term_string -
Disallow /eligibility/?highlight=%7Bsearch_term_string%7D -
Disallow /eligibility/?highlight=search_term_string -
Disallow /five-things-study-overseas/?highlight=%7Bsearch_term_string%7D -
Disallow /five-things-study-overseas/?highlight=search_term_string -
Disallow /frequently-asked-questions/?highlight=%7Bsearch_term_string%7D -
Disallow /frequently-asked-questions/?highlight=search_term_string -
Disallow /goregaon-mumbai/?highlight=%7Bsearch_term_string%7D -
Disallow /goregaon-mumbai/?highlight=search_term_string -
Disallow /gurgaon/?highlight=%7Bsearch_term_string%7D -
Disallow /gurgaon/?highlight=search_term_string -
Disallow /hebbal-bangalore/?highlight=%7Bsearch_term_string%7D -
Disallow /hebbal-bangalore/?highlight=search_term_string -
Disallow /hyderabad/?highlight=%7Bsearch_term_string%7D -
Disallow /hyderabad/?highlight=search_term_string -
Disallow /job-%26lt%3Bspanstyle%3D%26 039;background-color:
Disallow /job-search-services/?highlight=%7Bsearch_term_string%7D -
Disallow /job-search-services/?highlight=search_term_string -
Disallow /jubilee-hills/?highlight=%7Bsearch_term_string%7D -
Disallow /jubilee-hills/?highlight=search_term_string -
Disallow /kolkata/?highlight=%7Bsearch_term_string%7D -
Disallow /kolkata/?highlight=search_term_string -
Disallow /kolkata-salt-lake-city/?highlight=%7Bsearch_term_string%7D -
Disallow /kolkata-salt-lake-city/?highlight=search_term_string -
Disallow /koramangala-bangalore/?highlight=%7Bsearch_term_string%7D -
Disallow /koramangala-bangalore/?highlight=search_term_string -
Disallow /kukatpally-hyderabad/?highlight=%7Bsearch_term_string%7D -
Disallow /kukatpally-hyderabad/?highlight=search_term_string -
Disallow /melbourne/?highlight=%7Bsearch_term_string%7D -
Disallow /melbourne/?highlight=search_term_string -
Disallow /migrate/?highlight=%7Bsearch_term_string%7D -
Disallow /migrate/?highlight=search_term_string -
Disallow /migrate/austria/?highlight=%7Bsearch_term_string%7D -
Disallow /migrate/austria/?highlight=search_term_string -
Disallow /migrate/austria-job-seeker-visa/?highlight=%7Bsearch_term_string%7D -
Disallow /migrate/austria-job-seeker-visa/?highlight=search_term_string -
Disallow /migrate/canada/?highlight=%7Bsearch_term_string%7D -
Disallow /migrate/canada/?highlight=search_term_string -
Disallow /migrate/canada/express-entry/?highlight=%7Bsearch_term_string%7D -
Disallow /migrate/canada/express-entry/?highlight=search_term_string -
Disallow /migrate/germany/?highlight=%7Bsearch_term_string%7D -
Disallow /migrate/germany/?highlight=search_term_string -
Disallow /migrate/singapore/?highlight=%7Bsearch_term_string%7D -
Disallow /migrate/singapore/?highlight=search_term_string -
Disallow /migrate/uk/?highlight=%7Bsearch_term_string%7D -
Disallow /migrate/uk/?highlight=search_term_string -
Disallow /migrate/usa/?highlight=%7Bsearch_term_string%7D -
Disallow /migrate/usa/?highlight=search_term_string -
Disallow /new-migrants-to-be-banned-from-sydney-and-melbourne/feed/ -
Disallow /noida/?highlight=%7Bsearch_term_string%7D -
Disallow /noida/?highlight=search_term_string -
Disallow /openings/ -
Disallow /overseas-placement/ -
Disallow /page/ -
Disallow /pune/?highlight=%7Bsearch_term_string%7D -
Disallow /pune/?highlight=search_term_string -
Disallow /rbroad-somajiguda/?highlight=%7Bsearch_term_string%7D -
Disallow /rbroad-somajiguda/?highlight=search_term_string -
Disallow /satellite-ahmedabad/?highlight=%7Bsearch_term_string%7D -
Disallow /satellite-ahmedabad/?highlight=search_term_string -
Disallow /search/ -
Disallow /sitemap/ -
Disallow /sitemap-misc.html -
Disallow /sitemap-pt-page-2019-01.html -
Disallow /sitemap-pt-page-2019-02.html -
Disallow /sitemap-pt-page-2019-03.html -
Disallow /sitemap-pt-page-2019-04.html -
Disallow /sitemap-pt-page-2019-05.html -
Disallow /sitemap-pt-page-2019-06.html -
Disallow /sitemap-pt-page-2019-07.html -
Disallow /sitemap-pt-page-2019-08.html -
Disallow /sitemap-pt-page-2019-09.html -
Disallow /sitemap-pt-page-2019-10.html -
Disallow /sitemap-pt-page-2019-11.html -
Disallow /sitemap-pt-page-2019-12.html -
Disallow /sitemap-pt-page-2020-01.html -
Disallow /sitemap-pt-post-2018-10.html -
Disallow /skilledimmigrationpointscalculator/ -
Disallow /sproad-secunderabad/?highlight=%7Bsearch_term_string%7D -
Disallow /sproad-secunderabad/?highlight=search_term_string -
Disallow /terms-conditions/?highlight=%7Bsearch_term_string%7D -
Disallow /terms-conditions/?highlight=search_term_string -
Disallow /testimonials-reviews-success-stories/?highlight=%7Bsearch_term_string%7D -
Disallow /testimonials-reviews-success-stories/?highlight=search_term_string -
Disallow /thane-mumbai/?highlight=%7Bsearch_term_string%7D -
Disallow /thane-mumbai/?highlight=search_term_string -
Disallow /vashi-mumbai/?highlight=%7Bsearch_term_string%7D -
Disallow /vashi-mumbai/?highlight=search_term_string -
Disallow /visa-frauds -
Disallow /whitefield/?highlight=%7Bsearch_term_string%7D -
Disallow /whitefield/?highlight=search_term_string -
Disallow /wp-content/ -
Disallow /wp-json/ -
Disallow /wp-login.php -
Disallow /xmlrpc.php -
Disallow /immigration-complaints/ -
Disallow /search/search_term_string/ -
Disallow /search/search_term_string/ -
Disallow /sitemap.html -
Disallow /visa-success-stories-november/ -
Disallow /visa-success-stories/ -

omniexplorer_bot

Rule Path
Disallow /

freefind

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

jetbot/1.0

Rule Path
Disallow /

jetbot

Rule Path
Disallow /

webvac

Rule Path
Disallow /

stanford

Rule Path
Disallow /

naver

Rule Path
Disallow /

dumbot

Rule Path
Disallow /

hatena antenna

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

grub

Rule Path
Disallow /

webzip

Rule Path
Disallow /

larbin

Rule Path
Disallow /

b2w/0.1

Rule Path
Disallow /

copernic

Rule Path
Disallow /

psbot

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

netmechanic

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

crescent

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

prowebwalker

Rule Path
Disallow /

cheesebot

Rule Path
Disallow /

lnspiderguy

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

stanford comp sci

Rule Path
Disallow /

miixpc

Rule Path
Disallow /

telesoft

Rule Path
Disallow /

website quester

Rule Path
Disallow /

moget/2.1

Rule Path
Disallow /

webzip/4.0

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

netants

Rule Path
Disallow /

mister pix

Rule Path
Disallow /

webauto

Rule Path
Disallow /

thenomad

Rule Path
Disallow /

www-collector-e

Rule Path
Disallow /

rma

Rule Path
Disallow /

libweb/clshttp

Rule Path
Disallow /

asterias

Rule Path
Disallow /

httplib

Rule Path
Disallow /

turingos

Rule Path
Disallow /

spanner

Rule Path
Disallow /

infonavirobot

Rule Path
Disallow /

harvest/1.5

Rule Path
Disallow /

bullseye/1.0

Rule Path
Disallow /

crescent internet toolpak http ole control v.1.0

Rule Path
Disallow /

cherrypickerse/1.0

Rule Path
Disallow /

cherrypickerelite/1.0

Rule Path
Disallow /

webbandit/3.50

Rule Path
Disallow /

nicerspro

Rule Path
Disallow /

microsoft url control - 5.01.4511

Rule Path
Disallow /

dittospyder

Rule Path
Disallow /

foobot

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

botalot

Rule Path
Disallow /

lwp-trivial/1.34

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

bunnyslippers

Rule Path
Disallow /

microsoft url control - 6.00.8169

Rule Path
Disallow /

urly warning

Rule Path
Disallow /

wget/1.6

Rule Path
Disallow /

wget/1.5.3

Rule Path
Disallow /

wget

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

cosmos

Rule Path
Disallow /

moget

Rule Path
Disallow /

hloader

Rule Path
Disallow /

humanlinks

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

mata hari

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

web image collector

Rule Path
Disallow /

the intraformant

Rule Path
Disallow /

true_robot/1.0

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

blowfish/1.0

Rule Path
Disallow /

jennybot

Rule Path
Disallow /

miixpc/4.2

Rule Path
Disallow /

builtbottough

Rule Path
Disallow /

propowerbot/2.14

Rule Path
Disallow /

backdoorbot/1.0

Rule Path
Disallow /

tocrawl/urldispatcher

Rule Path
Disallow /

webenhancer

Rule Path
Disallow /

suzuran

Rule Path
Disallow /

vci webviewer vci webviewer win32

Rule Path
Disallow /

vci

Rule Path
Disallow /

szukacz/1.4

Rule Path
Disallow /

queryn metasearch

Rule Path
Disallow /

openfind data gathere

Rule Path
Disallow /

openfind

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

zeus

Rule Path
Disallow /

repomonkey bait & tackle/v1.01

Rule Path
Disallow /

repomonkey

Rule Path
Disallow /

microsoft url control

Rule Path
Disallow /

openbot

Rule Path
Disallow /

url control

Rule Path
Disallow /

zeus link scout

Rule Path
Disallow /

zeus 32297 webster pro v2.9 win32

Rule Path
Disallow /

webster pro

Rule Path
Disallow /

erocrawler

Rule Path
Disallow /

linkscan/8.1a unix

Rule Path
Disallow /

keyword density/0.9

Rule Path
Disallow /

kenjin spider

Rule Path
Disallow /

iron33/1.0.2

Rule Path
Disallow /

bookmark search tool

Rule Path
Disallow /

getright/4.2

Rule Path
Disallow /

fairad client

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

aqua_products

Rule Path
Disallow /

radiation retriever 1.1

Rule Path
Disallow /

flaming attackbot

Rule Path
Disallow /

oracle ultra search

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

perman

Rule Path
Disallow /

searchpreview

Rule Path
Disallow /

sootle

Rule Path
Disallow /

es

Rule Path
Disallow /

enterprise_search/1.0

Rule Path
Disallow /

enterprise_search

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://ar.y-axis.com/sitemap_index.xml
sitemap https://ar.y-axis.com/page_sitemap.xml
sitemap https://ar.y-axis.com/blog/sitemap_index.xml
sitemap https://ar.y-axis.com/overseas-jobs/sitemap.xml
sitemap https://ar.y-axis.com/web-story-sitemap.xml
sitemap https://ar.y-axis.com/news/sitemap_index.xml
sitemap https://ar.y-axis.com/image_sitemap.xml
Back to top

Comments

  • Disable Bad Bots
Back to top