Log In Sign Up

mcqsportal.com
robots.txt

Robots Exclusion Standard data for mcqsportal.com

Resource Scan

Scan Details

Site Domain mcqsportal.com
Base Domain mcqsportal.com
Scan Status Ok
Last Scan2025-09-07T13:10:59+00:00
Next Scan 2025-10-07T13:10:59+00:00

Last Scan

Scanned2025-09-07T13:10:59+00:00
URL https://mcqsportal.com/robots.txt
Redirect https://www.mcqsportal.com/robots.txt
Redirect Domain www.mcqsportal.com
Redirect Base mcqsportal.com
Domain IPs 64.31.40.162
Redirect IPs 64.31.40.162
Response IP 64.31.40.162
Found Yes
Hash 704c6058a0221831dd29edaec1ed389f6ffacc0588a94d81e0c425a833666617
SimHash 24085840a4b1

Groups

*

Rule Path
Disallow /admin/
Disallow /login/
Disallow /private/
Disallow /temp/
Allow /Index
Allow /Studysubject
Allow /Job
Allow /Privacy
Allow /Term
Allow Contact/index
Disallow /user-dashboard/
Allow /quizzes/
Allow /mcq-results/
Allow /learning-resources/
Back to top

Other Records

Field Value
sitemap https://www.mcqsportal.com/sitemap.xml
Back to top

Comments

  • robots.txt for mcqsportal.com
  • Block all crawlers from accessing sensitive areas like admin or login pages
  • Allow search engines to crawl essential pages and content
  • Block all crawlers from specific URLs that shouldn't be indexed
  • Allow crawling of certain directories
  • Sitemap reference to help search engines find all pages to crawl
Back to top