Log In Sign Up

learn.online-python.com
robots.txt

Robots Exclusion Standard data for learn.online-python.com

Resource Scan

Scan Details

Site Domain learn.online-python.com
Base Domain online-python.com
Scan Status Ok
Last Scan2026-02-23T11:39:59+00:00
Next Scan 2026-03-09T11:39:59+00:00

Last Scan

Scanned2026-02-23T11:39:59+00:00
URL https://learn.online-python.com/robots.txt
Domain IPs 216.150.1.65, 216.150.16.65
Response IP 216.150.16.65
Found Yes
Hash 22f5231ec367cb27b9979341e8df321d698d15dfac589575c80ac4dc8076a122
SimHash 119c1b50cdc5

Groups

*

Rule Path
Allow /
Allow /python/
Allow /pandas/
Allow /numpy/
Allow /python-how-to/
Allow /quiz
Allow /exercise
Allow /tutorial-quiz
Allow /tutorials/
Allow /about
Allow /terms-of-service
Allow /privacy-policy
Disallow /auth/
Disallow /dashboard
Disallow /profile
Disallow /my-bookmarks
Disallow /api/
Disallow /_nuxt/
Disallow /__/
Disallow /admin/
Disallow /supabase/
Disallow /migrations/
Disallow /server/
Disallow /*?question=*
Disallow /*?answers=*
Disallow /*?*session*
Disallow /*?*token*
Disallow /*?*auth*
Disallow /test
Disallow /test1/
Disallow /test2/
Disallow /*.json$
Disallow /data/

googlebot

Rule Path
Allow /python/
Allow /pandas/
Allow /numpy/
Allow /python-how-to/
Allow /quiz
Allow /exercise
Allow /tutorial-quiz
Disallow /auth/
Disallow /dashboard
Disallow /profile
Disallow /api/

bingbot

Rule Path
Allow /python/
Allow /pandas/
Allow /numpy/
Allow /python-how-to/
Allow /quiz
Allow /exercise
Allow /tutorial-quiz
Disallow /auth/
Disallow /dashboard
Disallow /profile
Disallow /api/

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://learn.online-python.com/sitemap.xml
Back to top

Comments

  • Robots.txt for Online Python Learning Platform
  • https://learn.online-python.com
  • Allow crawling of main educational content
  • Block user-specific pages and authentication
  • Block admin and backend areas
  • Block query parameters for dynamic content
  • Block development and test files
  • Allow specific bots full access to educational content
  • Sitemap location
  • Crawl delay for general bots (in seconds)
Back to top