pytutorial.com
robots.txt

Robots Exclusion Standard data for pytutorial.com

Resource Scan

Scan Details

Site Domain pytutorial.com
Base Domain pytutorial.com
Scan Status Ok
Last Scan2026-04-09T02:22:20+00:00
Next Scan 2026-04-16T02:22:20+00:00

Last Scan

Scanned2026-04-09T02:22:20+00:00
URL https://pytutorial.com/robots.txt
Domain IPs 104.21.66.8, 172.67.154.120, 2606:4700:3030::ac43:9a78, 2606:4700:3033::6815:4208
Response IP 104.21.66.8
Found Yes
Hash 835aaa356d9e961273f5fd218a21a52dca84382b140b6b665fa8b07aaa171f40
SimHash b81c1d24edd0

Groups

*

Rule Path
Disallow /page/*
Disallow /category/*/page/*
Disallow /tag/*/page/*
Disallow /media/
Disallow /static/

Other Records

Field Value
sitemap https://pytutorial.com/sitemap.xml

Comments

  • Prevent indexing of uploaded media (images/covers)