python-forum.io
robots.txt
Robots Exclusion Standard data for python-forum.io
Resource Scan
Scan Details
| Site Domain | python-forum.io |
| Base Domain | python-forum.io |
| Scan Status | Ok |
| Last Scan | 2025-08-11T11:49:02+00:00 |
| Next Scan | 2025-09-10T11:49:02+00:00 |
Last Scan
| Scanned | 2025-08-11T11:49:02+00:00 |
| URL | https://python-forum.io/robots.txt |
| Domain IPs | 104.21.27.41, 172.67.168.227, 2606:4700:3035::6815:1b29, 2606:4700:3037::ac43:a8e3 |
| Response IP | 172.67.168.227 |
| Found | Yes |
| Hash | 9b43e2f999d98746230d3ad607cf44d6dc2b189c68f3b8116d9531a6d3c90a77 |
| SimHash | 2955cc629292 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /cache/ |
| Disallow | /inc/ |
| Disallow | /jscripts/ |
| Disallow | /uploads/ |
| Disallow | /private.php |
| Disallow | /usercp.php |
| Disallow | /usercp2.php |
| Disallow | /member.php |
| Disallow | /calendar.php |
| Disallow | /search.php |
| Disallow | /newreply.php |
| Disallow | /newthread.php |
| Disallow | /editpost.php |
| Disallow | /ratethread.php |
| Disallow | /report.php |
| Disallow | /sendthread.php |
| Disallow | /moderation.php |
| Disallow | /modcp.php |
| Disallow | /misc.php?action=syndication |
| Disallow | /*action%3D* |
| Disallow | /*mode%3D* |
| Disallow | /*sort%3D* |
| Disallow | /*order%3D* |
| Disallow | /*highlight%3D* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Comments