pythonif.com
robots.txt
Robots Exclusion Standard data for pythonif.com
Resource Scan
Scan Details
| Site Domain | pythonif.com |
| Base Domain | pythonif.com |
| Scan Status | Ok |
| Last Scan | 2025-10-21T20:14:52+00:00 |
| Next Scan | 2025-11-20T20:14:52+00:00 |
Last Scan
| Scanned | 2025-10-21T20:14:52+00:00 |
| URL | http://pythonif.com/robots.txt |
| Redirect | http://www.pythonif.com/robots.txt |
| Redirect Domain | www.pythonif.com |
| Redirect Base | pythonif.com |
| Domain IPs | 38.6.120.79 |
| Redirect IPs | 38.6.120.79 |
| Response IP | 38.6.120.79 |
| Found | Yes |
| Hash | 7772bb73e92d933a24212dba347f03ec0ea8cf2951d198cecf8e43cd7f1db5a0 |
| SimHash | 0a162873ee9a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /wp-admin/ |
| Disallow | /config/ |
| Disallow | /backup/ |
| Disallow | /data/ |
| Disallow | /tmp/ |
| Disallow | /private/ |
| Disallow | /*.js |
| Disallow | /*.css |
| Disallow | /api/ |
| Disallow | /*?* |
| Allow | /*?s=* |
| Allow | /*?page=* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.pythonif.com/sitemap.xml |
Warnings
- 3 invalid lines.
Comments