tekstpesen.com
robots.txt
Robots Exclusion Standard data for tekstpesen.com
Resource Scan
Scan Details
| Site Domain | tekstpesen.com |
| Base Domain | tekstpesen.com |
| Scan Status | Ok |
| Last Scan | 6/5/2025, 6:21:45 PM |
| Next Scan | 6/12/2025, 6:21:45 PM |
Last Scan
| Scanned | 6/5/2025, 6:21:45 PM |
| URL | https://tekstpesen.com/robots.txt |
| Domain IPs | 104.21.39.202, 172.67.171.91, 2606:4700:3033::6815:27ca, 2606:4700:3035::ac43:ab5b |
| Response IP | 172.67.171.91 |
| Found | Yes |
| Hash | 8616f0d4cb428dce045dc616bc27987ac900780738da20ca3a51ced9f2680729 |
| SimHash | f909b4788433 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /engine/go.php |
| Disallow | /user/ |
| Disallow | /newposts/ |
| Disallow | /statistics.html |
| Disallow | /*subaction%3Duserinfo |
| Disallow | /*subaction%3Dnewposts |
| Disallow | /*do%3Dlastcomments |
| Disallow | /*do%3Dfeedback |
| Disallow | /*do%3Dregister |
| Disallow | /*do%3Dlostpassword |
| Disallow | /*do%3Daddnews |
| Disallow | /*do%3Dstats |
| Disallow | /*do%3Dpm |
| Disallow | /*do%3Dsearch |
| Disallow | /*do%3Ddownload |
| Disallow | /*do%3Dgo |
Other Records
| Field | Value |
|---|---|
| sitemap | https://tekstpesen.com/sitemap.xml |