web-town.org
robots.txt
Robots Exclusion Standard data for web-town.org
Resource Scan
Scan Details
| Site Domain | web-town.org |
| Base Domain | web-town.org |
| Scan Status | Ok |
| Last Scan | 2024-07-02T16:32:55+00:00 |
| Next Scan | 2024-07-09T16:32:55+00:00 |
Last Scan
| Scanned | 2024-07-02T16:32:55+00:00 |
| URL | https://web-town.org/robots.txt |
| Redirect | https://www.web-town.org/robots.txt |
| Redirect Domain | www.web-town.org |
| Redirect Base | web-town.org |
| Domain IPs | 104.21.89.155, 172.67.189.149, 2606:4700:3033::6815:599b, 2606:4700:3037::ac43:bd95 |
| Redirect IPs | 104.21.89.155, 172.67.189.149, 2606:4700:3033::6815:599b, 2606:4700:3037::ac43:bd95 |
| Response IP | 172.67.189.149 |
| Found | Yes |
| Hash | 5a3251da1700a3b3e056478ac1b94301c0c40ed7e9e105b625e0c5b7853cd011 |
| SimHash | 24b68c1de4d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search_results.php |
| Disallow | /turismonojapao.php |
| Disallow | /turismonojapao2.php |
| Disallow | /cgi-bin/ |
| Disallow | /admin/ |
| Disallow | /cp/ |
| Disallow | /add.php |
| Disallow | /modify.php |
| Disallow | /upgrade.php |
| Disallow | /tell_friend.php |
| Disallow | /send_pwd.php |
| Disallow | /sendmail.php |
| Disallow | /review.php |
| Disallow | /trackclick.php |
| Disallow | /bad_link.php |
| Disallow | /captcha.php |
| Disallow | /login.php |
| Disallow | /rss.php |
| Disallow | /tos.php |
| Disallow | /privacy.php |
| Disallow | /browsepr.php |
| Disallow | /hot.php |
| Disallow | /new.php |
| Disallow | /pick.php |
| Disallow | /top_rated.php |
| Disallow | /user_detail.php |
| Disallow | /about_us.php |
| Disallow | /plugin_action.php |
| Disallow | /xhot.php |
| Disallow | /contact.php |
| Disallow | /page.php |
| Disallow | /plugins/ |
| Disallow | /browsetag.php |
| Disallow | /tags.php |
| Disallow | /tags_letter/ |
| Disallow | /tag/ |
Comments