thebusinessfarmer.com
robots.txt
Robots Exclusion Standard data for thebusinessfarmer.com
Resource Scan
Scan Details
| Site Domain | thebusinessfarmer.com |
| Base Domain | thebusinessfarmer.com |
| Scan Status | Ok |
| Last Scan | 2024-10-01T21:27:40+00:00 |
| Next Scan | 2024-10-08T21:27:40+00:00 |
Last Scan
| Scanned | 2024-10-01T21:27:40+00:00 |
| URL | https://thebusinessfarmer.com/robots.txt |
| Domain IPs | 65.61.154.7 |
| Response IP | 65.61.154.7 |
| Found | Yes |
| Hash | addcf993b0b1bf7dcc37fa96ab4052dfc73330ea84dede911134a1285cb11e20 |
| SimHash | 84230986a9d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /css/ |
| Disallow | /css_system/ |
| Disallow | /js/ |
| Disallow | /js_system/ |
| Disallow | /account/ |
| Disallow | /calendar/post/ |
| Disallow | /forms/ |
| Disallow | /login.html |
| Disallow | /poll_process.html |
| Disallow | /post_comments.html |
| Disallow | /my_profile.html |
| Disallow | /my_stuff.html |
| Disallow | /user_profile.html |
| Disallow | /ajax/ |
| Disallow | /register.html |
| Disallow | /report_item.html |
| Disallow | /send_item.html |
| Disallow | /subscribe/ |
| Disallow | /renew/ |
| Disallow | /account/ |
| Disallow | /resetpassword/ |
| Disallow | /reset/ |
| Disallow | /alacarte/ |
| Disallow | /lookup/ |
| Disallow | /register-local/ |
| Disallow | /entercode/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://thebusinessfarmer.com/sitemaps/sitemaps-r2-default-businessfarmer-1.xml |
| sitemap | https://thebusinessfarmer.com/sitemaps/sitemaps-r2-googlenews-businessfarmer-1.xml |