farminguk.com
robots.txt
Robots Exclusion Standard data for farminguk.com
Resource Scan
Scan Details
| Site Domain | farminguk.com |
| Base Domain | farminguk.com |
| Scan Status | Ok |
| Last Scan | 2024-09-28T13:45:03+00:00 |
| Next Scan | 2024-10-05T13:45:03+00:00 |
Last Scan
| Scanned | 2024-09-28T13:45:03+00:00 |
| URL | https://farminguk.com/robots.txt |
| Domain IPs | 77.68.84.99 |
| Response IP | 77.68.84.99 |
| Found | Yes |
| Hash | 6dc6962719d6e6b73a51e44dba77ebcd74b369a5835c768f9a99b340faf4153f |
| SimHash | 6dc79bdcaade |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /advertclicks/ |
| Disallow | /admin/ |
| Disallow | /Account/ |
| Disallow | /Register |
| Disallow | /Advertiser/ |
| Disallow | /home/duplicate/ |
| Disallow | /home/amp/ |
| Disallow | /farming-statistics |
googlebot-news
| Rule | Path |
|---|---|
| Disallow | /Newslist |
| Disallow | /agriculturaldirectory |
| Disallow | /agricultural-directory |
| Disallow | /digitalfarmingmagazines |
| Disallow | /digital-farming-magazines |
| Disallow | /countryshowsandevents |
| Disallow | /country-shows-and-events |
| Disallow | /ruralholidayrentals |
| Disallow | /rural-holiday-rentals |
| Disallow | /farmingjobs |
| Disallow | /farming-jobs |
| Disallow | /farmingvideos |
| Disallow | /farming-videos |
| Disallow | /farmclassifieds |
| Disallow | /farm-classifieds |
| Disallow | /Newscategory |
| Disallow | /knowledgecentre |
| Disallow | /help |
| Disallow | /MarketData |
| Disallow | /worldfarmingnews |
| Disallow | /farmingcourses |
| Disallow | /farming-courses |
| Disallow | /Directorymap |
| Disallow | /weatherreport |
| Disallow | /farmingknowledgecentre |
| Disallow | /directories |
| Disallow | /DigitalEdition |
| Disallow | /Accommodation |
| Disallow | /farms-and-land-for-sale |
| Disallow | /job |
| Disallow | /videos |
| Disallow | /Tractorguide |
| Disallow | /Knowledge |
| Disallow | /defrastats |
| Disallow | /JobAgent |
| Disallow | /Job_Vacancies |
| Disallow | /marketsearch |
| Disallow | /propertiessearch |
| Disallow | /milk |
| Disallow | /eggs |
| Disallow | /MarketHistoricalData |
| Disallow | /Common |
| Disallow | /VisitorLogs |
| Disallow | /visitor-logs |
| Disallow | /Properties |
| Disallow | /Directory |
| Disallow | /Directorysearch |
| Disallow | /content |
| Disallow | /Agent_information |
| Disallow | /marketdetail |
| Disallow | /farmsandlandforsale |
| Disallow | /farms-and-land-for-sale |
| Disallow | /farmattractions |
| Disallow | /farm-attractions |
| Disallow | /Newslist/News |
| Disallow | /sitemap/jobs |
| Disallow | /sitemap/properties |
| Disallow | /sitemap/news |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.farminguk.com/sitemap/news |