for-sale.co.uk
robots.txt
Robots Exclusion Standard data for for-sale.co.uk
Resource Scan
Scan Details
| Site Domain | for-sale.co.uk |
| Base Domain | for-sale.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-04-29T11:50:26+00:00 |
| Next Scan | 2024-05-06T11:50:26+00:00 |
Last Scan
| Scanned | 2024-04-29T11:50:26+00:00 |
| URL | https://for-sale.co.uk/robots.txt |
| Redirect | https://www.for-sale.co.uk/robots.txt |
| Redirect Domain | www.for-sale.co.uk |
| Redirect Base | for-sale.co.uk |
| Domain IPs | 145.239.255.55 |
| Redirect IPs | 145.239.255.55 |
| Response IP | 145.239.255.55 |
| Found | Yes |
| Hash | be3aaa791f8cb2b8a585b1aa547ab57a44b83e0ac6da17f15cf938dd44497f94 |
| SimHash | 7044e90cb79b |
Groups
*
| Rule | Path |
|---|---|
| Allow | /ads.txt |
| Disallow | /Results/ |
| Disallow | /Result.aspx?q= |
| Disallow | /Default.aspx?q= |
| Disallow | /Desc |
| Disallow | /addDesc |
| Disallow | /longdesc |
| Disallow | /detbids |
| Disallow | /searchCounter |
| Disallow | /Search |
| Disallow | /autocomplete |
| Disallow | /subscribeKeyword |
| Disallow | /KeywordName |
| Disallow | /SendAdsIdStats |
| Disallow | /PrepareVisitStatForApi |
| Disallow | /c/ |
| Disallow | /c/GetSimilar |
| Disallow | /e/ |
| Disallow | /p/GetLastedEbayBids |
| Disallow | /s/time |
| Disallow | /s/imageServer |
| Disallow | /i/getimage |
| Disallow | /t/testtime |
| Disallow | /t/test |
| Disallow | /u/ |
| Disallow | /u/Ad/New |
| Disallow | /u/Account/SuperAdminUnsubscribing |
| Disallow | /stat |
| Disallow | /ads |
| Disallow | /mongo/GetPhrasesInsertedAsKeywords |
| Disallow | /Api/Get/Favourites |
| Disallow | /Account/GetUserBox |
| Disallow | /Account/GetUserName |
| Disallow | /Search/ClickCounter |
| Disallow | /details/stats |
| Disallow | /*c%3D* |
| Disallow | /*b%3D* |
| Disallow | /*forceNoindex%3D* |
| Disallow | /api |
| Disallow | /r/Details/ |
| Disallow | /f/ |
| Disallow | /r/ |
| Disallow | /r/ifdet |