used.forsale
robots.txt

Robots Exclusion Standard data for used.forsale

Resource Scan

Scan Details

Site Domain used.forsale
Base Domain used.forsale
Scan Status Ok
Last Scan2024-05-15T13:44:35+00:00
Next Scan 2024-05-22T13:44:35+00:00

Last Scan

Scanned2024-05-15T13:44:35+00:00
URL https://used.forsale/robots.txt
Redirect https://www.used.forsale/robots.txt
Redirect Domain www.used.forsale
Redirect Base used.forsale
Domain IPs 147.135.1.134
Redirect IPs 147.135.1.134
Response IP 147.135.1.134
Found Yes
Hash be3aaa791f8cb2b8a585b1aa547ab57a44b83e0ac6da17f15cf938dd44497f94
SimHash 7044e90cb79b

Groups

yandex
baiduspider
seznambot
bubing
cliqzbot

Rule Path
Disallow /

*

Rule Path
Allow /ads.txt
Disallow /Results/
Disallow /Result.aspx?q=
Disallow /Default.aspx?q=
Disallow /Desc
Disallow /addDesc
Disallow /longdesc
Disallow /detbids
Disallow /searchCounter
Disallow /Search
Disallow /autocomplete
Disallow /subscribeKeyword
Disallow /KeywordName
Disallow /SendAdsIdStats
Disallow /PrepareVisitStatForApi
Disallow /c/
Disallow /c/GetSimilar
Disallow /e/
Disallow /p/GetLastedEbayBids
Disallow /s/time
Disallow /s/imageServer
Disallow /i/getimage
Disallow /t/testtime
Disallow /t/test
Disallow /u/
Disallow /u/Ad/New
Disallow /u/Account/SuperAdminUnsubscribing
Disallow /stat
Disallow /ads
Disallow /mongo/GetPhrasesInsertedAsKeywords
Disallow /Api/Get/Favourites
Disallow /Account/GetUserBox
Disallow /Account/GetUserName
Disallow /Search/ClickCounter
Disallow /details/stats
Disallow /*c%3D*
Disallow /*b%3D*
Disallow /*forceNoindex%3D*
Disallow /api
Disallow /r/Details/
Disallow /f/
Disallow /r/
Disallow /r/ifdet