site-annonce.fr
robots.txt

Robots Exclusion Standard data for site-annonce.fr

Resource Scan

Scan Details

Site Domain site-annonce.fr
Base Domain site-annonce.fr
Scan Status Ok
Last Scan2024-11-14T22:06:34+00:00
Next Scan 2024-11-21T22:06:34+00:00

Last Scan

Scanned2024-11-14T22:06:34+00:00
URL https://site-annonce.fr/robots.txt
Redirect https://www.site-annonce.fr/robots.txt
Redirect Domain www.site-annonce.fr
Redirect Base site-annonce.fr
Domain IPs 46.105.55.79
Redirect IPs 46.105.55.79
Response IP 46.105.55.79
Found Yes
Hash be3aaa791f8cb2b8a585b1aa547ab57a44b83e0ac6da17f15cf938dd44497f94
SimHash 7044e90cb79b

Groups

yandex
baiduspider
seznambot
bubing
cliqzbot

Rule Path
Disallow /

*

Rule Path
Allow /ads.txt
Disallow /Results/
Disallow /Result.aspx?q=
Disallow /Default.aspx?q=
Disallow /Desc
Disallow /addDesc
Disallow /longdesc
Disallow /detbids
Disallow /searchCounter
Disallow /Search
Disallow /autocomplete
Disallow /subscribeKeyword
Disallow /KeywordName
Disallow /SendAdsIdStats
Disallow /PrepareVisitStatForApi
Disallow /c/
Disallow /c/GetSimilar
Disallow /e/
Disallow /p/GetLastedEbayBids
Disallow /s/time
Disallow /s/imageServer
Disallow /i/getimage
Disallow /t/testtime
Disallow /t/test
Disallow /u/
Disallow /u/Ad/New
Disallow /u/Account/SuperAdminUnsubscribing
Disallow /stat
Disallow /ads
Disallow /mongo/GetPhrasesInsertedAsKeywords
Disallow /Api/Get/Favourites
Disallow /Account/GetUserBox
Disallow /Account/GetUserName
Disallow /Search/ClickCounter
Disallow /details/stats
Disallow /*c%3D*
Disallow /*b%3D*
Disallow /*forceNoindex%3D*
Disallow /api
Disallow /r/Details/
Disallow /f/
Disallow /r/
Disallow /r/ifdet