site-annonce.be
robots.txt

Robots Exclusion Standard data for site-annonce.be

Resource Scan

Scan Details

Site Domain site-annonce.be
Base Domain site-annonce.be
Scan Status Ok
Last Scan2024-10-31T16:47:35+00:00
Next Scan 2024-11-07T16:47:35+00:00

Last Scan

Scanned2024-10-31T16:47:35+00:00
URL https://site-annonce.be/robots.txt
Redirect https://www.site-annonce.be/robots.txt
Redirect Domain www.site-annonce.be
Redirect Base site-annonce.be
Domain IPs 176.31.133.108
Redirect IPs 176.31.133.108
Response IP 176.31.133.108
Found Yes
Hash be3aaa791f8cb2b8a585b1aa547ab57a44b83e0ac6da17f15cf938dd44497f94
SimHash 7044e90cb79b

Groups

yandex
baiduspider
seznambot
bubing
cliqzbot

Rule Path
Disallow /

*

Rule Path
Allow /ads.txt
Disallow /Results/
Disallow /Result.aspx?q=
Disallow /Default.aspx?q=
Disallow /Desc
Disallow /addDesc
Disallow /longdesc
Disallow /detbids
Disallow /searchCounter
Disallow /Search
Disallow /autocomplete
Disallow /subscribeKeyword
Disallow /KeywordName
Disallow /SendAdsIdStats
Disallow /PrepareVisitStatForApi
Disallow /c/
Disallow /c/GetSimilar
Disallow /e/
Disallow /p/GetLastedEbayBids
Disallow /s/time
Disallow /s/imageServer
Disallow /i/getimage
Disallow /t/testtime
Disallow /t/test
Disallow /u/
Disallow /u/Ad/New
Disallow /u/Account/SuperAdminUnsubscribing
Disallow /stat
Disallow /ads
Disallow /mongo/GetPhrasesInsertedAsKeywords
Disallow /Api/Get/Favourites
Disallow /Account/GetUserBox
Disallow /Account/GetUserName
Disallow /Search/ClickCounter
Disallow /details/stats
Disallow /*c%3D*
Disallow /*b%3D*
Disallow /*forceNoindex%3D*
Disallow /api
Disallow /r/Details/
Disallow /f/
Disallow /r/
Disallow /r/ifdet