dubizzle.jo
robots.txt
Robots Exclusion Standard data for dubizzle.jo
Resource Scan
Scan Details
Site Domain | dubizzle.jo |
Base Domain | dubizzle.jo |
Scan Status | Ok |
Last Scan | 2024-09-18T14:06:50+00:00 |
Next Scan | 2024-09-25T14:06:50+00:00 |
Last Scan
Scanned | 2024-09-18T14:06:50+00:00 |
URL | https://dubizzle.jo/robots.txt |
Redirect | https://www.dubizzle.jo/robots.txt |
Redirect Domain | www.dubizzle.jo |
Redirect Base | dubizzle.jo |
Domain IPs | 3.165.102.101, 3.165.102.14, 3.165.102.26, 3.165.102.63 |
Redirect IPs | 104.18.12.204, 104.18.13.204, 2606:4700::6812:ccc, 2606:4700::6812:dcc |
Response IP | 104.18.12.204 |
Found | Yes |
Hash | c3278070fd6db8c41f6e1dd529b91871f465139bc2a435bf04a0bc9db2645ef6 |
SimHash | 399108600d32 |
Groups
*
Rule | Path |
---|---|
Disallow | /ajax/ |
Disallow | /adminpanel/ |
Disallow | /myaccount/ |
Disallow | /adprint/ |
Disallow | /ad/leaflet/ |
Disallow | /ad/contact/ |
Disallow | /payment/ |
Disallow | /adding/confirm/ |
Disallow | /adding/confirmpage/ |
Disallow | /i2/ad/abuse/ |
Disallow | /m/ad/abuse/ |
Disallow | /apple-app-site-association |
Disallow | /profile/ |
Disallow | /en/profile/ |
Disallow | *ref%* |
Disallow | *search%* |
Disallow | *search%5B* |
Disallow | *sorting%3D* |
Disallow | *minPhotoCount%3D* |
Disallow | *product%3D* |
Disallow | */changelang/* |
Disallow | *sort_by%3D* |
Disallow | *back%3D* |
Disallow | /account |
Disallow | /en/account |
Disallow | /captchaChallenge |
Disallow | /en/captchaChallenge |
Allow | / |
*
Rule | Path |
---|---|
Disallow | /api/ |
Disallow | /post/ |
Disallow | /edit/ |
Disallow | /chat/ |
Disallow | /profile/ |
Disallow | /payments/ |
Disallow | /nf/ |
Disallow | /deal_of_the_week/ |
Disallow | /en/deal_of_the_week/ |
Disallow | /featuredAgencies |
Disallow | /en/featuredAgencies |
Disallow | /api/ |
Disallow | /recommended_properties* |
Disallow | /profolio/ |
Disallow | /en/profolio/ |
Disallow | /cp/ |
Disallow | /en/cp/ |
Disallow | /nova/ |
Disallow | /en/nova/ |
Disallow | *filter%3D* |
Disallow | */model-*/q-* |
Comments