avito.ma
robots.txt
Robots Exclusion Standard data for avito.ma
Resource Scan
Scan Details
| Site Domain | avito.ma |
| Base Domain | avito.ma |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-08T23:28:18+00:00 |
| Next Scan | 2024-11-06T23:28:18+00:00 |
Last Successful Scan
| Scanned | 2023-10-14T21:16:43+00:00 |
| URL | https://avito.ma/robots.txt |
| Redirect | https://www.avito.ma/robots.txt |
| Redirect Domain | www.avito.ma |
| Redirect Base | avito.ma |
| Domain IPs | 104.22.10.48, 104.22.11.48, 172.67.8.148, 2606:4700:10::6816:a30, 2606:4700:10::6816:b30, 2606:4700:10::ac43:894 |
| Redirect IPs | 104.22.10.48, 104.22.11.48, 172.67.8.148, 2606:4700:10::6816:a30, 2606:4700:10::6816:b30, 2606:4700:10::ac43:894 |
| Response IP | 172.67.8.148 |
| Found | Yes |
| Hash | 69762ec6172e6563f201550d0997af22fb715b9f3def6efcf11bf74badf8e7dd |
| SimHash | 916cf7655f17 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /adwatch |
| Disallow | /templates/docs/ad_images.html |
| Disallow | /pg |
| Disallow | /adreply |
| Disallow | /fr// |
| Disallow | /ar// |
| Disallow | /58092247 |
| Disallow | /payment |
| Disallow | /api/v1 |
| Disallow | /old/favourites |
| Disallow | /controlpanel |
| Disallow | /delivery |
| Disallow | */rs%3D* |
| Disallow | */rs%3D* |
| Disallow | */re%3D* |
| Disallow | */ros%3D* |
| Disallow | */roe%3D* |
| Disallow | */ss%3D* |
| Disallow | */se%3D* |
| Disallow | */spr%3D* |
| Disallow | */mpr%3D* |
| Disallow | /*/?sp=1* |
scooter
| Rule | Path |
|---|---|
| Disallow | /adwatch |
| Disallow | /templates/docs/ad_images.html |
| Disallow | /pg |
| Disallow | /fr// |
| Disallow | /ar// |
| Disallow | /58092247 |
| Disallow | /old/favourites |
| Disallow | /controlpanel |
| Disallow | /delivery |
msnbot
| Rule | Path |
|---|---|
| Disallow | /adwatch |
| Disallow | /templates/docs/ad_images.html |
| Disallow | /pg |
| Disallow | /adreply |
| Disallow | /fr// |
| Disallow | /ar// |
| Disallow | /58092247 |
| Disallow | /old/favourites |
| Disallow | /controlpanel |
| Disallow | /delivery |
slurp
| Rule | Path |
|---|---|
| Disallow | /adwatch |
| Disallow | /templates/docs/ad_images.html |
| Disallow | /pg |
| Disallow | /adreply |
| Disallow | /fr// |
| Disallow | /ar// |
| Disallow | /58092247 |
| Disallow | /old/favourites |
| Disallow | /controlpanel |
| Disallow | /delivery |
ia_archiver
| Rule | Path |
|---|---|
| Disallow | /adwatch |
| Disallow | /templates/docs/ad_images.html |
| Disallow | /pg |
| Disallow | /adreply |
| Disallow | /fr// |
| Disallow | /ar// |
| Disallow | /58092247 |
| Disallow | /old/favourites |
| Disallow | /controlpanel |
| Disallow | /delivery |
schibstedsokbot
| Rule | Path |
|---|---|
| Disallow | /li |
| Disallow | /list |
| Disallow | /vi |
| Disallow | /adwatch |
| Disallow | /cgi-bin |
| Disallow | /support |
| Disallow | /templates/docs/ad_images.html |
| Disallow | /pg |
| Disallow | /adreply |
| Disallow | /fr// |
| Disallow | /ar// |
| Disallow | /58092247 |
| Disallow | /old/favourites |
| Disallow | /controlpanel |
rogerbot
| Rule | Path |
|---|---|
| Disallow | /adwatch |
| Disallow | /templates/docs/ad_images.html |
| Disallow | /pg |
| Disallow | /adreply |
| Disallow | /fr// |
| Disallow | /ar// |
| Disallow | /58092247 |
| Disallow | /old/favourites |
| Disallow | /controlpanel |
| Disallow | /delivery |
alexabot
| Rule | Path |
|---|---|
| Disallow | /adwatch |
| Disallow | /templates/docs/ad_images.html |
| Disallow | /pg |
| Disallow | /adreply |
| Disallow | /fr// |
| Disallow | /ar// |
| Disallow | /58092247 |
| Disallow | /old/favourites |
| Disallow | /controlpanel |
| Disallow | /delivery |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.avito.ma/auto/neuf/sitemap.xml |
| sitemap | https://www.avito.ma/sitemap_index.xml |
| sitemap | https://www.avito.ma/sitemap_listing_index.xml |
| sitemap | https://www.avito.ma/sp/nc/sitemap/sitemap-generic.xml |
| sitemap | https://www.avito.ma/sp/nc/sitemap/sitemap-car.xml |