ma.afribaba.com
robots.txt
Robots Exclusion Standard data for ma.afribaba.com
Resource Scan
Scan Details
| Site Domain | ma.afribaba.com |
| Base Domain | afribaba.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-24T01:28:49+00:00 |
| Next Scan | 2024-08-22T01:28:49+00:00 |
Last Successful Scan
| Scanned | 2024-01-03T01:24:00+00:00 |
| URL | https://ma.afribaba.com/robots.txt |
| Domain IPs | 104.26.10.76, 104.26.11.76, 172.67.73.30, 2606:4700:20::681a:a4c, 2606:4700:20::681a:b4c, 2606:4700:20::ac43:491e |
| Response IP | 104.26.10.76 |
| Found | Yes |
| Hash | c6fac6b34b1526e9422a6ab7b6e3122a692db36e5c76d31183b0f541182e6bcf |
| SimHash | 194c9b615792 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*? |
| Disallow | /*mobile%3Dfalse* |
| Allow | /*mobile%3Dtrue* |
| Allow | /*?page=* |
| Allow | /*?adult=* |
| Allow | /*?id=cars |
| Allow | /*vip%3D1 |
| Allow | /*feat%3D1 |
| Allow | /*autorenew%3D1 |
| Allow | /*urgent%3D1 |
| Allow | /*haspics%3D* |
| Allow | /*postertype%3D* |
| Allow | /*supplydemand%3D* |
| Allow | /*sort%3D* |
| Allow | /*order%3D* |
| Allow | /*_gallery%3D* |
| Allow | /ads/*catid%3D* |
| Allow | /ads/*subcatid%3D* |
| Allow | /ads/*countryid%3D* |
| Allow | /ads/*cityid%3D* |
| Allow | /search.html?q=* |
| Allow | /search.html?*countryid=* |
| Allow | /search.html?*cityid=* |
| Allow | /search.html?*areaid=* |
| Allow | /search.html?*catid=* |
| Allow | /search.html?*subcatid=* |
| Allow | /search.html?*make=* |
| Allow | /search.html?*model=* |
| Allow | /search.html?*rooms=* |
| Allow | /search.html?*bathrooms=* |
| Allow | /search.html?*postertype=* |
| Allow | /search.html?*supplydemand=* |
| Allow | /search.html?*property_type=* |
| Allow | /search.html?*contract_type=* |
| Allow | /search.html?*fuel=* |
| Allow | /search.html?*transmission=* |
| Allow | /search.html?*year=* |
| Allow | /search.html?*doors=* |
| Allow | /search.html?*seats=* |
| Allow | /search.html?*age=* |
| Allow | /search.html?*i_am=* |
| Allow | /search.html?*people_accepted=* |
| Allow | /search.html?*displacement=* |
| Allow | /search.html?*price=* |
| Allow | /search.html?*pricemin=* |
| Allow | /search.html?*pricemax=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ma.afribaba.com/sitemap.xml |
| sitemap | https://ma.afribaba.com/feed.xml |