ma.afribaba.com
robots.txt
Robots Exclusion Standard data for ma.afribaba.com
Resource Scan
Scan Details
Site Domain | ma.afribaba.com |
Base Domain | afribaba.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-22T01:29:07+00:00 |
Next Scan | 2024-11-20T01:29:07+00:00 |
Last Successful Scan
Scanned | 2024-01-03T01:24:00+00:00 |
URL | https://ma.afribaba.com/robots.txt |
Domain IPs | 104.26.10.76, 104.26.11.76, 172.67.73.30, 2606:4700:20::681a:a4c, 2606:4700:20::681a:b4c, 2606:4700:20::ac43:491e |
Response IP | 104.26.10.76 |
Found | Yes |
Hash | c6fac6b34b1526e9422a6ab7b6e3122a692db36e5c76d31183b0f541182e6bcf |
SimHash | 194c9b615792 |
Groups
*
Rule | Path |
---|---|
Disallow | /*? |
Disallow | /*mobile%3Dfalse* |
Allow | /*mobile%3Dtrue* |
Allow | /*?page=* |
Allow | /*?adult=* |
Allow | /*?id=cars |
Allow | /*vip%3D1 |
Allow | /*feat%3D1 |
Allow | /*autorenew%3D1 |
Allow | /*urgent%3D1 |
Allow | /*haspics%3D* |
Allow | /*postertype%3D* |
Allow | /*supplydemand%3D* |
Allow | /*sort%3D* |
Allow | /*order%3D* |
Allow | /*_gallery%3D* |
Allow | /ads/*catid%3D* |
Allow | /ads/*subcatid%3D* |
Allow | /ads/*countryid%3D* |
Allow | /ads/*cityid%3D* |
Allow | /search.html?q=* |
Allow | /search.html?*countryid=* |
Allow | /search.html?*cityid=* |
Allow | /search.html?*areaid=* |
Allow | /search.html?*catid=* |
Allow | /search.html?*subcatid=* |
Allow | /search.html?*make=* |
Allow | /search.html?*model=* |
Allow | /search.html?*rooms=* |
Allow | /search.html?*bathrooms=* |
Allow | /search.html?*postertype=* |
Allow | /search.html?*supplydemand=* |
Allow | /search.html?*property_type=* |
Allow | /search.html?*contract_type=* |
Allow | /search.html?*fuel=* |
Allow | /search.html?*transmission=* |
Allow | /search.html?*year=* |
Allow | /search.html?*doors=* |
Allow | /search.html?*seats=* |
Allow | /search.html?*age=* |
Allow | /search.html?*i_am=* |
Allow | /search.html?*people_accepted=* |
Allow | /search.html?*displacement=* |
Allow | /search.html?*price=* |
Allow | /search.html?*pricemin=* |
Allow | /search.html?*pricemax=* |
Other Records
Field | Value |
---|---|
sitemap | https://ma.afribaba.com/sitemap.xml |
sitemap | https://ma.afribaba.com/feed.xml |