renew.olx.in
robots.txt
Robots Exclusion Standard data for renew.olx.in
Resource Scan
Scan Details
Site Domain | renew.olx.in |
Base Domain | olx.in |
Scan Status | Ok |
Last Scan | 2024-09-28T05:20:23+00:00 |
Next Scan | 2024-10-05T05:20:23+00:00 |
Last Scan
Scanned | 2024-09-28T05:20:23+00:00 |
URL | https://renew.olx.in/robots.txt |
Domain IPs | 184.51.6.196, 184.51.6.221, 2600:1413:b000:1d::17d1:2e90, 2600:1413:b000:1d::17d1:2e93 |
Response IP | 23.52.40.105 |
Found | Yes |
Hash | 54ceaae4f9296260fd11f95829987ef100d217f41c7837838f1d7f8ca8a41305 |
SimHash | 4a90eb15c592 |
Groups
*
Rule | Path |
---|---|
Disallow | /api/ |
Disallow | /post/ |
Disallow | /edit/ |
Disallow | /account |
Disallow | /chat/ |
Disallow | /profile/ |
Disallow | /payments/ |
Disallow | /nf/ |
Disallow | */items/* |
Disallow | */query-* |
Disallow | */*?*%5B |
Disallow | */*?*%5B |
Disallow | /delhi_g4058659/cars_c84/q-2-and* |
Disallow | *_and_* |
Disallow | */*?*filter=*%2C* |
Disallow | */*?*expired=* |
Disallow | /blog/wp-admin/ |
Disallow | /blog/cgi-bin/ |
Allow | /blog/wp-admin/admin-ajax.php |
googlebot
Rule | Path |
---|---|
Disallow | /post/ |
Disallow | /edit/ |
Disallow | /account |
Disallow | /chat/ |
Disallow | /profile/ |
Disallow | /payments/ |
Disallow | /nf/ |
Disallow | */items/* |
Disallow | */query-* |
Disallow | */*?*%5B |
Disallow | */*?*%5B |
Disallow | /delhi_g4058659/cars_c84/q-2-and* |
Disallow | *_and_* |
Disallow | */*?*filter=*%2C* |
Disallow | */*?*expired=* |
Disallow | /blog/wp-admin/ |
Disallow | /blog/cgi-bin/ |
Allow | /blog/wp-admin/admin-ajax.php |
Allow | */api/* |
Allow | /api/relevance |
Allow | /api/v3/items |
Other Records
Field | Value |
---|---|
sitemap | https://www.olx.in/sitemapindex.xml |
sitemap | https://www.olx.in/blog/sitemap_index.xml |
Comments