newdelhi.olx.in
robots.txt
Robots Exclusion Standard data for newdelhi.olx.in
Resource Scan
Scan Details
Site Domain | newdelhi.olx.in |
Base Domain | olx.in |
Scan Status | Ok |
Last Scan | 2024-06-04T19:41:09+00:00 |
Next Scan | 2024-06-11T19:41:09+00:00 |
Last Scan
Scanned | 2024-06-04T19:41:09+00:00 |
URL | https://newdelhi.olx.in/robots.txt |
Domain IPs | 23.59.168.137, 2600:1413:b000:1d::17d1:2e90, 2600:1413:b000:1d::17d1:2e93 |
Response IP | 23.52.40.105 |
Found | Yes |
Hash | 0eca5b04f0d015c0fb0c4004e342d02b4c08e0a1c4ac852c5800de70d75d9674 |
SimHash | 4890bb15c592 |
Groups
*
Rule | Path |
---|---|
Disallow | /api/ |
Disallow | /post/ |
Disallow | /edit/ |
Disallow | /account |
Disallow | /chat/ |
Disallow | /profile/ |
Disallow | /payments/ |
Disallow | /nf/ |
Disallow | /items$ |
Disallow | /items/* |
Disallow | */*?*%5B |
Disallow | */*?*%5B |
Disallow | /delhi_g4058659/cars_c84/q-2-and* |
Disallow | *_and_* |
Disallow | */*?*filter=*%2C* |
Disallow | */*?*expired=* |
Disallow | /blog/wp-admin/ |
Disallow | /blog/cgi-bin/ |
Allow | /blog/wp-admin/admin-ajax.php |
googlebot
Rule | Path |
---|---|
Disallow | /post/ |
Disallow | /edit/ |
Disallow | /account |
Disallow | /chat/ |
Disallow | /profile/ |
Disallow | /payments/ |
Disallow | /nf/ |
Disallow | /items$ |
Disallow | /items/* |
Disallow | */*?*%5B |
Disallow | */*?*%5B |
Disallow | /delhi_g4058659/cars_c84/q-2-and* |
Disallow | *_and_* |
Disallow | */*?*filter=*%2C* |
Disallow | */*?*expired=* |
Disallow | /blog/wp-admin/ |
Disallow | /blog/cgi-bin/ |
Allow | /blog/wp-admin/admin-ajax.php |
Allow | */api/* |
Allow | /api/relevance |
Allow | /api/v3/items |
Other Records
Field | Value |
---|---|
sitemap | https://www.olx.in/sitemapindex.xml |
sitemap | https://www.olx.in/blog/sitemap_index.xml |
Comments