noida.in.locan.to
robots.txt
Robots Exclusion Standard data for noida.in.locan.to
Resource Scan
Scan Details
| Site Domain | noida.in.locan.to |
| Base Domain | locan.to |
| Scan Status | Ok |
| Last Scan | 2025-12-03T00:08:57+00:00 |
| Next Scan | 2025-12-17T00:08:57+00:00 |
Last Scan
| Scanned | 2025-12-03T00:08:57+00:00 |
| URL | https://noida.in.locan.to/robots.txt |
| Domain IPs | 104.18.34.110, 172.64.153.146 |
| Response IP | 104.18.34.110 |
| Found | Yes |
| Hash | 3d8cfcdeda2de27c84a480475ece4360598d74e0ae495f7086605ff0dbc7ce13 |
| SimHash | 6b9b63f3c8e3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /asclick/ |
| Disallow | /post_G1/ |
| Disallow | /register_G2/ |
| Disallow | /afs_click/ |
| Disallow | /run/faq/ |
| Disallow | /m/run/faq/ |
| Disallow | /g/run/faq/ |
| Disallow | /my/ |
| Disallow | /m/my/ |
| Disallow | /g/my/ |
| Disallow | /*index.rss$ |
| Disallow | /images/sprites/ |
| Disallow | /images/bg/ |
| Disallow | /images/16/ |
| Disallow | /images/32/ |
| Disallow | /images/48/ |
| Disallow | /images/64/ |
| Disallow | /images/100/ |
| Disallow | /images/128/ |
| Disallow | /images/256/ |
| Disallow | /images/share/ |
| Disallow | /manage/ |
| Disallow | /*/manage/ |
| Disallow | /cdn-cgi/ |
| Disallow | /api/ |
| Disallow | /run/track |
| Disallow | /run/dfp |
| Disallow | /*?listing_filter= |
msnbot
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /asclick/ |
| Disallow | /post_G1/ |
| Disallow | /register_G2/ |
| Disallow | /afs_click/ |
| Disallow | /api/ |
| Disallow | /run/faq/ |
| Disallow | /m/run/faq/ |
| Disallow | /g/run/faq/ |
| Disallow | /my/ |
| Disallow | /m/my/ |
| Disallow | /g/my/ |
| Disallow | /images/sprites/ |
| Disallow | /images/bg/ |
| Disallow | /images/16/ |
| Disallow | /images/32/ |
| Disallow | /images/48/ |
| Disallow | /images/64/ |
| Disallow | /images/100/ |
| Disallow | /images/128/ |
| Disallow | /images/256/ |
| Disallow | /images/share/ |
| Disallow | /manage/ |
| Disallow | /*/manage/ |
| Disallow | /cdn-cgi/ |
| Disallow | /api/ |
| Disallow | /run/track |
| Disallow | /run/dfp |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /asclick/ |
| Disallow | /post_G1/ |
| Disallow | /register_G2/ |
| Disallow | /afs_click/ |
| Disallow | /api/ |
| Disallow | /run/faq/ |
| Disallow | /m/run/faq/ |
| Disallow | /g/run/faq/ |
| Disallow | /my/ |
| Disallow | /m/my/ |
| Disallow | /g/my/ |
| Disallow | /*index.rss$ |
| Disallow | /images/sprites/ |
| Disallow | /images/bg/ |
| Disallow | /images/16/ |
| Disallow | /images/32/ |
| Disallow | /images/48/ |
| Disallow | /images/64/ |
| Disallow | /images/100/ |
| Disallow | /images/128/ |
| Disallow | /images/256/ |
| Disallow | /images/share/ |
| Disallow | /manage/ |
| Disallow | /*/manage/ |
| Disallow | /cdn-cgi/ |
| Disallow | /api/ |
| Disallow | /run/track |
| Disallow | /run/dfp |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
slurp
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /asclick/ |
| Disallow | /post_G1/ |
| Disallow | /register_G2/ |
| Disallow | /afs_click/ |
| Disallow | /api/ |
| Disallow | /run/faq/ |
| Disallow | /m/run/faq/ |
| Disallow | /g/run/faq/ |
| Disallow | /my/ |
| Disallow | /m/my/ |
| Disallow | /g/my/ |
| Disallow | /*index.rss$ |
| Disallow | /images/sprites/ |
| Disallow | /images/bg/ |
| Disallow | /images/16/ |
| Disallow | /images/32/ |
| Disallow | /images/48/ |
| Disallow | /images/64/ |
| Disallow | /images/100/ |
| Disallow | /images/128/ |
| Disallow | /images/256/ |
| Disallow | /images/share/ |
| Disallow | /manage/ |
| Disallow | /*/manage/ |
| Disallow | /cdn-cgi/ |
| Disallow | /api/ |
| Disallow | /run/track |
| Disallow | /run/dfp |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
Warnings
- 2 invalid lines.
Comments