cartes-2-france.com
robots.txt
Robots Exclusion Standard data for cartes-2-france.com
Resource Scan
Scan Details
Site Domain | cartes-2-france.com |
Base Domain | cartes-2-france.com |
Scan Status | Ok |
Last Scan | 2024-11-05T20:26:01+00:00 |
Next Scan | 2024-11-12T20:26:01+00:00 |
Last Scan
Scanned | 2024-11-05T20:26:01+00:00 |
URL | https://www.cartes-2-france.com/robots.txt |
Domain IPs | 194.163.191.66 |
Response IP | 194.163.191.66 |
Found | Yes |
Hash | 921155cc277fe6494583abadb38ddf7f810e7ac130086ad74a61eee240e81c6a |
SimHash | 5015dae3c763 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /photos/ |
mozilla/3.0 (compatible; scan4mail (advanced version) http://www.peterspages.net/?scan4mail)
Rule | Path |
---|---|
Disallow | / |
sogou orion spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm
Product | Comment |
---|---|
sogou orion spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm | 07) |
Rule | Path |
---|---|
Disallow | / |
sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm
Product | Comment |
---|---|
sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm | 07) |
Rule | Path |
---|---|
Disallow | / |
mozilla/3.0 (compatible; scan4mail (advanced version) http://www.peterspages.net/?scan4mail)
Rule | Path |
---|---|
Disallow | / |
sogou orion spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm
Product | Comment |
---|---|
sogou orion spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm | 07) |
Rule | Path |
---|---|
Disallow | / |
sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm
Product | Comment |
---|---|
sogou web spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm | 07) |
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (linux; android 5.0) applewebkit/537.36 (khtml, like gecko) mobile safari/537.36 (compatible; bytespider; spider-feedback@bytedance.com)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 applewebkit/537.36 (khtml, like gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) chrome/116.0.1938.76 safari/537.36
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; dataforseobot/1.0; +https://dataforseo.com/dataforseo-bot)
Rule | Path |
---|---|
Disallow | / |
Warnings
- 5 invalid lines.
Comments