saint.cf
robots.txt
Robots Exclusion Standard data for saint.cf
Resource Scan
Scan Details
Site Domain | saint.cf |
Base Domain | saint.cf |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-09-19T17:42:28+00:00 |
Next Scan | 2024-12-18T17:42:28+00:00 |
Last Successful Scan
Scanned | 2024-01-31T12:18:38+00:00 |
URL | http://saint.cf/robots.txt |
Domain IPs | 16.162.137.164 |
Response IP | 16.162.137.164 |
Found | Yes |
Hash | 5e0305293acbc86c98a3f2824afa5eb2ead2ff77d2d5af7173a8622438ff0a91 |
SimHash | b10241485718 |
Groups
adsbot-google
Rule | Path |
---|---|
Disallow | /maps/api/js/ |
Allow | /maps/api/js |
Disallow | /maps/api/place/js/ |
Disallow | /maps/api/staticmap |
Disallow | /maps/api/streetview |
Disallow | /%24rpc/google.internal.maps.mapsjs.v1.MapsJsInternalService/ |
baiduspider
Rule | Path |
---|---|
Disallow | /maps/api/js/ |
Allow | /maps/api/js |
Disallow | /maps/api/place/js/ |
Disallow | /maps/api/staticmap |
Disallow | /maps/api/streetview |
Disallow | /%24rpc/google.internal.maps.mapsjs.v1.MapsJsInternalService/ |
yisouspider
Rule | Path |
---|---|
Disallow | /maps/api/js/ |
Allow | /maps/api/js |
Disallow | /maps/api/place/js/ |
Disallow | /maps/api/staticmap |
Disallow | /maps/api/streetview |
Disallow | /%24rpc/google.internal.maps.mapsjs.v1.MapsJsInternalService/ |
petalbot
Rule | Path |
---|---|
Disallow | /maps/api/js/ |
Allow | /maps/api/js |
Disallow | /maps/api/place/js/ |
Disallow | /maps/api/staticmap |
Disallow | /maps/api/streetview |
Disallow | /%24rpc/google.internal.maps.mapsjs.v1.MapsJsInternalService/ |
bytespider
Rule | Path |
---|---|
Disallow | /maps/api/js/ |
Allow | /maps/api/js |
Disallow | /maps/api/place/js/ |
Disallow | /maps/api/staticmap |
Disallow | /maps/api/streetview |
Disallow | /%24rpc/google.internal.maps.mapsjs.v1.MapsJsInternalService/ |
sogou web spider
Rule | Path |
---|---|
Disallow | /maps/api/js/ |
Allow | /maps/api/js |
Disallow | /maps/api/place/js/ |
Disallow | /maps/api/staticmap |
Disallow | /maps/api/streetview |
Disallow | /%24rpc/google.internal.maps.mapsjs.v1.MapsJsInternalService/ |
sogou inst spider
Rule | Path |
---|---|
Disallow | /maps/api/js/ |
Allow | /maps/api/js |
Disallow | /maps/api/place/js/ |
Disallow | /maps/api/staticmap |
Disallow | /maps/api/streetview |
Disallow | /%24rpc/google.internal.maps.mapsjs.v1.MapsJsInternalService/ |
baiduspider-render
Rule | Path |
---|---|
Disallow | /maps/api/js/ |
Allow | /maps/api/js |
Disallow | /maps/api/place/js/ |
Disallow | /maps/api/staticmap |
Disallow | /maps/api/streetview |
Disallow | /%24rpc/google.internal.maps.mapsjs.v1.MapsJsInternalService/ |
*
Rule | Path |
---|---|
Disallow | /maps/api/js/ |
Allow | /maps/api/js |
Disallow | /maps/api/place/js/ |
Disallow | /maps/api/staticmap |
Disallow | /maps/api/streetview |
Disallow | /%24rpc/google.internal.maps.mapsjs.v1.MapsJsInternalService/ |
Warnings
- 7 invalid lines.