blog.stephane-robert.info
robots.txt
Robots Exclusion Standard data for blog.stephane-robert.info
Resource Scan
Scan Details
Site Domain | blog.stephane-robert.info |
Base Domain | stephane-robert.info |
Scan Status | Ok |
Last Scan | 2024-05-27T20:08:42+00:00 |
Next Scan | 2024-06-26T20:08:42+00:00 |
Last Scan
Scanned | 2024-05-27T20:08:42+00:00 |
URL | https://blog.stephane-robert.info/robots.txt |
Domain IPs | 108.156.133.109, 108.156.133.41, 108.156.133.57, 108.156.133.63, 2600:9000:2755:1000:19:72ff:4980:93a1, 2600:9000:2755:3e00:19:72ff:4980:93a1, 2600:9000:2755:4c00:19:72ff:4980:93a1, 2600:9000:2755:5800:19:72ff:4980:93a1, 2600:9000:2755:9000:19:72ff:4980:93a1, 2600:9000:2755:b200:19:72ff:4980:93a1, 2600:9000:2755:b800:19:72ff:4980:93a1, 2600:9000:2755:ec00:19:72ff:4980:93a1 |
Response IP | 108.156.133.63 |
Found | Yes |
Hash | be03abc18ad4b5a34ade64a12ef1f9a43f98355d3e512cbbc4aa7cdd5912ff9a |
SimHash | 49155244cdb1 |
Groups
*
Rule | Path |
---|---|
Disallow | /*index.xml$ |
Disallow | /index.json |
Disallow | /search/index.json |
Other Records
Field | Value |
---|---|
sitemap | https://blog.stephane-robert.info/sitemap.xml |