chat.nostalgie.fr
robots.txt
Robots Exclusion Standard data for chat.nostalgie.fr
Resource Scan
Scan Details
Site Domain | chat.nostalgie.fr |
Base Domain | nostalgie.fr |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Request timed out. |
Last Scan | 2024-06-10T11:44:25+00:00 |
Next Scan | 2024-06-17T11:44:25+00:00 |
Last Successful Scan
Scanned | 2024-06-02T11:42:39+00:00 |
URL | https://chat.nostalgie.fr/robots.txt |
Domain IPs | 185.40.101.46 |
Response IP | 185.40.101.46 |
Found | Yes |
Hash | 8a3114caa6a093e28c58d0bbeea38b61f32454ce5d2a71d06732dc8a3cc087d3 |
SimHash | 415dcb102773 |
Groups
hybridbot (hybrid.ru/about. if our bot caused problems please contact us. contact email: m.lyashkov@targetix.net)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; grapeshotcrawler/2.0; +http://www.grapeshot.co.uk/crawler.php)
Rule | Path |
---|---|
Disallow | / |
sirdatabot (+https://semantic-api.docs.sirdata.net/contextual-api/contextual-api/introduction)
Rule | Path |
---|---|
Disallow | /Account/Activate/ |
*
Rule | Path |
---|---|
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://chat.nostalgie.fr/sitemap.xml |