webcambabes.fr
robots.txt
Robots Exclusion Standard data for webcambabes.fr
Resource Scan
Scan Details
Site Domain | webcambabes.fr |
Base Domain | webcambabes.fr |
Scan Status | Ok |
Last Scan | 2024-10-03T16:47:32+00:00 |
Next Scan | 2024-10-17T16:47:32+00:00 |
Last Scan
Scanned | 2024-10-03T16:47:32+00:00 |
URL | https://webcambabes.fr/robots.txt |
Domain IPs | 5.104.228.27 |
Response IP | 5.104.228.27 |
Found | Yes |
Hash | 853d56a8ba9bf61b165163a20657c44ad06e24535fd9f073315515c0d69f9f8f |
SimHash | 72537390d616 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /classes/ |
Disallow | /connect/ |
Disallow | /go/ |
Disallow | /include/ |
Disallow | /sitemap-gen/ |
Disallow | /tools/ |
Disallow | /vendor/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.webcambabes.fr/sitemap.xml |
Warnings
- 8 invalid lines.