fspark.me
robots.txt
Robots Exclusion Standard data for fspark.me
Resource Scan
Scan Details
Site Domain | fspark.me |
Base Domain | fspark.me |
Scan Status | Ok |
Last Scan | 2025-05-13T17:17:45+00:00 |
Next Scan | 2025-06-12T17:17:45+00:00 |
Last Scan
Scanned | 2025-05-13T17:17:45+00:00 |
URL | https://fspark.me/robots.txt |
Domain IPs | 104.21.2.222, 172.67.129.191, 2606:4700:3033::6815:2de, 2606:4700:3037::ac43:81bf |
Response IP | 172.67.129.191 |
Found | Yes |
Hash | 8c6a9718be764c9bc14951f590148fe4f111ab0f878a4e71dce17218f32b972c |
SimHash | 6b1cce72ebb2 |
Groups
*
Rule | Path |
---|---|
Disallow | /usr/plugins |
Disallow | /archives/my-* |
Other Records
Field | Value |
---|---|
crawl-delay | 120 |
Other Records
Field | Value |
---|---|
sitemap | https://fspark.me/sitemap.xml |