fspark.me
robots.txt

Robots Exclusion Standard data for fspark.me

Resource Scan

Scan Details

Site Domain fspark.me
Base Domain fspark.me
Scan Status Ok
Last Scan2025-05-13T17:17:45+00:00
Next Scan 2025-06-12T17:17:45+00:00

Last Scan

Scanned2025-05-13T17:17:45+00:00
URL https://fspark.me/robots.txt
Domain IPs 104.21.2.222, 172.67.129.191, 2606:4700:3033::6815:2de, 2606:4700:3037::ac43:81bf
Response IP 172.67.129.191
Found Yes
Hash 8c6a9718be764c9bc14951f590148fe4f111ab0f878a4e71dce17218f32b972c
SimHash 6b1cce72ebb2

Groups

*

Rule Path
Disallow /usr/plugins
Disallow /archives/my-*

Other Records

Field Value
crawl-delay 120

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://fspark.me/sitemap.xml