funlith.com
robots.txt

Robots Exclusion Standard data for funlith.com

Resource Scan

Scan Details

Site Domain funlith.com
Base Domain funlith.com
Scan Status Ok
Last Scan2025-09-18T23:36:40+00:00
Next Scan 2025-09-25T23:36:40+00:00

Last Scan

Scanned2025-09-18T23:36:40+00:00
URL https://funlith.com/robots.txt
Domain IPs 76.76.21.21
Response IP 76.76.21.21
Found Yes
Hash 521793a1ff2e32141700f0d524a88336f370200536099ca6062ce699703c825d
SimHash 200c4a9ee693

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /private/

Other Records

Field Value
sitemap https://funlith.com/sitemap.xml

Comments

  • Disallow crawling of API paths
  • Disallow crawling of specific paths
  • Sitemap location (using full URL format)