forums.soulcaster.cc
robots.txt

Robots Exclusion Standard data for forums.soulcaster.cc

Resource Scan

Scan Details

Site Domain forums.soulcaster.cc
Base Domain soulcaster.cc
Scan Status Ok
Last Scan2025-12-20T11:30:40+00:00
Next Scan 2026-01-03T11:30:40+00:00

Last Scan

Scanned2025-12-20T11:30:40+00:00
URL https://forums.soulcaster.cc/robots.txt
Domain IPs 104.21.34.218, 172.67.165.153, 2606:4700:3032::ac43:a599, 2606:4700:3037::6815:22da
Response IP 104.21.34.218
Found Yes
Hash 657f9ccdf88326aca7f37c719c16c720cb94710c348e433377efebc54ffc16cc
SimHash 2d4f4ec1fd89

Groups

*

Rule Path Comment
Disallow /admin.php -
Disallow /install/ -
Disallow /internal_data/ -
Disallow /library/ -
Disallow /src/ -
Disallow /styles/ -
Disallow /data/ -
Disallow /find-new/ -
Disallow /whats-new/ -
Disallow /goto/ -
Disallow /login/ -
Disallow /logout/ -
Disallow /register/ -
Disallow /account/ -
Disallow /lost-password/ -
Disallow /search/ -
Disallow /posts/ prevent single-post URLs from being indexed
Allow /members/ -
Allow / -

Other Records

Field Value
sitemap https://forums.soulcaster.cc/sitemap.xml

Comments

  • --- XenForo friendly robots.txt ---
  • Admin & system
  • Low-value / duplicate pages
  • âœ
  • Explicitly allow everything else
  • Sitemap

Warnings

  • 1 invalid line.