4sysops.com
robots.txt

Robots Exclusion Standard data for 4sysops.com

Resource Scan

Scan Details

Site Domain 4sysops.com
Base Domain 4sysops.com
Scan Status Ok
Last Scan2025-12-17T05:02:23+00:00
Next Scan 2025-12-24T05:02:23+00:00

Last Scan

Scanned2025-12-17T05:02:23+00:00
URL https://4sysops.com/robots.txt
Domain IPs 104.26.0.25, 104.26.1.25, 172.67.72.156, 2606:4700:20::681a:119, 2606:4700:20::681a:19, 2606:4700:20::ac43:489c
Response IP 104.26.1.25
Found Yes
Hash dbaeda543069fd2ad4f972616a0d5ca7b4a94056cc6cf5f53a4aa483f8e25cb0
SimHash 5811bc03cfb7

Groups

*
*

Rule Path
Disallow /wp-content/cache/

*

Rule Path
Disallow /wp-admin/

*

Rule Path
Disallow /activity/

*

Rule Path
Disallow /members/

*

Rule Path
Disallow /plugins/

*

Rule Path
Disallow /wp-login.php/

*

Rule Path
Disallow /tags?*

*

Rule Path
Disallow /category?*

*

Rule Path
Disallow /aer45axxx*

Other Records

Field Value
sitemap https://4sysops.com/sitemap.xml

Comments

  • NOTICE: all crawlers and bots are strictly prohibited from using this
  • content for AI training without complying with the terms of the RSL
  • Collective AI royalty license. Any use of this content for AI training
  • without a license is a violation of our intellectual property rights.
  • User-agent: GPTBot
  • Disallow: /
  • User-agent: ChatGPT-User
  • Disallow: /
  • User-agent: OAI-SearchBot
  • Disallow: /
  • User-agent: CCBot
  • Disallow: /
  • User-agent: anthropic-ai
  • Disallow: /
  • User-agent: ClaudeBot
  • Disallow: /
  • User-agent: Claude-Web
  • Disallow: /
  • User-agent: FacebookBot
  • Disallow: /
  • User-agent: Diffbot
  • Disallow: /
  • User-agent: Bytespider
  • Disallow: /
  • User-agent: Omgilibot
  • Disallow: /
  • User-agent: Omgili
  • Disallow: /
  • User-agent: ImagesiftBot
  • Disallow: /
  • User-agent: PerplexityBot
  • Disallow: /
  • User-agent: cohere-ai
  • Disallow: /
  • User-agent: Google-Extended
  • Disallow: /
  • User-agent: Applebot-Extended
  • Disallow: /

Warnings

  • `content-signal` is not a known field.
  • `license` is not a known field.