sybos.net
robots.txt

Robots Exclusion Standard data for sybos.net

Resource Scan

Scan Details

Site Domain sybos.net
Base Domain sybos.net
Scan Status Ok
Last Scan2025-09-19T11:18:19+00:00
Next Scan 2025-10-19T11:18:19+00:00

Last Scan

Scanned2025-09-19T11:18:19+00:00
URL http://sybos.net/robots.txt
Redirect https://www.solarys.com/robots.txt
Redirect Domain www.solarys.com
Redirect Base solarys.com
Domain IPs 78.46.215.174
Redirect IPs 13.203.125.58, 13.233.175.166, 3.109.243.18
Response IP 52.68.134.190
Found Yes
Hash b907dbd7ae5eb841457b0ae00d4b0a34deef55d1adda6fd3d7118d6dd6058551
SimHash a91818868b03

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /admin/
Disallow /temp/

webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea

Rule Path
Disallow /

Other Records

Field Value
sitemap http://sybos.com
sitemap https://www.solarys.com/sitemap.xml

Comments

  • ===================================
  • Generator: http://pixelfolk.net/tools/robots
  • Erstellt am: 18.04.2024, 10:11
  • Webseite: http://http://sybos.com
  • ===================================
  • ===================================
  • Folgende Seiten sollen nicht indexiert werden:
  • ===================================
  • ===================================
  • Schließe folgende Spider komplett aus:
  • ===================================