ctf.cyber-cit.club
robots.txt
Robots Exclusion Standard data for ctf.cyber-cit.club
Resource Scan
Scan Details
| Site Domain | ctf.cyber-cit.club |
| Base Domain | cyber-cit.club |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-11-09T04:40:02+00:00 |
| Next Scan | 2026-01-08T04:40:02+00:00 |
Last Successful Scan
| Scanned | 2025-08-18T14:31:08+00:00 |
| URL | https://ctf.cyber-cit.club/robots.txt |
| Domain IPs | 104.21.24.10, 172.67.215.71, 2606:4700:3032::6815:180a, 2606:4700:3034::ac43:d747 |
| Response IP | 172.67.215.71 |
| Found | Yes |
| Hash | ece99386717428a2c28464f67f6e8d693e378d16d9f380f49ece76415d3e98ee |
| SimHash | a1bede124620 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /tmp/ |
| Disallow | /junk/ |
| Disallow | /cache/ |
| Disallow | /logs/ |
| Disallow | /backups/ |
| Disallow | /admin/ |
| Disallow | /admin-panel/ |
| Disallow | /secret/ |
| Disallow | /private/ |
| Disallow | /config/ |
| Disallow | /settings/ |
| Disallow | /system/ |
| Disallow | /core/ |
| Disallow | /dev/ |
| Disallow | /test/ |
| Disallow | /sandbox/ |
| Disallow | /experimental/ |
| Disallow | /staging/ |
| Disallow | /beta/ |
| Disallow | /preview/ |
| Disallow | /tmp_test/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /plugins/ |
| Disallow | /themes/ |
| Disallow | /modules/ |
| Disallow | /extensions/ |
| Disallow | /vendor/ |
| Disallow | /assets/ |
| Disallow | /api/ |
| Disallow | /data/ |
| Disallow | /export/ |
| Disallow | /download/ |
| Disallow | /import/ |
| Disallow | /json/ |
| Disallow | /xml/ |
| Disallow | /csv/ |
| Disallow | /alpha/ |
| Disallow | /bravo/ |
| Disallow | /charlie/ |
| Disallow | /delta/ |
| Disallow | /echo/ |
| Disallow | /foxtrot/ |
| Disallow | /golf/ |
| Disallow | /hotel/ |
| Disallow | /india/ |
| Disallow | /juliet/ |
| Disallow | /kilo/ |
| Disallow | /lima/ |
| Disallow | /mike/ |
| Disallow | /november/ |
| Disallow | /oscar/ |
| Disallow | /papa/ |
| Disallow | /quebec/ |
| Disallow | /romeo/ |
| Disallow | /sierra/ |
| Disallow | /tango/ |
| Disallow | /uniform/ |
| Disallow | /victor/ |
| Disallow | /whiskey/ |
| Disallow | /xray/ |
| Disallow | /yankee/ |
| Disallow | /zulu/ |
| Disallow | /archive/ |
| Disallow | /deprecated/ |
| Disallow | /old_backup/ |
| Disallow | /historic/ |
| Disallow | /unused/ |
| Disallow | /redundant/ |
| Disallow | /experimental_deploy/ |
| Disallow | /CIT%7Bm6F2nr8RgjYI%7D/ |
| Disallow | /beta_testing/ |
| Disallow | /temp_storage/ |
| Disallow | /offline/ |
| Disallow | /info/ |
| Disallow | /hidden-files/ |
| Disallow | /restricted/ |
| Disallow | /confidential/ |
| Disallow | /sensitive_data/ |
| Disallow | /internal/ |
| Disallow | /miscellaneous/ |
| Disallow | /obscure_logs/ |
| Disallow | /shadow/ |
| Disallow | /vault/ |
| Disallow | /zone1/ |
| Disallow | /zone2/ |
| Disallow | /zone3/ |
| Disallow | /lockdown/ |
| Disallow | /noentry/ |
| Disallow | /do_not_index/ |
| Disallow | /blocked/ |
| Disallow | /deny_all/ |
| Disallow | /no_crawl/ |
| Disallow | /no_access/ |
| Disallow | /alpha-extra/ |
| Disallow | /beta-secure/ |
| Disallow | /gamma/ |
| Disallow | /delta-secure/ |
| Disallow | /epsilon/ |
| Disallow | /file_storage/ |
| Disallow | /media_temp/ |
| Disallow | /reserve/ |
| Disallow | /auxiliary/ |
| Disallow | /helper/ |
| Disallow | /content_backup/ |
| Disallow | /structure/ |
| Disallow | /undocumented/ |
| Disallow | /system_logs/ |
| Disallow | /error_logs/ |
| Disallow | /access_logs/ |
| Disallow | /data_archive/ |
| Disallow | /old_versions/ |
| Disallow | /legacy/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://cyber-cit.club/sitemap_index.xml |
| sitemap | https://cyber-cit.club/sitemap_news.xml |
| sitemap | https://cyber-cit.club/sitemap_images.xml |
Comments