Log In Sign Up

ctfces.tech
robots.txt

Robots Exclusion Standard data for ctfces.tech

Resource Scan

Scan Details

Site Domain ctfces.tech
Base Domain ctfces.tech
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-10-13T04:30:50+00:00
Next Scan 2026-01-11T04:30:50+00:00

Last Successful Scan

Scanned2025-05-24T00:00:05+00:00
URL https://ctfces.tech/robots.txt
Domain IPs 104.21.72.154, 172.67.151.209, 2606:4700:3032::6815:489a, 2606:4700:3037::ac43:97d1
Response IP 172.67.151.209
Found Yes
Hash 4f733288dcfe78ae14e06c28db01fc4277784906e08ba2e7ba37c9abfb1bd0ee
SimHash 3cdb713383c3

Groups

*

Rule Path
Disallow /admin
Back to top

Comments

  • User-agent: DummyBot1
  • Disallow: /dummy1/
  • Allow: /public/
  • Crawl-delay: 5
  • Request-rate: 1/10
  • User-agent: DummyBot2
  • Disallow: /dummy2/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 2/15
  • User-agent: ImaginaryCrawler
  • Disallow: /imaginary/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 1/5
  • User-agent: ROT 47
  • Disallow: /dummy3/
  • Allow: /public/
  • Crawl-delay: 6
  • Request-rate: 2/12
  • User-agent: RandomSpider
  • Disallow: /random/
  • Allow: /public/
  • Crawl-delay: 7
  • Request-rate: 3/20
  • User-agent: NonExistentBot
  • Disallow: /nonexistent/
  • Allow: /public/
  • Crawl-delay: 12
  • Request-rate: 1/7
  • User-agent: DummyBot4
  • Disallow: /dummy4/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 1/8
  • User-agent: FictionalSpider
  • Disallow: /fictional/
  • Allow: /public/
  • Crawl-delay: 11
  • Request-rate: 2/14
  • User-agent: ImaginaryBot
  • Disallow: /imaginary/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/6
  • User-agent: GhostCrawler
  • Disallow: /ghost/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 3/18
  • User-agent: DummyBot5
  • Disallow: /dummy5/
  • Allow: /public/
  • Crawl-delay: 7
  • Request-rate: 1/9
  • User-agent: DummyBot6
  • Disallow: /dummy6/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 2/13
  • User-agent: PhantomCrawler
  • Disallow: /phantom/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/7
  • User-agent: MirageBot
  • Disallow: /mirage/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 2/15
  • User-agent: QuasarSpider
  • Disallow: /quasar/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 1/8
  • User-agent: EnigmaCrawler
  • Disallow: /enigma/
  • Allow: /public/
  • Crawl-delay: 7
  • Request-rate: 3/20
  • User-agent: NebulaBot
  • Disallow: /nebula/
  • Allow: /public/
  • Crawl-delay: 11
  • Request-rate: 2/12
  • User-agent: VirtualSpider
  • Disallow: /virtual/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 1/6
  • User-agent: CryptoCrawler
  • Disallow: /crypto/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/10
  • User-agent: NebulousBot
  • Disallow: /nebulous/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 2/14
  • User-agent: PseudoSpider
  • Disallow: /pseudo/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 1/9
  • User-agent: DummyBot7
  • Disallow: /dummy7/
  • Allow: /public/
  • Crawl-delay: 6
  • Request-rate: 2/12
  • User-agent: DummyBot8
  • Disallow: /dummy8/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 1/8
  • User-agent: QuantumCrawler
  • Disallow: /quantum/
  • Allow: /public/
  • Crawl-delay: 11
  • Request-rate: 2/14
  • User-agent: NebulaRover
  • Disallow: /nebularover/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/6
  • User-agent: SpectralSpider
  • Disallow: /spectral/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 3/18
  • User-agent: DummyBot9
  • Disallow: /dummy9/
  • Allow: /public/
  • Crawl-delay: 7
  • Request-rate: 1/9
  • User-agent: DummyBot10
  • Disallow: /dummy10/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 2/13
  • User-agent: CosmicCrawler
  • Disallow: /cosmic/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/7
  • User-agent: GalacticSpider
  • Disallow: /galactic/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 2/15
  • User-agent: HyperQuasar
  • Disallow: /hyperquasar/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 1/8
  • User-agent: VirtualNavigator
  • Disallow: /virtualnavigator/
  • Allow: /public/
  • Crawl-delay: 7
  • Request-rate: 3/20
  • User-agent: NebulaSeeker
  • Disallow: /nebulaseeker/
  • Allow: /public/
  • Crawl-delay: 11
  • Request-rate: 2/12
  • User-agent: QuantumExplorer
  • Disallow: /quantumexplorer/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 1/6
  • User-agent: CryptoBot
  • Disallow: /cryptobot/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/10
  • User-agent: NebulaCrawler
  • Disallow: /nebulacrawler/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 2/14
  • User-agent: PseudoNavigator
  • Disallow: /pseudonavigator/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 1/9
  • User-agent: QuantumBot
  • Disallow: /quantumbot/
  • Allow: /public/
  • Crawl-delay: 6
  • Request-rate: 2/12
  • User-agent: QuantumRover
  • Disallow: /quantumrover/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 1/8
  • User-agent: HyperCrawler
  • Disallow: /hypercrawler/
  • Allow: /public/
  • Crawl-delay: 11
  • Request-rate: 2/14
  • User-agent: NebulaExplorer
  • Disallow: /nebulaexplorer/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/6
  • User-agent: SpectralSeeker
  • Disallow: /spectralseeker/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 3/18
  • User-agent: GalacticNavigator
  • Disallow: /galacticnavigator/
  • Allow: /public/
  • Crawl-delay: 7
  • Request-rate: 1/9
  • User-agent: QuantumSeeker
  • Disallow: /quantumseeker/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 2/13
  • User-agent: CosmicBot
  • Disallow: /cosmicbot/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/7
  • User-agent: QuantumSpider
  • Disallow: /quantumspider/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 2/15
  • User-agent: HyperQuasarBot
  • Disallow: /hyperquasarbot/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 1/8
  • User-agent: VirtualRover
  • Disallow: /virtualrover/
  • Allow: /public/
  • Crawl-delay: 7
  • Request-rate: 3/20
  • User-agent: NebulaPioneer
  • Disallow: /nebulapioneer/
  • Allow: /public/
  • Crawl-delay: 11
  • Request-rate: 2/12
  • User-agent: QuantumNavigator
  • Disallow: /quantumnavigator/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 1/6
  • User-agent: CryptoExplorer
  • Disallow: /cryptoexplorer/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/10
  • User-agent: NebulaBotX
  • Disallow: /nebulabotx/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 2/14
  • User-agent: PseudoCrawler
  • Disallow: /pseudocrawler/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 1/9
  • User-agent: QuantumBotX
  • Disallow: /quantumbotx/
  • Allow: /public/
  • Crawl-delay: 6
  • Request-rate: 2/12
  • User-agent: QuantumRoverX
  • Disallow: /quantumroverx/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 1/8
  • User-agent: HyperCrawlerX
  • Disallow: /hypercrawlerx/
  • Allow: /public/
  • Crawl-delay: 11
  • Request-rate: 2/14
  • User-agent: NebulaExplorerX
  • Disallow: /nebulaexplorerx/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/6
  • User-agent: SpectralSeekerX
  • Disallow: /spectralseekerx/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 3/18
  • User-agent: GalacticNavigatorX
  • Disallow: /galacticnavigatorx/
  • Allow: /public/
  • Crawl-delay: 7
  • Request-rate: 1/9
  • User-agent: QuantumSeekerX
  • Disallow: /quantumseekerx/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: :6/9
  • User-agent: CosmicBotX
  • Disallow: /cosmicbotx/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/7
  • User-agent: QuantumSpiderX
  • Disallow: /quantumspiderx/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 2/15
  • User-agent: HyperQuasarBotX
  • Disallow: /hyperquasarbotx/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 1/8
  • User-agent: VirtualRoverX
  • Disallow: /virtualroverx/
  • Allow: /public/
  • Crawl-delay: 7
  • Request-rate: 3/20
  • User-agent: NebulaPioneerX
  • Disallow: /nebulapioneerx/
  • Allow: /public/
  • Crawl-delay: 11
  • Request-rate: 2/12
  • User-agent: QuantumNavigatorX
  • Disallow: /quantumnavigatorx/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 1/6
  • User-agent: CryptoExplorerX
  • Disallow: /cryptoexplorerx/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/10
  • User-agent: NebulaBotY
  • Disallow: /nebulaboty/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 2/14
  • User-agent: PseudoCrawlerX
  • Disallow: /pseudocrawlerx/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 1/9
  • User-agent: QuantumBotY
  • Disallow: /quantumboty/
  • Allow: /public/
  • Crawl-delay: 6
  • Request-rate: 2/12
  • User-agent: QuantumRoverY
  • Disallow: /quantumrovery/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 1/8
  • User-agent: HyperCrawlerY
  • Disallow: /hypercrawlery/
  • Allow: /public/
  • Crawl-delay: 11
  • Request-rate: 2/14
  • User-agent: HyperQuasarBotY
  • Disallow: !c?5_CcVD0#bEC`3FE`_?
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 1/8
  • User-agent: NebulaExplorerY
  • Disallow: /nebulaexplorery/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/6
  • User-agent: SpectralSeekerY
  • Disallow: /spectralseekery/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 3/18
  • User-agent: GalacticNavigatorY
  • Disallow: /galacticnavigatory/
  • Allow: /public/
  • Crawl-delay: 7
  • Request-rate: 1/9
  • User-agent: QuantumSeekerY
  • Disallow: /quantumseekery/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 2/13
  • User-agent: CosmicBotY
  • Disallow: /cosmicboty/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/7
  • User-agent: QuantumSpiderY
  • Disallow: /quantumspidery/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 2/15
  • User-agent: NebulaExplorerY
  • Disallow: /nebulaexplorery/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/6
  • User-agent: SpectralSeekerY
  • Disallow: /spectralseekery/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 3/18
  • User-agent: GalacticNavigatorY
  • Disallow: /galacticnavigatory/
  • Allow: /public/
  • Crawl-delay: 7
  • Request-rate: 1/9
  • User-agent: QuantumSeekerY
  • Disallow: /quantumseekery/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 2/13
  • User-agent: CosmicBotY
  • Disallow: /cosmicboty/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/7
  • User-agent: QuantumSpiderY
  • Disallow: /quantumspidery/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 2/15
  • User-agent: NebulaExplorerY
  • Disallow: /nebulaexplorery/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/6
  • User-agent: SpectralSeekerY
  • Disallow: /spectralseekery/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 3/18
  • User-agent: GalacticNavigatorY
  • Disallow: /galacticnavigatory/
  • Allow: /public/
  • Crawl-delay: 7
  • Request-rate: 1/9
  • User-agent: QuantumSeekerY
  • Disallow: /quantumseekery/
  • Allow: /public/
  • Crawl-delay: 10
  • Request-rate: 2/13
  • User-agent: CosmicBotY
  • Disallow: /cosmicboty/
  • Allow: /public/
  • Crawl-delay: 8
  • Request-rate: 1/7
  • User-agent: QuantumSpiderY
  • Disallow: /quantumspidery/
  • Allow: /public/
  • Crawl-delay: 9
  • Request-rate: 2/15
Back to top