Log In Sign Up

netsec.csuci.edu
robots.txt

Robots Exclusion Standard data for netsec.csuci.edu

Resource Scan

Scan Details

Site Domain netsec.csuci.edu
Base Domain csuci.edu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-06-07T00:53:13+00:00
Next Scan 2025-09-05T00:53:13+00:00

Last Successful Scan

Scanned2025-01-16T00:38:44+00:00
URL https://netsec.csuci.edu/robots.txt
Domain IPs 173.255.246.104
Response IP 173.255.246.104
Found Yes
Hash 2d0d9a5f449da345c457708c0c8cacb094594c365d78ab8e90ccbd3e8996cc67
SimHash 55281739c121

Groups

*

Rule Path
Disallow wp-configs.php
Disallow themes.php
Disallow wp-info.php
Disallow xmrlpc.php
Disallow function.php
Disallow wp-login.php
Disallow wp-admin.php

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

meta-externalagent
meta-externalagent

Rule Path
Disallow /

newsnow

Rule Path
Disallow /

news-please

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

peer39_crawler
peer39_crawler/1.0

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

quora-bot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://netsec.csuci.edu/sitemapindex.xml
sitemap https://netsec.csuci.edu/sitemap/1
sitemap https://netsec.csuci.edu/sitemap/2
sitemap https://netsec.csuci.edu/sitemap/3
sitemap https://netsec.csuci.edu/sitemap/4
sitemap https://netsec.csuci.edu/sitemap/5
sitemap https://netsec.csuci.edu/sitemap/6
sitemap https://netsec.csuci.edu/sitemap/7
sitemap https://netsec.csuci.edu/sitemap/8
sitemap https://netsec.csuci.edu/sitemap/9
sitemap https://netsec.csuci.edu/sitemap/10
sitemap https://netsec.csuci.edu/sitemap/11
sitemap https://netsec.csuci.edu/sitemap/12
sitemap https://netsec.csuci.edu/sitemap/13
sitemap https://netsec.csuci.edu/sitemap/14
sitemap https://netsec.csuci.edu/sitemap/15
sitemap https://netsec.csuci.edu/sitemap/16
sitemap https://netsec.csuci.edu/sitemap/17
sitemap https://netsec.csuci.edu/sitemap/18
sitemap https://netsec.csuci.edu/sitemap/19
sitemap https://netsec.csuci.edu/sitemap/20
sitemap https://netsec.csuci.edu/sitemap/21
sitemap https://netsec.csuci.edu/sitemap/22
sitemap https://netsec.csuci.edu/sitemap/23
sitemap https://netsec.csuci.edu/sitemap/24
sitemap https://netsec.csuci.edu/sitemap/25
sitemap https://netsec.csuci.edu/sitemap/26
sitemap https://netsec.csuci.edu/sitemap/27
sitemap https://netsec.csuci.edu/sitemap/28
sitemap https://netsec.csuci.edu/sitemap/29
sitemap https://netsec.csuci.edu/sitemap/30
sitemap https://netsec.csuci.edu/sitemap/31
sitemap https://netsec.csuci.edu/sitemap/32
sitemap https://netsec.csuci.edu/sitemap/33
sitemap https://netsec.csuci.edu/sitemap/34
sitemap https://netsec.csuci.edu/sitemap/35
sitemap https://netsec.csuci.edu/sitemap/36
sitemap https://netsec.csuci.edu/sitemap/37
sitemap https://netsec.csuci.edu/sitemap/38
sitemap https://netsec.csuci.edu/sitemap/39
sitemap https://netsec.csuci.edu/sitemap/40
sitemap https://netsec.csuci.edu/sitemap/41
sitemap https://netsec.csuci.edu/sitemap/42
sitemap https://netsec.csuci.edu/sitemap/43
sitemap https://netsec.csuci.edu/sitemap/44
sitemap https://netsec.csuci.edu/sitemap/45
sitemap https://netsec.csuci.edu/sitemap/46
sitemap https://netsec.csuci.edu/sitemap/47
sitemap https://netsec.csuci.edu/sitemap/48
sitemap https://netsec.csuci.edu/sitemap/49
sitemap https://netsec.csuci.edu/sitemap/50
sitemap https://netsec.csuci.edu/sitemap/51
sitemap https://netsec.csuci.edu/sitemap/52
sitemap https://netsec.csuci.edu/sitemap/53
sitemap https://netsec.csuci.edu/sitemap/54
sitemap https://netsec.csuci.edu/sitemap/55
sitemap https://netsec.csuci.edu/sitemap/56
sitemap https://netsec.csuci.edu/sitemap/57
sitemap https://netsec.csuci.edu/sitemap/58
sitemap https://netsec.csuci.edu/sitemap/59
sitemap https://netsec.csuci.edu/sitemap/60
sitemap https://netsec.csuci.edu/sitemap/61
sitemap https://netsec.csuci.edu/sitemap/62
sitemap https://netsec.csuci.edu/sitemap/63
sitemap https://netsec.csuci.edu/sitemap/64
sitemap https://netsec.csuci.edu/sitemap/65
sitemap https://netsec.csuci.edu/sitemap/66
sitemap https://netsec.csuci.edu/sitemap/67
sitemap https://netsec.csuci.edu/sitemap/68
sitemap https://netsec.csuci.edu/sitemap/69
sitemap https://netsec.csuci.edu/sitemap/70
sitemap https://netsec.csuci.edu/sitemap/71
sitemap https://netsec.csuci.edu/sitemap/72
sitemap https://netsec.csuci.edu/sitemap/73
sitemap https://netsec.csuci.edu/sitemap/74
sitemap https://netsec.csuci.edu/sitemap/75
sitemap https://netsec.csuci.edu/sitemap/76
sitemap https://netsec.csuci.edu/sitemap/77
sitemap https://netsec.csuci.edu/sitemap/78
sitemap https://netsec.csuci.edu/sitemap/79
sitemap https://netsec.csuci.edu/sitemap/80
sitemap https://netsec.csuci.edu/sitemap/81
sitemap https://netsec.csuci.edu/sitemap/82
sitemap https://netsec.csuci.edu/sitemap/83
sitemap https://netsec.csuci.edu/sitemap/84
sitemap https://netsec.csuci.edu/sitemap/85
sitemap https://netsec.csuci.edu/sitemap/86
sitemap https://netsec.csuci.edu/sitemap/87
sitemap https://netsec.csuci.edu/sitemap/88
sitemap https://netsec.csuci.edu/sitemap/89
sitemap https://netsec.csuci.edu/sitemap/90
sitemap https://netsec.csuci.edu/sitemap/91
sitemap https://netsec.csuci.edu/sitemap/92
sitemap https://netsec.csuci.edu/sitemap/93
sitemap https://netsec.csuci.edu/sitemap/94
sitemap https://netsec.csuci.edu/sitemap/95
sitemap https://netsec.csuci.edu/sitemap/96
sitemap https://netsec.csuci.edu/sitemap/97
sitemap https://netsec.csuci.edu/sitemap/98
sitemap https://netsec.csuci.edu/sitemap/99
sitemap https://netsec.csuci.edu/sitemap/100
sitemap https://netsec.csuci.edu/sitemap/101
sitemap https://netsec.csuci.edu/sitemap/102
sitemap https://netsec.csuci.edu/sitemap/103
sitemap https://netsec.csuci.edu/sitemap/104
sitemap https://netsec.csuci.edu/sitemap/105
sitemap https://netsec.csuci.edu/sitemap/106
sitemap https://netsec.csuci.edu/sitemap/107
sitemap https://netsec.csuci.edu/sitemap/108
sitemap https://netsec.csuci.edu/sitemap/109
sitemap https://netsec.csuci.edu/sitemap/110
sitemap https://netsec.csuci.edu/sitemap/111
sitemap https://netsec.csuci.edu/sitemap/112
Back to top

Comments

  • Disallow Rules
Back to top