Log In Sign Up

cityunionbank.com
robots.txt

Robots Exclusion Standard data for cityunionbank.com

Resource Scan

Scan Details

Site Domain cityunionbank.com
Base Domain cityunionbank.com
Scan Status Ok
Last Scan2025-03-05T21:51:15+00:00
Next Scan 2025-04-04T21:51:15+00:00

Last Scan

Scanned2025-03-05T21:51:15+00:00
URL https://cityunionbank.com/robots.txt
Domain IPs 125.17.14.218, 14.142.105.88
Response IP 125.17.14.218
Found Yes
Hash 1b22a2123359c095d3240369137f1aabd754ac5ad5e0836c32e48472deab325e
SimHash 6d148d53f651

Groups

*

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow

ahrefssiteaudit

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

googleother

Rule Path
Disallow

googleother-image

Rule Path
Disallow

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-news

Rule Path
Disallow

googlebot-video

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

googlebot-image/1.0

Rule Path
Disallow

googlebot-news/2.3

Rule Path
Disallow

googlebot-video/1.0

Rule Path
Disallow

google-ads-overview-crawler

Rule Path
Disallow

siteauditbot

Rule Path
Disallow

siteauditbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://cityunionbank.com/sitemap.xml
sitemap https://cityunionbank.com/sitemap.xml
sitemap https://cityunionbank.com/sitemap.xml
sitemap https://cityunionbank.com/sitemap.xml
sitemap https://cityunionbank.com/sitemap.xml
sitemap https://cityunionbank.com/sitemap.xml
sitemap https://cityunionbank.com/sitemap.xml
sitemap https://cityunionbank.com/sitemap.xml
sitemap https://cityunionbank.com/sitemap.xml
sitemap https://cityunionbank.com/sitemap.xml
sitemap https://cityunionbank.com/sitemap.xml
sitemap https://cityunionbank.com/sitemap.xml
sitemap https://cityunionbank.com/sitemap.xml
sitemap https://cityunionbank.com/sitemap.xml
sitemap https://cityunionbank.com/sitemap.xml
sitemap https://cityunionbank.com/sitemap.xml
Back to top