seecalifornia.com
robots.txt

Robots Exclusion Standard data for seecalifornia.com

Resource Scan

Scan Details

Site Domain seecalifornia.com
Base Domain seecalifornia.com
Scan Status Ok
Last Scan2024-10-03T14:01:20+00:00
Next Scan 2024-10-10T14:01:20+00:00

Last Scan

Scanned2024-10-03T14:01:20+00:00
URL https://seecalifornia.com/robots.txt
Redirect http://seecalifornia.com/robots.txt
Domain IPs 192.124.249.3
Response IP 192.124.249.3
Found Yes
Hash 59ec8c92d77fde07d67e4255e74753a5d1dde332862b3b4259b5223afb864691
SimHash 00c8dc80d2c3

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /*.jpg$
Disallow /*.gif$
Disallow /*.JPG$
Disallow /*.GIF$
Disallow /wp-app.php/service
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /tags/

googlebot-image

Rule Path
Disallow /

wesee

Rule Path
Disallow /

psbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot/0.98

Rule Path
Disallow /

ahrefsbot/5.0

Rule Path
Disallow /

wesee:ads/pagebot

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

admantx

Rule Path
Disallow /

riddler

Rule Path
Disallow /

yandex

Rule Path
Disallow /