18-comicfreedom.org
robots.txt

Robots Exclusion Standard data for 18-comicfreedom.org

Resource Scan

Scan Details

Site Domain 18-comicfreedom.org
Base Domain 18-comicfreedom.org
Scan Status Ok
Last Scan7/2/2025, 1:53:53 AM
Next Scan 7/9/2025, 1:53:53 AM

Last Scan

Scanned7/2/2025, 1:53:53 AM
URL https://18-comicfreedom.org/robots.txt
Redirect https://18comic-wantgo.cc/robots.txt
Redirect Domain 18comic-wantgo.cc
Redirect Base 18comic-wantgo.cc
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.10.154, 172.67.163.160, 2606:4700:3031::ac43:a3a0, 2606:4700:3033::6815:a9a
Response IP 104.21.10.154
Found Yes
Hash bee53099c40cf91d6db23a0df0e80b20dd6312f51e548e60ba4b0fd7d0d1bde1
SimHash 4b1ecc715398

Groups

*

Rule Path
Allow /media/videos/tmb/*/*.jpg
Allow /media/albums/*.jpg
Allow /templates/frontend/
Allow /media/*.jpg
Allow /media/*/preview.mp4
Disallow /siteadmin/
Disallow /cache/
Disallow /include/
Disallow /install/
Disallow /language/
Disallow /media/
Disallow /tmp/
Disallow /classes/
Disallow /templates/
Disallow /scripts/
Disallow /addons/
Disallow /cron/
Disallow /contrib/

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

sogou

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mauibot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

serpstatbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

seokicks-robot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10