18comic-genshin.xyz
robots.txt

Robots Exclusion Standard data for 18comic-genshin.xyz

Resource Scan

Scan Details

Site Domain 18comic-genshin.xyz
Base Domain 18comic-genshin.xyz
Scan Status Ok
Last Scan6/28/2025, 7:03:30 PM
Next Scan 7/5/2025, 7:03:30 PM

Last Scan

Scanned6/28/2025, 7:03:30 PM
URL https://18comic-genshin.xyz/robots.txt
Redirect https://18comic-wantgo.org/robots.txt
Redirect Domain 18comic-wantgo.org
Redirect Base 18comic-wantgo.org
Domain IPs 104.21.85.156, 172.67.207.82, 2606:4700:3036::6815:559c, 2606:4700:3037::ac43:cf52
Redirect IPs 104.21.31.140, 172.67.177.21, 2606:4700:3031::6815:1f8c, 2606:4700:3035::ac43:b115
Response IP 172.67.177.21
Found Yes
Hash bee53099c40cf91d6db23a0df0e80b20dd6312f51e548e60ba4b0fd7d0d1bde1
SimHash 4b1ecc715398

Groups

*

Rule Path
Allow /media/videos/tmb/*/*.jpg
Allow /media/albums/*.jpg
Allow /templates/frontend/
Allow /media/*.jpg
Allow /media/*/preview.mp4
Disallow /siteadmin/
Disallow /cache/
Disallow /include/
Disallow /install/
Disallow /language/
Disallow /media/
Disallow /tmp/
Disallow /classes/
Disallow /templates/
Disallow /scripts/
Disallow /addons/
Disallow /cron/
Disallow /contrib/

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

sogou

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mauibot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

serpstatbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

seokicks-robot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10