doujints.com
robots.txt

Robots Exclusion Standard data for doujints.com

Resource Scan

Scan Details

Site Domain doujints.com
Base Domain doujints.com
Scan Status Ok
Last Scan2024-06-02T02:25:13+00:00
Next Scan 2024-07-02T02:25:13+00:00

Last Scan

Scanned2024-06-02T02:25:13+00:00
URL https://doujints.com/robots.txt
Domain IPs 104.21.52.211, 172.67.204.24, 2606:4700:3034::6815:34d3, 2606:4700:3036::ac43:cc18
Response IP 104.21.52.211
Found Yes
Hash 5ed17b7834841ca080be65e3455a1fa750b3a6f6665bc8f6b0074ed364ec4f24
SimHash 6b44dd148395

Groups

*

Rule Path
Allow /
Allow /manhwa
Allow /tag
Allow /tags
Allow /search
Allow /review-doujin
Disallow /ads
Disallow /cache
Disallow /oops
Disallow /core
Disallow /dmca
Disallow /api.php
Disallow /clear-cache.php
Disallow /sitemap.php

googlebot

Rule Path
Allow /
Allow /manhwa
Allow /tag
Allow /tags
Allow /search
Allow /review-doujin
Disallow /ads
Disallow /cache
Disallow /oops
Disallow /core
Disallow /dmca
Disallow /api.php
Disallow /clear-cache.php
Disallow /sitemap.php

googlebot-image

Rule Path
Allow /

Other Records

Field Value
sitemap https://doujints.com/sitemap.xml