ci-en.dlsite.com
robots.txt

Robots Exclusion Standard data for ci-en.dlsite.com

Resource Scan

Scan Details

Site Domain ci-en.dlsite.com
Base Domain dlsite.com
Scan Status Ok
Last Scan2024-05-31T16:42:44+00:00
Next Scan 2024-06-30T16:42:44+00:00

Last Scan

Scanned2024-05-31T16:42:44+00:00
URL https://ci-en.dlsite.com/robots.txt
Domain IPs 52.198.41.193, 54.65.79.171
Response IP 54.65.79.171
Found Yes
Hash 319f9203c2a888f00be0d7620fdb81f6df3dcfe7bff1e97b093e7fd9bebbe12a
SimHash 65145445c153

Groups

bingbot
gptbot
dataforseobot

Rule Path
Disallow /

*

Rule Path
Disallow /mypage
Disallow /mypage/
Disallow /api/

Other Records

Field Value
sitemap https://ci-en.net/sitemap