koreansex.kr
robots.txt

Robots Exclusion Standard data for koreansex.kr

Resource Scan

Scan Details

Site Domain koreansex.kr
Base Domain koreansex.kr
Scan Status Ok
Last Scan2024-08-31T04:03:07+00:00
Next Scan 2024-09-30T04:03:07+00:00

Last Scan

Scanned2024-08-31T04:03:07+00:00
URL https://koreansex.kr/robots.txt
Redirect https://www.koreansex.kr/robots.txt
Redirect Domain www.koreansex.kr
Redirect Base koreansex.kr
Domain IPs 104.131.187.95, 159.89.154.79
Redirect IPs 23.215.7.28, 23.215.7.5, 2600:1413:b000:1b::17d7:705, 2600:1413:b000:1b::17d7:71c
Response IP 23.32.29.16
Found Yes
Hash d7a1c593d2c40522f67dc16756d8d2b67ad760b9ecf2642edcdc3dfae7a9ff39
SimHash 78144860c953

Groups

ia_archiver

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

surveybot_ignoreip

Rule Path
Disallow /

*

Rule Path
Disallow /landing/mta
Disallow /t/tr

Other Records

Field Value
sitemap https://www.koreansex.kr/sitemap.xml