mainnews.kr
robots.txt

Robots Exclusion Standard data for mainnews.kr

Resource Scan

Scan Details

Site Domain mainnews.kr
Base Domain mainnews.kr
Scan Status Ok
Last Scan2024-11-11T00:42:30+00:00
Next Scan 2024-11-18T00:42:30+00:00

Last Scan

Scanned2024-11-11T00:42:30+00:00
URL https://mainnews.kr/robots.txt
Domain IPs 52.78.61.202
Response IP 52.78.61.202
Found Yes
Hash a7604df147fb4a5e5eaeb7dd4695cc681bd6310636a63939e895c3077bdddb84
SimHash 657cd8e0e353

Groups

*

Rule Path
Disallow /_template
Disallow /_compile

Other Records

Field Value
crawl-delay 5

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /