weflix.wetown.kr
robots.txt

Robots Exclusion Standard data for weflix.wetown.kr

Resource Scan

Scan Details

Site Domain weflix.wetown.kr
Base Domain wetown.kr
Scan Status Ok
Last Scan2024-10-23T01:16:51+00:00
Next Scan 2024-11-22T01:16:51+00:00

Last Scan

Scanned2024-10-23T01:16:51+00:00
URL https://weflix.wetown.kr/robots.txt
Redirect https://wefilx.tistory.com/robots.txt
Redirect Domain wefilx.tistory.com
Redirect Base tistory.com
Domain IPs 104.21.11.221, 172.67.150.105, 2606:4700:3030::6815:bdd, 2606:4700:3035::ac43:9669
Redirect IPs 211.249.222.33
Response IP 211.249.222.33
Found Yes
Hash 0c3d44aebb32d151b7c9744b289b0c65bd32ccbd089948f2818c6ad30030fac2
SimHash 6581d8644ba0

Groups

*

Rule Path
Disallow /guestbook
Disallow /m/guestbook
Disallow /manage
Disallow /owner
Disallow /admin
Disallow /search
Disallow /m/search

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20