Log In Sign Up

lwiki.net
robots.txt

Robots Exclusion Standard data for lwiki.net

Resource Scan

Scan Details

Site Domain lwiki.net
Base Domain lwiki.net
Scan Status Ok
Last Scan2024-11-01T06:43:29+00:00
Next Scan 2024-11-08T06:43:29+00:00

Last Scan

Scanned2024-11-01T06:43:29+00:00
URL https://lwiki.net/robots.txt
Domain IPs 13.35.210.109, 13.35.210.31, 13.35.210.32, 13.35.210.72, 2600:9000:2078:1600:10:186e:dac0:93a1, 2600:9000:2078:2a00:10:186e:dac0:93a1, 2600:9000:2078:3000:10:186e:dac0:93a1, 2600:9000:2078:7e00:10:186e:dac0:93a1, 2600:9000:2078:9000:10:186e:dac0:93a1, 2600:9000:2078:9800:10:186e:dac0:93a1, 2600:9000:2078:aa00:10:186e:dac0:93a1, 2600:9000:2078:ca00:10:186e:dac0:93a1
Response IP 13.35.210.32
Found Yes
Hash 0530edfb32b9878b9614a07753527c6df31ef5d10c8b0718ed5dadb9781b5678
SimHash c95d9c603c98

Groups

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

*

Rule Path
Allow /w/api.php?action=mobileview&
Allow /w/load.php?
Allow /w/resources/assets
Allow /api/rest_v1/?doc
Disallow /w/
Disallow /api/
Disallow /wiki/Special%3A
Disallow /wiki/%ED%8A%B9%EC%88%98%3A
Disallow /wiki/%ED%8A%B9%EC%88%98%EA%B8%B0%EB%8A%A5%3A
Disallow /wiki/%ED%8A%B9%3A
Disallow /pwabuilder-sw.js

adsbot-google

Rule Path
Allow /w/api.php?action=mobileview&
Allow /w/load.php?
Disallow /w/
Disallow /api/
Disallow /wiki/%ED%8C%8C%EC%9D%BC%3A

googlebot

Rule Path
Allow /w/index.php?title=%ED%8A%B9%EC%88%98%3ASearch&search=
Allow /w/index.php?title=%ED%8A%B9%EC%88%98%3A%EA%B2%80%EC%83%89&search=
Back to top

Other Records

Field Value
sitemap https://www.lwiki.net/sitemaplw/sitemap-index-lwiki.xml
Back to top