lwiki.net
robots.txt

Robots Exclusion Standard data for lwiki.net

Resource Scan

Scan Details

Site Domain lwiki.net
Base Domain lwiki.net
Scan Status Ok
Last Scan2024-09-27T06:22:04+00:00
Next Scan 2024-10-04T06:22:04+00:00

Last Scan

Scanned2024-09-27T06:22:04+00:00
URL https://lwiki.net/robots.txt
Domain IPs 13.35.18.106, 13.35.18.107, 13.35.18.125, 13.35.18.18, 2600:9000:20c7:3400:10:186e:dac0:93a1, 2600:9000:20c7:6400:10:186e:dac0:93a1, 2600:9000:20c7:7400:10:186e:dac0:93a1, 2600:9000:20c7:9e00:10:186e:dac0:93a1, 2600:9000:20c7:a800:10:186e:dac0:93a1, 2600:9000:20c7:c400:10:186e:dac0:93a1, 2600:9000:20c7:ca00:10:186e:dac0:93a1, 2600:9000:20c7:fa00:10:186e:dac0:93a1
Response IP 13.35.18.125
Found Yes
Hash 0530edfb32b9878b9614a07753527c6df31ef5d10c8b0718ed5dadb9781b5678
SimHash c95d9c603c98

Groups

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

*

Rule Path
Allow /w/api.php?action=mobileview&
Allow /w/load.php?
Allow /w/resources/assets
Allow /api/rest_v1/?doc
Disallow /w/
Disallow /api/
Disallow /wiki/Special%3A
Disallow /wiki/%ED%8A%B9%EC%88%98%3A
Disallow /wiki/%ED%8A%B9%EC%88%98%EA%B8%B0%EB%8A%A5%3A
Disallow /wiki/%ED%8A%B9%3A
Disallow /pwabuilder-sw.js

adsbot-google

Rule Path
Allow /w/api.php?action=mobileview&
Allow /w/load.php?
Disallow /w/
Disallow /api/
Disallow /wiki/%ED%8C%8C%EC%9D%BC%3A

googlebot

Rule Path
Allow /w/index.php?title=%ED%8A%B9%EC%88%98%3ASearch&search=
Allow /w/index.php?title=%ED%8A%B9%EC%88%98%3A%EA%B2%80%EC%83%89&search=

Other Records

Field Value
sitemap https://www.lwiki.net/sitemaplw/sitemap-index-lwiki.xml