luntai.net.cn
robots.txt

Robots Exclusion Standard data for luntai.net.cn

Resource Scan

Scan Details

Site Domain luntai.net.cn
Base Domain luntai.net.cn
Scan Status Ok
Last Scan2025-10-28T00:38:15+00:00
Next Scan 2025-11-04T00:38:15+00:00

Last Scan

Scanned2025-10-28T00:38:15+00:00
URL https://luntai.net.cn/robots.txt
Redirect https://www.luntai.net.cn/robots.txt
Redirect Domain www.luntai.net.cn
Redirect Base luntai.net.cn
Domain IPs 104.21.51.53, 172.67.221.165, 2606:4700:3033::ac43:dda5, 2606:4700:3034::6815:3335
Redirect IPs 104.21.51.53, 172.67.221.165, 2606:4700:3033::ac43:dda5, 2606:4700:3034::6815:3335
Response IP 104.21.51.53
Found Yes
Hash 17fcfe09655996f34e8b57001b278d16deb93ba91eefb6c8ead142988fb6fa59
SimHash 6d350f36d603

Groups

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

facebookexternalhit/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

facebookcatalog/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Allow /
Disallow /spring/
Disallow /api/
Disallow /admin/
Disallow /partner/
Disallow /cart
Disallow /redirect
Disallow /search
Disallow *?embedded=true
Disallow *redirect?url=
Disallow *?source=
Disallow *?cw=true

Other Records

Field Value
sitemap https://www.luntai.net.cn/sitemapindex.xml