38jiejie.com
robots.txt

Robots Exclusion Standard data for 38jiejie.com

Resource Scan

Scan Details

Site Domain 38jiejie.com
Base Domain 38jiejie.com
Scan Status Ok
Last Scan2024-11-20T06:58:18+00:00
Next Scan 2024-11-27T06:58:18+00:00

Last Scan

Scanned2024-11-20T06:58:18+00:00
URL https://38jiejie.com/robots.txt
Domain IPs 104.21.38.19, 172.67.218.5, 2606:4700:3032::6815:2613, 2606:4700:3034::ac43:da05
Response IP 104.21.38.19
Found Yes
Hash f8f225f091588c11fb1a6e03daeed2143549929d1ed290965e53219a7255288a
SimHash 4084d863a619

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /?s=
Disallow /search/

blexbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

voltron

Rule Path
Disallow /

yandex

Rule Path
Disallow /

obot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

fetcher

Rule Path
Disallow /

cfnetwork

Rule Path
Disallow /

dalvik

Rule Path
Disallow /

Other Records

Field Value
sitemap https://38jiejie.com/sitemap.xml
sitemap https://38jiejie.com/news-sitemap.xml
sitemap https://38jiejie.com/sitemap-1.xml
sitemap https://38jiejie.com/sitemap-2.xml