qi-gong.me
robots.txt

Robots Exclusion Standard data for qi-gong.me

Resource Scan

Scan Details

Site Domain qi-gong.me
Base Domain qi-gong.me
Scan Status Ok
Last Scan2024-11-11T14:10:10+00:00
Next Scan 2024-11-18T14:10:10+00:00

Last Scan

Scanned2024-11-11T14:10:10+00:00
URL https://qi-gong.me/robots.txt
Redirect https://www.qi-gong.me/robots.txt
Redirect Domain www.qi-gong.me
Redirect Base qi-gong.me
Domain IPs 104.26.10.78, 104.26.11.78, 172.67.74.18, 2606:4700:20::681a:a4e, 2606:4700:20::681a:b4e, 2606:4700:20::ac43:4a12
Redirect IPs 104.26.10.78, 104.26.11.78, 172.67.74.18, 2606:4700:20::681a:a4e, 2606:4700:20::681a:b4e, 2606:4700:20::ac43:4a12
Response IP 172.67.74.18
Found Yes
Hash 71dbfd2d25c088ed4c986637ad6d7086c81758d7ea9450a6216c3a1d9226624b
SimHash f47e592ac6e3

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Allow /
Disallow /cdn-cgi/
Disallow /wp-admin/
Disallow /author/
Disallow /wp-login.php
Disallow /cgi-bin/
Disallow /index.php
Disallow /xmlrpc.php
Disallow /*/comment-page-*
Disallow /*?replytocom=*
Disallow /*?variant=*
Disallow /*/trackback/
Disallow /*/feed/
Disallow /*wpmp_switcher%3D*
Disallow /?p=*
Disallow /page/
Disallow /wp-content/plugins/wp-postviews-plus/
Disallow /wp-content/plugins/down-as-pdf/cache/
Disallow *.html/$
Disallow *000$
Disallow *variant%3Dzh-tw$
Disallow /*?__shortid__=*
Disallow /feed/
Disallow */feed/
Disallow */trackback/
Disallow /*/page/
Allow /wp-content/uploads

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow /

spiderling

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yeti

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

wsearch

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

docomo

Rule Path
Disallow /

discobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

blexbot

Rule Path
Disallow /