bizpacreview.com
robots.txt

Robots Exclusion Standard data for bizpacreview.com

Resource Scan

Scan Details

Site Domain bizpacreview.com
Base Domain bizpacreview.com
Scan Status Ok
Last Scan2024-06-21T03:37:16+00:00
Next Scan 2024-06-28T03:37:16+00:00

Last Scan

Scanned2024-06-21T03:37:16+00:00
URL https://bizpacreview.com/robots.txt
Domain IPs 104.26.10.54, 104.26.11.54, 172.67.75.108, 2606:4700:20::681a:a36, 2606:4700:20::681a:b36, 2606:4700:20::ac43:4b6c
Response IP 104.26.11.54
Found Yes
Hash ccc29c44ca6eee666e92b92619f5916a97c72ac5765c13419acc3db665c40d45
SimHash 7c135181e8b1

Groups

*

Rule Path
Disallow /?
Disallow /?*
Disallow /?author=*
Disallow /?s=
Disallow /*?count=*
Disallow /*?filter=
Disallow /*?p=*
Disallow /*?preview=*
Disallow /*?s=*
Disallow /*%26count%3D*
Disallow /*%26filter%3D
Disallow /*%26p%3D*
Disallow /*%26preview%3D*
Disallow /*%26s%3D*
Disallow /*add_to_wishlist%3D*
Disallow /*add-to-cart%3D*
Disallow /*cart/*
Disallow /*checkout/*
Disallow /*my-account/*
Disallow /*myaccount/*
Disallow /*orderby%3Ddate
Disallow /*orderby%3Ddesc
Disallow /*orderby%3Dpopularity
Disallow /*orderby%3Dprice
Disallow /*orderby%3Dprice-desc
Disallow /*orderby%3Drating
Disallow /*orderby%3Dtitle
Disallow /*paged%3D%26count%3D*
Disallow /*replytocom%3D*
Disallow /*wc-ajax%3Dadd_to_cart
Disallow /*wc-ajax%3Dremove_from_cart
Disallow /*wp-comments*
Disallow /*wp-feed*
Disallow /*wp-trackback*
Disallow /cart/*
Disallow /checkout/*
Disallow /members/
Disallow /my-account/*
Disallow /search/
Disallow /wp-admin/
Disallow /wp-content/uploads/*
Disallow /wp-login.php
Allow /wp-admin/admin-ajax.php
Allow /*/plugins/*

Other Records

Field Value
crawl-delay 30

parler
parlerstaging
bingbot
msnbot
msnbot-media

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

twitterbot
facebookexternalhit
facebot
googlebot

Rule Path
Allow *

ahrefsbot
ahrefssiteaudit
baiduspider
baiduspider-ads
baiduspider-cpro
baiduspider-favo
baiduspider-image
baiduspider-news
baiduspider-video
coccoc
dataforseobot
genieo
hoaxybot
laserlikebot
mail.ru
mj12bot
petalbot
qwantify
rogerbot
screaming frog seo spider
semrushbot
semrushbot-ba
semrushbot-bm
semrushbot-ct
semrushbot-sa
semrushbot-si
semrushbot-swa
seoscanners.net
seznambot
sogou blog
sogou inst spider
sogou news spider
sogou orion spider
sogou spider
sogou spider2
sogou web spider
spbot
splitsignalbot
storygizebot
yandex
yandexbot
yandeximages
yandexmobilebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bizpacreview.com/sitemap_index.xml