discountreactor.org
robots.txt

Robots Exclusion Standard data for discountreactor.org

Resource Scan

Scan Details

Site Domain discountreactor.org
Base Domain discountreactor.org
Scan Status Ok
Last Scan2026-03-14T20:23:23+00:00
Next Scan 2026-03-21T20:23:23+00:00

Last Scan

Scanned2026-03-14T20:23:23+00:00
URL https://discountreactor.org/robots.txt
Domain IPs 104.21.38.224, 172.67.140.58, 2606:4700:3033::6815:26e0, 2606:4700:3036::ac43:8c3a
Response IP 172.67.140.58
Found Yes
Hash df6b9eaa919e41ded496327ccbd362358d8ffa57ba3e4dada673a2b9b692c223
SimHash 185dc0d3de10

Groups

adsbot-google
adsbot-google-mobile-apps

Rule Path
Allow /

baiduspider*
sogou*

Rule Path
Disallow /

yandex

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot
amazonbot
blexbot
ccbot
cliqzbot
dotbot
ia_archiver
mbcrawler
mj12bot
petalbot
photon
scrapy
semrushbot
seznambot
linguee
similarweb
snapchatads
facebookexternalhit
meta-externalagent
crawler
barkrowler
blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

Rule Path
Allow /*.html

Other Records

Field Value
sitemap /post-sitemap.xml