apogeeweb.net
robots.txt

Robots Exclusion Standard data for apogeeweb.net

Resource Scan

Scan Details

Site Domain apogeeweb.net
Base Domain apogeeweb.net
Scan Status Ok
Last Scan2024-11-14T06:06:05+00:00
Next Scan 2024-12-14T06:06:05+00:00

Last Scan

Scanned2024-11-14T06:06:05+00:00
URL https://apogeeweb.net/robots.txt
Redirect https://www.apogeeweb.net/robots.txt
Redirect Domain www.apogeeweb.net
Redirect Base apogeeweb.net
Domain IPs 104.26.0.58, 104.26.1.58, 172.67.75.66, 2606:4700:20::681a:13a, 2606:4700:20::681a:3a, 2606:4700:20::ac43:4b42
Redirect IPs 104.26.0.58, 104.26.1.58, 172.67.75.66, 2606:4700:20::681a:13a, 2606:4700:20::681a:3a, 2606:4700:20::ac43:4b42
Response IP 172.67.75.66
Found Yes
Hash b124fccbdc72b44764b733f284a51a52ccaff202b282f63b160cc212118526e8
SimHash 9cff9a00c7a6

Groups

*

Rule Path
Disallow /Service/Report.aspx
Disallow /admin/
Disallow /Shop/
Disallow /Member/data/
Disallow /Attributes/
Disallow /Attributes-Product/
Disallow /Product/mfg/index.aspx?mfg=*
Disallow /Search/index.aspx?CateID=*
Disallow /Search/index.aspx?CateID=*&vPage=*
Disallow /search/*?vvPage=*
Disallow /Home.aspx/
Disallow /login/*
Disallow /register/*
Disallow /stock/*

bubing

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

naver

Rule Path
Disallow /

daum bot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

majestic seo

Rule Path
Disallow /

searchmetrics

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

sitebulb

Rule Path
Disallow /

ravencrawler

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

ninjabot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.apogeeweb.net/SiteMap/sitemap.xml

Warnings

  • 1 invalid line.