asiacomponents.net
robots.txt

Robots Exclusion Standard data for asiacomponents.net

Resource Scan

Scan Details

Site Domain asiacomponents.net
Base Domain asiacomponents.net
Scan Status Ok
Last Scan2024-09-08T18:00:25+00:00
Next Scan 2024-10-08T18:00:25+00:00

Last Scan

Scanned2024-09-08T18:00:25+00:00
URL https://asiacomponents.net/robots.txt
Domain IPs 172.66.40.252, 172.66.43.4, 2606:4700:3108::ac42:28fc, 2606:4700:3108::ac42:2b04
Response IP 172.66.40.252
Found Yes
Hash 6328bc873a4a8814458a8401ae74f7bee2f2c0526b92c53716f5068d7f09204f
SimHash 1ccf9a10c7a4

Groups

*

Rule Path
Disallow /Service/Report.aspx
Disallow /admin/
Disallow /Shop/
Disallow /Member/data/
Disallow /Attributes/
Disallow /Attributes-Product/
Disallow /Product/mfg/index.aspx?mfg=*
Disallow /Search/index.aspx?CateID=*
Disallow /Search/index.aspx?CateID=*&vPage=*
Disallow /search/*?vvPage=*
Disallow /Home.aspx/
Disallow /login/*
Disallow /register/*
Disallow /stock/*

bubing

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

naver

Rule Path
Disallow /

daum bot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

majestic seo

Rule Path
Disallow /

searchmetrics

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

sitebulb

Rule Path
Disallow /

ravencrawler

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

ninjabot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.asiacomponents.net/SiteMap/sitemap.xml

Warnings

  • 1 invalid line.