asiantrader.biz
robots.txt

Robots Exclusion Standard data for asiantrader.biz

Resource Scan

Scan Details

Site Domain asiantrader.biz
Base Domain asiantrader.biz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-14T07:42:01+00:00
Next Scan 2024-11-28T07:42:01+00:00

Last Successful Scan

Scanned2024-10-30T07:41:17+00:00
URL https://asiantrader.biz/robots.txt
Redirect https://www.asiantrader.biz/robots.txt
Redirect Domain www.asiantrader.biz
Redirect Base asiantrader.biz
Domain IPs 54.243.223.181, 54.243.223.182
Redirect IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91
Response IP 199.232.45.91
Found Yes
Hash f767d5adc606d0b115a704e37f2a30a09e4ebdf53dc76df23e956286505c903e
SimHash 804538504811

Groups

*

Rule Path
Disallow /core/*
Disallow /r/*
Disallow /mnt/*

Other Records

Field Value
sitemap https://www.asiantrader.biz/sitemap.xml
sitemap https://www.asiantrader.biz/sitemap_news.xml
sitemap https://www.asiantrader.biz/sitemap_sections.xml
sitemap https://www.asiantrader.biz/sitemap_tags.xml
sitemap https://www.asiantrader.biz/sitemap_video.xml