detailtext-aucfan.com
robots.txt
Robots Exclusion Standard data for detailtext-aucfan.com
Resource Scan
Scan Details
Site Domain | detailtext-aucfan.com |
Base Domain | detailtext-aucfan.com |
Scan Status | Ok |
Last Scan | 2024-09-22T08:13:26+00:00 |
Next Scan | 2024-09-29T08:13:26+00:00 |
Last Scan
Scanned | 2024-09-22T08:13:26+00:00 |
URL | https://detailtext-aucfan.com/robots.txt |
Domain IPs | 52.195.241.249, 54.248.250.185 |
Response IP | 52.195.241.249 |
Found | Yes |
Hash | d9ee54ce29073614c585645255e5d1e32c08d0cb032d6d5bd50f7d6c748ebcd3 |
SimHash | d3088a628fb3 |
Groups
*
Rule | Path |
---|---|
Disallow | /vote.cgi |
Disallow | /bbs/ |
Disallow | /ext/ |
Disallow | /move/ |
Disallow | /query_link/ |
Disallow | /ajax/ |
Disallow | /inc/ |
Disallow | /append/ |
Disallow | /addparts/ |
Disallow | /search/nativeAd* |
Disallow | /ad_cs?id=* |
Disallow | /amazon/ |
Disallow | /search/possiblylist/ |
Disallow | /c/*? |
Disallow | /assets/js/common/searchPagination.js |
Disallow | /aucview/getItemsComparisonData/?site=am* |
Disallow | /dyn/report/* |
Disallow | /bouncer/ |
Allow | /addparts/category_chart/ |
Allow | /addparts/getGraphDatasUnder50/* |
Allow | /addparts/kanren_*%26crawlAllow%3Dtrue |
Other Records
Field | Value |
---|---|
sitemap | https://aucfan.com/static/user/pro/product/sitemap.xml |