detailtext-aucfan.com
robots.txt

Robots Exclusion Standard data for detailtext-aucfan.com

Resource Scan

Scan Details

Site Domain detailtext-aucfan.com
Base Domain detailtext-aucfan.com
Scan Status Ok
Last Scan2024-09-22T08:13:26+00:00
Next Scan 2024-09-29T08:13:26+00:00

Last Scan

Scanned2024-09-22T08:13:26+00:00
URL https://detailtext-aucfan.com/robots.txt
Domain IPs 52.195.241.249, 54.248.250.185
Response IP 52.195.241.249
Found Yes
Hash d9ee54ce29073614c585645255e5d1e32c08d0cb032d6d5bd50f7d6c748ebcd3
SimHash d3088a628fb3

Groups

*

Rule Path
Disallow /vote.cgi
Disallow /bbs/
Disallow /ext/
Disallow /move/
Disallow /query_link/
Disallow /ajax/
Disallow /inc/
Disallow /append/
Disallow /addparts/
Disallow /search/nativeAd*
Disallow /ad_cs?id=*
Disallow /amazon/
Disallow /search/possiblylist/
Disallow /c/*?
Disallow /assets/js/common/searchPagination.js
Disallow /aucview/getItemsComparisonData/?site=am*
Disallow /dyn/report/*
Disallow /bouncer/
Allow /addparts/category_chart/
Allow /addparts/getGraphDatasUnder50/*
Allow /addparts/kanren_*%26crawlAllow%3Dtrue

petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://aucfan.com/static/user/pro/product/sitemap.xml