autoc-one.jp
robots.txt

Robots Exclusion Standard data for autoc-one.jp

Resource Scan

Scan Details

Site Domain autoc-one.jp
Base Domain autoc-one.jp
Scan Status Ok
Last Scan2024-11-09T10:20:41+00:00
Next Scan 2024-11-16T10:20:41+00:00

Last Scan

Scanned2024-11-09T10:20:41+00:00
URL https://autoc-one.jp/robots.txt
Domain IPs 23.215.7.12, 23.215.7.20, 2600:1413:b000:1b::17d7:70c, 2600:1413:b000:1b::17d7:714
Response IP 23.215.7.12
Found Yes
Hash 147106a191be2a1bb24da31b2cea68115f900052ce1617540546c757c6461829
SimHash 685bc812e459

Groups

*

Rule Path
Allow /
Disallow /used/searchv2/*makerFullCodes*
Disallow /used/searchv2/*modelFullCodes*
Disallow /used/searchv2/*grades*
Disallow /used/searchv2/*prefecture*
Disallow /used/searchv2/*cities*
Disallow /used/searchv2/*year*
Disallow /used/searchv2/*price1*
Disallow /used/searchv2/*price2*
Disallow /used/searchv2/*distance*
Disallow /used/searchv2/*carTypes*
Disallow /used/searchv2/*equipments*
Disallow /used/searchv2/*safetyPerformances*
Disallow /used/searchv2/*environmentWelfares*
Disallow /used/searchv2/*bodyType*
Disallow /used/searchv2/*interiors*
Disallow /used/searchv2/*exteriors*
Disallow /used/searchv2/*colors*
Disallow /used/searchv2/*etcs*
Disallow /used/searchv2/*supercharger*
Disallow /used/searchv2/*engine*
Disallow /used/searchv2/*drive*
Disallow /used/searchv2/*handle*
Disallow /used/searchv2/*doorNumber*
Disallow /used/searchv2/*slideDoor*
Disallow /used/searchv2/*transMission*
Disallow /used/searchv2/*capacity*
Disallow /used/searchv2/*navi*
Disallow /used/searchv2/*audio*
Disallow /used/searchv2/*warranty*
Disallow /ullo/auction_information/
Disallow /shop/help/law/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://autoc-one.jp/sitemap_xml/sitemap_index.xml

Comments

  • used USED-459 Block specific parameters
  • AUCTION-258
  • CARPARTS-154
  • 240815 bingbot 対策
  • 240925 Crawl-Delayを1に変更
  • 240930 Crawl-Delayを2に変更