keirin-station.com
robots.txt

Robots Exclusion Standard data for keirin-station.com

Resource Scan

Scan Details

Site Domain keirin-station.com
Base Domain keirin-station.com
Scan Status Ok
Last Scan2024-06-14T13:55:25+00:00
Next Scan 2024-06-21T13:55:25+00:00

Last Scan

Scanned2024-06-14T13:55:25+00:00
URL https://keirin-station.com/robots.txt
Domain IPs 103.6.62.235
Response IP 103.6.62.235
Found Yes
Hash bc7b8d0522e7559c142c69a53c82c0517f0e9b219b97316feb211c15ff62e8e5
SimHash 4a0dcca07e10

Groups

*

Rule Path
Disallow /maintenance.html
Disallow /periodic_maintenance.html
Disallow /restriction.html
Disallow /system/
Disallow /comment/
Disallow /blog/
Disallow /jump/out/

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://keirin-station.com/sitemap.xml