webronza.asahi.com
robots.txt

Robots Exclusion Standard data for webronza.asahi.com

Resource Scan

Scan Details

Site Domain webronza.asahi.com
Base Domain asahi.com
Scan Status Ok
Last Scan2024-05-14T01:15:26+00:00
Next Scan 2024-06-13T01:15:26+00:00

Last Scan

Scanned2024-05-14T01:15:26+00:00
URL https://webronza.asahi.com/robots.txt
Domain IPs 210.152.124.57
Response IP 210.152.124.57
Found Yes
Hash 0d80882a3e760bfcc5bf8484427de62435ceb4e0edacf3ec2e1aa6b885e24394
SimHash 6417c985e1b4

Groups

googlebot

Rule Path
Disallow /*?iref*

slurp

Rule Path
Disallow /*?iref*

Other Records

Field Value
crawl-delay 0.1

msnbot

Rule Path
Disallow /*?iref*

Other Records

Field Value
crawl-delay 3

bingbot

Rule Path
Disallow /*?iref*

Other Records

Field Value
crawl-delay 3

*

Rule Path
Disallow /*?iref*

Other Records

Field Value
crawl-delay 3