hiromaaru.org
robots.txt

Robots Exclusion Standard data for hiromaaru.org

Resource Scan

Scan Details

Site Domain hiromaaru.org
Base Domain hiromaaru.org
Scan Status Ok
Last Scan2024-11-11T15:18:06+00:00
Next Scan 2024-12-11T15:18:06+00:00

Last Scan

Scanned2024-11-11T15:18:06+00:00
URL https://hiromaaru.org/robots.txt
Domain IPs 210.224.185.84
Response IP 210.224.185.84
Found Yes
Hash c06e7c55c753c7c60dad860d18b91a77ad3d19ada6ab448f6e4ed650d1335d3d
SimHash 2b198871e2b9

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ahrefsbot

Rule Path
Disallow /
Allow /wp-content/uploads/

blexbot

Rule Path
Disallow /
Allow /wp-content/uploads/

facebookexternalhit

Rule Path
Disallow /
Allow /wp-content/uploads/

Other Records

Field Value
crawl-delay 1

grapeshotcrawler

Rule Path
Disallow /
Allow /wp-content/uploads/

linespider

Rule Path
Disallow /
Allow /wp-content/uploads/

Other Records

Field Value
crawl-delay 1

linguee

Rule Path
Disallow /
Allow /wp-content/uploads/

mj12bot

Rule Path
Disallow /
Allow /wp-content/uploads/

Other Records

Field Value
crawl-delay 5

mappy

Rule Path
Disallow /
Allow /wp-content/uploads/

megaindex

Rule Path
Disallow /
Allow /wp-content/uploads/

smtbot

Rule Path
Disallow /
Allow /wp-content/uploads/

semrushbot

Rule Path
Disallow /
Allow /wp-content/uploads/

bidswitchbot

Rule Path
Disallow /
Allow /wp-content/uploads/

integralads

Rule Path
Disallow /
Allow /wp-content/uploads/

jet-bot

Rule Path
Disallow /
Allow /wp-content/uploads/

ltx71

Rule Path
Disallow /
Allow /wp-content/uploads/

proximic

Rule Path
Disallow /
Allow /wp-content/uploads/

trendictionbot

Rule Path
Disallow /
Allow /wp-content/uploads/

*

Rule Path
Disallow /wordpress/wp-admin/