firstgear.co.kr
robots.txt

Robots Exclusion Standard data for firstgear.co.kr

Resource Scan

Scan Details

Site Domain firstgear.co.kr
Base Domain firstgear.co.kr
Scan Status Ok
Last Scan2025-04-21T14:01:19+00:00
Next Scan 2025-04-28T14:01:19+00:00

Last Scan

Scanned2025-04-21T14:01:19+00:00
URL https://firstgear.co.kr/robots.txt
Redirect https://www.firstgear.co.kr/robots.txt
Redirect Domain www.firstgear.co.kr
Redirect Base firstgear.co.kr
Domain IPs 104.21.30.168, 172.67.173.65, 2606:4700:3036::6815:1ea8, 2606:4700:3036::ac43:ad41
Redirect IPs 104.21.30.168, 172.67.173.65, 2606:4700:3036::6815:1ea8, 2606:4700:3036::ac43:ad41
Response IP 104.21.30.168
Found Yes
Hash 726ce4eb96b393749af48949ff37285512373fd51bfd02c851a202bda7a5face
SimHash 1b1f4ce07319

Groups

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

*

Rule Path
Disallow /ajax/

Other Records

Field Value
crawl-delay 5