rairizky.my.id
robots.txt

Robots Exclusion Standard data for rairizky.my.id

Resource Scan

Scan Details

Site Domain rairizky.my.id
Base Domain rairizky.my.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-03-27T02:05:25+00:00
Next Scan 2025-06-25T02:05:25+00:00

Last Successful Scan

Scanned2024-11-04T23:22:12+00:00
URL https://rairizky.my.id/robots.txt
Domain IPs 104.21.15.203, 172.67.163.245, 2606:4700:3035::ac43:a3f5, 2606:4700:3037::6815:fcb
Response IP 172.67.163.245
Found Yes
Hash d4733b4d6fed6e7b9d92a1edd92bb846d7ed3a62a8a1a6659b06fc603453954c
SimHash 905c9022a09b

Groups

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

friendly_crawler

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /