alfarieza.my.id
robots.txt

Robots Exclusion Standard data for alfarieza.my.id

Resource Scan

Scan Details

Site Domain alfarieza.my.id
Base Domain alfarieza.my.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-13T07:24:10+00:00
Next Scan 2024-12-12T07:24:10+00:00

Last Successful Scan

Scanned2023-05-20T11:48:52+00:00
URL https://alfarieza.my.id/robots.txt
Redirect https://www.alfarieza.my.id/robots.txt
Redirect Domain www.alfarieza.my.id
Redirect Base alfarieza.my.id
Domain IPs 13.250.129.152, 2406:da18:9d0:143e:8e74:1b1a:98b9:2813, 2406:da18:9d0:143f:29e7:ae24:cfea:e9bb, 54.151.156.30
Redirect IPs 104.21.84.43, 172.67.186.24, 2606:4700:3034::6815:542b, 2606:4700:3037::ac43:ba18
Response IP 172.67.186.24
Found Yes
Hash ef0b883d68892121a941486b71f7c5f1dca8cfd32cdd20ca3ed6eb095df8b9fa
SimHash e816d3115591

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

googlebot
googlebot-image
ia_archiver
linkedinbot
pinterestbot
seznambot
slurp
teoma
telegrambot
msnbot
naverbot
applebot
bingbot
discordbot
duckduckbot
yeti
twitterbot
yandex

Rule Path
Allow /

baiduspider
sogouspider
yisouspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.alfarieza.my.id/sitemap.xml
sitemap https://www.alfarieza.my.id/atom.xml?redirect=false&start-index=1&max-results=500

Warnings

  • 1 invalid line.