melodi99resmi.com
robots.txt

Robots Exclusion Standard data for melodi99resmi.com

Resource Scan

Scan Details

Site Domain melodi99resmi.com
Base Domain melodi99resmi.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2024-06-28T23:27:47+00:00
Next Scan 2024-07-05T23:27:47+00:00

Last Successful Scan

Scanned2024-05-28T23:27:22+00:00
URL https://melodi99resmi.com/robots.txt
Redirect https://melodi99musik.com/robots.txt
Redirect Domain melodi99musik.com
Redirect Base melodi99musik.com
Domain IPs 104.21.3.148, 172.67.130.213, 2606:4700:3031::6815:394, 2606:4700:3036::ac43:82d5
Redirect IPs 104.21.65.115, 172.67.190.21, 2606:4700:3032::6815:4173, 2606:4700:3035::ac43:be15
Response IP 104.21.65.115
Found Yes
Hash 5d7c1eb4ff3eb6221737e52b8cf47794bab615208c2a49cdd96cc6c0e3704617
SimHash 6541c30155d7

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://melodi99musik.com/sitemap.xml

Warnings

  • 1 invalid line.