melodi99jr.com
robots.txt

Robots Exclusion Standard data for melodi99jr.com

Resource Scan

Scan Details

Site Domain melodi99jr.com
Base Domain melodi99jr.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2024-09-26T04:42:01+00:00
Next Scan 2024-12-25T04:42:01+00:00

Last Successful Scan

Scanned2024-02-07T00:52:32+00:00
URL https://melodi99jr.com/robots.txt
Redirect https://melodi99paten.com/robots.txt
Redirect Domain melodi99paten.com
Redirect Base melodi99paten.com
Domain IPs 104.21.28.96, 172.67.145.81, 2606:4700:3036::6815:1c60, 2606:4700:3037::ac43:9151
Redirect IPs 104.21.23.48, 172.67.209.49, 2606:4700:3033::ac43:d131, 2606:4700:3036::6815:1730
Response IP 172.67.209.49
Found Yes
Hash e088d8140e8ea9aa64897b2dd63d6ee98465bf050b619e84d80a5c949e7b47ec
SimHash 6141c38555d7

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://melodi99paten.com/sitemap.xml

Warnings

  • 1 invalid line.