lim4dpaus.com
robots.txt

Robots Exclusion Standard data for lim4dpaus.com

Resource Scan

Scan Details

Site Domain lim4dpaus.com
Base Domain lim4dpaus.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2/23/2025, 1:02:14 PM
Next Scan 4/24/2025, 1:02:14 PM

Last Successful Scan

Scanned12/3/2024, 11:37:56 AM
URL https://lim4dpaus.com/robots.txt
Redirect https://lim4djaya.com/robots.txt
Redirect Domain lim4djaya.com
Redirect Base lim4djaya.com
Domain IPs 104.21.94.144, 172.67.136.220, 2606:4700:3032::ac43:88dc, 2606:4700:3033::6815:5e90
Redirect IPs 104.21.65.126, 172.67.145.107, 2606:4700:3030::ac43:916b, 2606:4700:3037::6815:417e
Response IP 172.67.145.107
Found Yes
Hash faf914b06ac9f587ea408f8f979e090bf05b0f5f17068a577aea9029e580ff4f
SimHash 6159d38557d7

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://lim4djaya.com/sitemap.xml

Warnings

  • 1 invalid line.