lireia.com
robots.txt
Robots Exclusion Standard data for lireia.com
Resource Scan
Scan Details
Site Domain | lireia.com |
Base Domain | lireia.com |
Scan Status | Ok |
Last Scan | 4/18/2025, 10:27:27 AM |
Next Scan | 4/25/2025, 10:27:27 AM |
Last Scan
Scanned | 4/18/2025, 10:27:27 AM |
URL | https://lireia.com/robots.txt |
Redirect | https://www.lireia.com/robots.txt |
Redirect Domain | www.lireia.com |
Redirect Base | lireia.com |
Domain IPs | 104.21.85.58, 172.67.202.189, 2606:4700:3035::ac43:cabd, 2606:4700:3036::6815:553a |
Redirect IPs | 104.21.85.58, 172.67.202.189, 2606:4700:3035::ac43:cabd, 2606:4700:3036::6815:553a |
Response IP | 104.21.85.58 |
Found | Yes |
Hash | 7bf5494ba3b94e2617c94619a5a5337240fcca2ba8d950332415739e1b9cbf23 |
SimHash | e99c5c50e3a1 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
crawl-delay | 360 |
googlebot
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Allow | /wp-includes/css/ |
Allow | /wp-includes/js/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
bingbot
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Allow | /wp-includes/css/ |
Allow | /wp-includes/js/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
semrushbot-sa
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Allow | /wp-includes/css/ |
Allow | /wp-includes/js/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
semrushbot-si
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Allow | /wp-includes/css/ |
Allow | /wp-includes/js/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
yahoo! slurp
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Allow | /wp-includes/css/ |
Allow | /wp-includes/js/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
ahrefsbot
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Allow | /wp-includes/css/ |
Allow | /wp-includes/js/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | http://www.lireia.com/sitemap.xml.gz |