semelia.com
robots.txt

Robots Exclusion Standard data for semelia.com

Resource Scan

Scan Details

Site Domain semelia.com
Base Domain semelia.com
Scan Status Ok
Last Scan2024-10-30T17:29:50+00:00
Next Scan 2024-11-29T17:29:50+00:00

Last Scan

Scanned2024-10-30T17:29:50+00:00
URL https://semelia.com/robots.txt
Redirect https://www.semelia.com/robots.txt
Redirect Domain www.semelia.com
Redirect Base semelia.com
Domain IPs 208.98.35.79
Redirect IPs 208.98.35.79
Response IP 208.98.35.79
Found Yes
Hash 0e1bf5da3ab58450a274a545d412aeabdac861c23fadb04b05a5710b6813d606
SimHash b1065912cb53

Groups

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

yisouspider
petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.semelia.com/sitemap.xml

Warnings

  • 1 invalid line.