css-live.ru
robots.txt

Robots Exclusion Standard data for css-live.ru

Resource Scan

Scan Details

Site Domain css-live.ru
Base Domain css-live.ru
Scan Status Ok
Last Scan2025-09-26T02:25:27+00:00
Next Scan 2025-10-26T02:25:27+00:00

Last Scan

Scanned2025-09-26T02:25:27+00:00
URL http://css-live.ru/robots.txt
Domain IPs 2a03:6f00:1::5c35:60c1, 92.53.96.193
Response IP 92.53.96.193
Found Yes
Hash d64ccf44f4b423528a53681dbd53f6c6432247a55528d3e27f3afefc3d96af16
SimHash 4e5cdc71e600

Groups

*

Rule Path
Allow /
Disallow /wp-admin
Disallow /Primer
Disallow /Portfolio
Disallow /search
Disallow /page

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 18

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap http://css-live.ru/sitemap.xml.gz

Warnings

  • `host` is not a known field.