Log In Sign Up

viciebsk.cc
robots.txt

Robots Exclusion Standard data for viciebsk.cc

Resource Scan

Scan Details

Site Domain viciebsk.cc
Base Domain viciebsk.cc
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-07T14:05:20+00:00
Next Scan 2026-02-05T14:05:20+00:00

Last Successful Scan

Scanned2025-01-11T15:55:20+00:00
URL https://viciebsk.cc/robots.txt
Domain IPs 104.21.45.140, 172.67.215.47, 2606:4700:3033::ac43:d72f, 2606:4700:3035::6815:2d8c
Response IP 172.67.215.47
Found Yes
Hash 25f6225571ce4b408379edf95e5320ce603d4180e9dc0087237bd42e73329249
SimHash 412cc5e06aaa

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 180

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 180

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 180

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 180

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 180

friendly-spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 180

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 90
Back to top

Other Records

Field Value
sitemap https://viciebsk.cc/sitemap.xml
sitemap https://viciebsk.cc/google-news-sitemap.xml
Back to top

Warnings

  • `er-agent` is not a known field.
  • `host` is not a known field.
Back to top