smogus.cc
robots.txt

Robots Exclusion Standard data for smogus.cc

Resource Scan

Scan Details

Site Domain smogus.cc
Base Domain smogus.cc
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-27T13:12:42+00:00
Next Scan 2025-11-26T13:12:42+00:00

Last Successful Scan

Scanned2025-07-07T03:15:11+00:00
URL https://www.smogus.cc/robots.txt
Redirect https://spb.smogus.me/robots.txt
Redirect Domain spb.smogus.me
Redirect Base smogus.me
Domain IPs 104.21.24.53, 172.67.217.27, 2606:4700:3033::6815:1835, 2606:4700:3036::ac43:d91b
Redirect IPs 185.75.90.67
Response IP 185.75.90.67
Found Yes
Hash 9f27a63a1f6fd90bc2a70c83668bac1c7e732a7bc36c3b15577a102ed6a010ec
SimHash 0d51fee38322

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /*add-to-cart%3D*
Disallow /wp-admin
Disallow /wp-includes
Allow /wp-content/themes
Allow /wp-content/plugins
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /*?*
Disallow /terms
Disallow /cdn-cgi/l/email-protection
Disallow /my-account/
Disallow /privacy/
Disallow /checkout/order-received/*

yandex

Rule Path
Disallow /cgi-bin
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /*add-to-cart%3D*
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /wp-content/plugins
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /author/lenazay4ik/
Disallow /terms
Disallow /cdn-cgi/l/email-protection
Disallow /my-account/
Disallow /privacy/
Disallow /checkout/order-received/*

Other Records

Field Value
crawl-delay 4

Other Records

Field Value
sitemap https://spb.smogus.me/sitemap.xml
sitemap https://spb.smogus.me/sitemap.xml

Comments

  • Disallow: /wp-content/cache
  • Host: https://spb.smogus.me/
  • Disallow: /*?*

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.