sigidot5.net
robots.txt

Robots Exclusion Standard data for sigidot5.net

Resource Scan

Scan Details

Site Domain sigidot5.net
Base Domain sigidot5.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-16T14:20:03+00:00
Next Scan 2025-11-14T14:20:03+00:00

Last Successful Scan

Scanned2023-04-30T10:47:17+00:00
URL http://sigidot5.net/robots.txt
Redirect https://sigidot6.net/robots.txt
Redirect Domain sigidot6.net
Redirect Base sigidot6.net
Domain IPs 94.23.72.147
Redirect IPs 104.21.20.9, 172.67.190.193, 2606:4700:3033::ac43:bec1, 2606:4700:3036::6815:1409
Response IP 104.21.20.9
Found Yes
Hash b0e1c5391fec52234b951e776c5f3e08590c97266416cff570f241c8d899c077
SimHash 4dd15853d632

Groups

*

Rule Path
Disallow /my/
Disallow /checkout/
Disallow /search/?query=
Disallow /compare/
Disallow /tag/
Disallow /cart/
Disallow /signup/
Disallow /login/
Disallow /forgotpassword/
Disallow /webasyst/
Disallow *?page=*
Disallow /newsite/shop/my/
Disallow /newsite/shop/checkout/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://sigidot6.net/sitemap.xml

Comments

  • wa shop *
  • wa shop

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.