bitstarz.pro
robots.txt

Robots Exclusion Standard data for bitstarz.pro

Resource Scan

Scan Details

Site Domain bitstarz.pro
Base Domain bitstarz.pro
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-27T01:33:12+00:00
Next Scan 2025-11-25T01:33:12+00:00

Last Successful Scan

Scanned2025-04-07T00:21:26+00:00
URL https://bitstarz.pro/robots.txt
Domain IPs 5.45.85.20
Response IP 5.45.85.20
Found Yes
Hash f1b229952794d6f405daf97b395d36cc9d426488b8b24adc5394255604c04f8b
SimHash 59435915de5e

Groups

yandex

Rule Path
Allow *.js
Allow *.css
Allow *.png
Allow *.jpg
Allow /wp-content/themes/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /wp-json/
Disallow /cgi-bin/
Disallow /uncategorized/
Disallow /author/
Disallow */feed/
Disallow */trackback/
Disallow /go/
Disallow */amp/*
Disallow */resources.xml/
Disallow /?repeat=w3tc
Disallow /category/
Disallow /feed/turbopage/
Disallow /feed/turbopost/
Disallow /feed/turbopost/*
Disallow /payments/
Disallow /?p=*

googlebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bitstarz.pro/sitemap.xml