Log In Sign Up

rusxxx.best
robots.txt

Robots Exclusion Standard data for rusxxx.best

Resource Scan

Scan Details

Site Domain rusxxx.best
Base Domain rusxxx.best
Scan Status Ok
Last Scan2024-05-28T13:59:27+00:00
Next Scan 2024-06-27T13:59:27+00:00

Last Scan

Scanned2024-05-28T13:59:27+00:00
URL https://rusxxx.best/robots.txt
Domain IPs 104.21.43.15, 172.67.215.215, 2606:4700:3036::ac43:d7d7, 2606:4700:3037::6815:2b0f
Response IP 172.67.215.215
Found Yes
Hash f6a0a4786bacf39561459125d02777f92ddcbef834ac26abd824d6d043988ff0
SimHash 634d1c014221

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin
Disallow /*?ref=*
Disallow /abuse.php
Disallow /contacts.php

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://rusxxx.best/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top