Log In Sign Up

rubabr.com
robots.txt

Robots Exclusion Standard data for rubabr.com

Resource Scan

Scan Details

Site Domain rubabr.com
Base Domain rubabr.com
Scan Status Ok
Last Scan2025-04-17T06:11:12+00:00
Next Scan 2025-04-24T06:11:12+00:00

Last Scan

Scanned2025-04-17T06:11:12+00:00
URL https://rubabr.com/robots.txt
Domain IPs 104.21.44.47, 172.67.195.20, 2606:4700:3030::ac43:c314, 2606:4700:3031::6815:2c2f
Response IP 104.21.44.47
Found Yes
Hash c794d267a4946a44a559cce650cc33e939b753b7a627bed166cd02b4417396db
SimHash 6559dc614791

Groups

*

Rule Path
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 2
Back to top

Other Records

Field Value
sitemap http://rubabr.com/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top