Log In Sign Up

finreg.sk
robots.txt

Robots Exclusion Standard data for finreg.sk

Resource Scan

Scan Details

Site Domain finreg.sk
Base Domain finreg.sk
Scan Status Ok
Last Scan2024-06-28T17:17:03+00:00
Next Scan 2024-07-05T17:17:03+00:00

Last Scan

Scanned2024-06-28T17:17:03+00:00
URL https://finreg.sk/robots.txt
Redirect https://www.finreg.sk/robots.txt
Redirect Domain www.finreg.sk
Redirect Base finreg.sk
Domain IPs 213.160.169.226
Redirect IPs 213.160.169.226
Response IP 213.160.169.226
Found Yes
Hash 65207ccc3cfb0e95806825f85d64fe1ffdd3e42168d3ccb88a9627cfc2d7ab95
SimHash 6036c44267d9

Groups

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path Comment
Disallow allow all

Other Records

Field Value
crawl-delay 6

seznambot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 6

amazonbot

Rule Path
Disallow /

bingbot

Rule Path Comment
Disallow allow all

Other Records

Field Value
crawl-delay 6

bytespider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 6

gptbot

Rule Path Comment
Disallow allow all

Other Records

Field Value
crawl-delay 6
Back to top

Other Records

Field Value
sitemap https://www.finreg.sk/sitemap.xml
Back to top

Comments

  • https://dataforseo.com/dataforseo-bot
  • https://opensiteexplorer.org
  • http://de.semrush.com/bot/
  • https://ahrefs.com/robot/
Back to top

Warnings

  • `request-rate` is not a known field.
  • `visit-time` is not a known field.
Back to top