borntodiy.hu
robots.txt

Robots Exclusion Standard data for borntodiy.hu

Resource Scan

Scan Details

Site Domain borntodiy.hu
Base Domain borntodiy.hu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-24T13:59:42+00:00
Next Scan 2025-12-23T13:59:42+00:00

Last Successful Scan

Scanned2025-02-27T06:15:43+00:00
URL https://borntodiy.hu/robots.txt
Domain IPs 193.32.234.20
Response IP 193.32.234.20
Found Yes
Hash 24233aff1bac227c292d3aa0a08c4e097c69e4df33c915faa535104d91128b43
SimHash c04118444714

Groups

*

Rule Path
Disallow /views
Disallow /models
Disallow /controllers
Disallow /userfiles
Disallow /tmp
Disallow /tmp_images

googlebot

Rule Path
Allow *.js
Allow *.css

Other Records

Field Value
sitemap https://borntodiy.hu/hu/sitemap/sitemap.xml