Log In Sign Up

megabyte.hu
robots.txt

Robots Exclusion Standard data for megabyte.hu

Resource Scan

Scan Details

Site Domain megabyte.hu
Base Domain megabyte.hu
Scan Status Ok
Last Scan2025-10-26T18:58:24+00:00
Next Scan 2025-10-27T18:58:24+00:00

Last Scan

Scanned2025-10-26T18:58:24+00:00
URL https://megabyte.hu/robots.txt
Domain IPs 104.21.86.56, 172.67.215.89, 2606:4700:3031::ac43:d759, 2606:4700:3035::6815:5638
Response IP 104.21.86.56
Found Yes
Hash e87f4f4a2f00f7ef920ec4f9335a98a0d13d59706e6aa9d7fbe97e33e24624d2
SimHash 490534dced93

Groups

*

Rule Path
Disallow /doksi/*
Disallow /kapcsolat*
Disallow /bejelentkezes*
Disallow /gephaz*
Disallow /comment*
Disallow /*?*

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://megabyte.hu/sitemap.xml
Back to top

Comments

  • oldalak tiltasa
  • osszes kerdojeles parameter tiltasa
  • User-agent: GPTBot
  • Disallow: /
Back to top