genertel.hu
robots.txt

Robots Exclusion Standard data for genertel.hu

Resource Scan

Scan Details

Site Domain genertel.hu
Base Domain genertel.hu
Scan Status Ok
Last Scan2026-02-14T04:49:15+00:00
Next Scan 2026-03-16T04:49:15+00:00

Last Scan

Scanned2026-02-14T04:49:15+00:00
URL https://genertel.hu/robots.txt
Redirect https://www.genertel.hu/robots.txt
Redirect Domain www.genertel.hu
Redirect Base genertel.hu
Domain IPs 45.223.167.17, 45.223.179.17
Redirect IPs 45.223.167.17, 45.223.179.17
Response IP 45.223.167.17
Found Yes
Hash 81f37bd1ac304af6d7e03c35f273bb381c38a43217414573470a3181e68ed485
SimHash 025c9d448990

Groups

*

Rule Path
Disallow

blexbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

jamesbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

netseer

Rule Path
Disallow /

obot

Rule Path
Disallow /

karriereatbot

Rule Path
Disallow /

feosey mohk crawler

Rule Path
Disallow /

steeler

Rule Path
Disallow /

bilbo

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

elefent

Rule Path
Disallow /

elefent/elefent

Rule Path
Disallow /

tineye

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

deusu

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.genertel.hu/sitemap.xml