Log In Sign Up

agyiszint.hu
robots.txt

Robots Exclusion Standard data for agyiszint.hu

Resource Scan

Scan Details

Site Domain agyiszint.hu
Base Domain agyiszint.hu
Scan Status Ok
Last Scan2024-11-16T08:34:49+00:00
Next Scan 2024-11-23T08:34:49+00:00

Last Scan

Scanned2024-11-16T08:34:49+00:00
URL https://agyiszint.hu/robots.txt
Domain IPs 104.21.60.3, 172.67.186.162, 2606:4700:3034::ac43:baa2, 2606:4700:3035::6815:3c03
Response IP 172.67.186.162
Found Yes
Hash 2ceb4094e8151cec8a96f6efd7e2879f186e61142e33e2fa1bbe476d7db182af
SimHash 0147fdf4f9e3

Groups

ia_archiver

Rule Path
Disallow /

deusu

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

alert_alligator_webmonitoring_service

Rule Path
Disallow /

hirlista-feedagent

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

comodo dcv

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

webymon

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

*

Rule Path
Disallow /privacy
Back to top