storeinsider.hu
robots.txt

Robots Exclusion Standard data for storeinsider.hu

Resource Scan

Scan Details

Site Domain storeinsider.hu
Base Domain storeinsider.hu
Scan Status Ok
Last Scan2024-09-21T05:07:58+00:00
Next Scan 2024-09-28T05:07:58+00:00

Last Scan

Scanned2024-09-21T05:07:58+00:00
URL https://storeinsider.hu/robots.txt
Domain IPs 104.21.48.75, 172.67.181.118, 2606:4700:3032::6815:304b, 2606:4700:3035::ac43:b576
Response IP 104.21.48.75
Found Yes
Hash 5d833fc7f2b9e606ae86d25c26bba7335b1f61534f77fe39b69efc791816f6e7
SimHash 494650046540

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /
Disallow /kereses.php
Disallow /kereses
Disallow /_nuxt/
Disallow /image/
Disallow /api/
Disallow /rss/
Disallow /uploads/images/imported/

bingbot

Rule Path
Allow /
Disallow /kereses.php
Disallow /kereses
Disallow /_nuxt/
Disallow /image/
Disallow /api/
Disallow /rss/
Disallow /uploads/images/imported/

mediapartners-google

Rule Path
Allow /
Disallow /kereses
Disallow /uploads/images/imported/

facebookexternalhit

Rule Path
Allow /
Disallow /kereses
Disallow /uploads/images/imported/