kerekmese.hu
robots.txt

Robots Exclusion Standard data for kerekmese.hu

Resource Scan

Scan Details

Site Domain kerekmese.hu
Base Domain kerekmese.hu
Scan Status Ok
Last Scan2024-11-11T08:36:43+00:00
Next Scan 2024-11-18T08:36:43+00:00

Last Scan

Scanned2024-11-11T08:36:43+00:00
URL https://kerekmese.hu/robots.txt
Domain IPs 104.21.27.66, 172.67.141.198, 2606:4700:3032::6815:1b42, 2606:4700:3034::ac43:8dc6
Response IP 104.21.27.66
Found Yes
Hash 17c657cd958073184eba9aea5c76bfb8577952aabc61eca9eb80df289e8e6487
SimHash 695c6001a698

Groups

*

Rule Path
Disallow /books/
Disallow /*?nggpage=

mj12bot

Rule Path
Disallow /

spiderbot

Rule Path
Disallow /

spiderbot/nutch-1.7

Rule Path
Disallow /

bingbot

Rule Path
Disallow /minta/
Disallow /nevre-szolo-minta/

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

*

Rule Path
Disallow /*add-to-cart%3D*