farmmodeldatabase.com
robots.txt

Robots Exclusion Standard data for farmmodeldatabase.com

Resource Scan

Scan Details

Site Domain farmmodeldatabase.com
Base Domain farmmodeldatabase.com
Scan Status Ok
Last Scan2024-06-26T02:09:55+00:00
Next Scan 2024-07-26T02:09:55+00:00

Last Scan

Scanned2024-06-26T02:09:55+00:00
URL https://farmmodeldatabase.com/robots.txt
Redirect https://www.farmmodeldatabase.com/robots.txt
Redirect Domain www.farmmodeldatabase.com
Redirect Base farmmodeldatabase.com
Domain IPs 185.94.230.168, 2a00:f10:13f:0:1c00:b5ff:fe00:195
Redirect IPs 185.94.230.168, 2a00:f10:13f:0:1c00:b5ff:fe00:195
Response IP 185.94.230.168
Found Yes
Hash 8010a06577d31a4fee08556b0c80e5e8c5dba28000a654245d8dbcac46dacf48
SimHash a24ec1761d67

Groups

ahrefsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

pulsepoint

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

ias-ir

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

adstxtcrawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

dataxu

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

*

Rule Path
Disallow /en/admin/
Disallow /nl/beheer/
Disallow /en/models/my-wishlist/
Disallow /nl/modellen/mijn-verlanglijst/
Disallow /nl/modellen/mijn-verzameling/
Disallow /en/models/my-collection/
Disallow /en/edit-farmmodel/
Disallow /nl/landbouwminiatuur-wijzigen