arantius.com
robots.txt

Robots Exclusion Standard data for arantius.com

Resource Scan

Scan Details

Site Domain arantius.com
Base Domain arantius.com
Scan Status Ok
Last Scan2025-05-17T12:19:52+00:00
Next Scan 2025-05-24T12:19:52+00:00

Last Scan

Scanned2025-05-17T12:19:52+00:00
URL https://arantius.com/robots.txt
Domain IPs 2607:a680:5:1002::7, 52.129.44.27
Response IP 52.129.44.27
Found Yes
Hash 19f23a1c756e37bb5955f228741b2864363647f0e71748fadc145ecd697f334f
SimHash cd5532703f11

Groups

*

Rule Path
Disallow /contact
Disallow /login
Disallow /search
Disallow /prefs

mediapartners-google*

Rule Path
Disallow

aboutusbot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

fast-webcrawler

Rule Path
Disallow /

mercator

Rule Path
Disallow /

npbot

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

robocrawl

Rule Path
Disallow /

omniexplorer

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

proximic

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /