alicenorth.com
robots.txt

Robots Exclusion Standard data for alicenorth.com

Resource Scan

Scan Details

Site Domain alicenorth.com
Base Domain alicenorth.com
Scan Status Ok
Last Scan2024-09-16T23:33:16+00:00
Next Scan 2024-10-16T23:33:16+00:00

Last Scan

Scanned2024-09-16T23:33:16+00:00
URL https://alicenorth.com/robots.txt
Domain IPs 52.84.229.120, 52.84.229.5, 52.84.229.57, 52.84.229.80
Response IP 52.84.229.120
Found Yes
Hash c1a21dbe3d25791e197f21f9efe8af1b7dc0722f0667d12d58f7b190c6690543
SimHash 985544786883

Groups

ia_archiver

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mbcrawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

pagething

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

testbot

Rule Path
Disallow /

vuhuvbot

Rule Path
Disallow /

pandalytics

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mixrankbot

Rule Path
Disallow /

thinkchaos

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://alicenorth.com/sitemapindex.xml