arnette.com
robots.txt

Robots Exclusion Standard data for arnette.com

Resource Scan

Scan Details

Site Domain arnette.com
Base Domain arnette.com
Scan Status Ok
Last Scan2024-09-28T10:31:42+00:00
Next Scan 2024-10-28T10:31:42+00:00

Last Scan

Scanned2024-09-28T10:31:42+00:00
URL https://arnette.com/robots.txt
Redirect https://www.arnette.com/robots.txt
Redirect Domain www.arnette.com
Redirect Base arnette.com
Domain IPs 23.32.29.91, 23.32.29.99, 2600:1413:b000:1d::17d1:2e98, 2600:1413:b000:1d::17d1:2ea2
Redirect IPs 23.32.29.91, 23.32.29.99, 2600:1413:b000:1d::17d1:2e98, 2600:1413:b000:1d::17d1:2ea2
Response IP 23.32.29.99
Found Yes
Hash 3362658f5dab8b3e477a1d5b405b6623e41a9c13ec167c00547bed87b798c673
SimHash 50043a201710

Groups

*

Rule Path
Disallow /cms-preview/
Disallow /flags/
Disallow /images/
Disallow /locales/
Disallow /android*
Disallow /assets-manifest.json
Disallow /browserconfig.xml
Disallow /favicon*
Disallow /manifest.json
Disallow /mstile*
Disallow /safari*
Disallow /worker.js

rytebot/1.0.0 (+https://bot.ryte.com/)

Rule Path
Allow *

mozilla/5.0 (compatible; botify;http://botify.com)

Rule Path
Allow *

adsbot-google

Rule Path
Allow *

Other Records

Field Value
sitemap /sitemap.xml
sitemap https://www.arnette.com/en-us/sitemap.xml
sitemap https://www.arnette.com/en-uk/sitemap.xml
sitemap https://www.arnette.com/en-pt/sitemap.xml
sitemap https://www.arnette.com/en-nl/sitemap.xml
sitemap https://www.arnette.com/it-it/sitemap.xml
sitemap https://www.arnette.com/en-ie/sitemap.xml
sitemap https://www.arnette.com/fr-fr/sitemap.xml
sitemap https://www.arnette.com/es-es/sitemap.xml
sitemap https://www.arnette.com/de-de/sitemap.xml
sitemap https://www.arnette.com/en-ca/sitemap.xml
sitemap https://www.arnette.com/de-at/sitemap.xml