maxon.net
robots.txt

Robots Exclusion Standard data for maxon.net

Resource Scan

Scan Details

Site Domain maxon.net
Base Domain maxon.net
Scan Status Ok
Last Scan2024-09-18T00:03:16+00:00
Next Scan 2024-09-25T00:03:16+00:00

Last Scan

Scanned2024-09-18T00:03:16+00:00
URL https://maxon.net/robots.txt
Redirect https://www.maxon.net/robots.txt
Redirect Domain www.maxon.net
Redirect Base maxon.net
Domain IPs 104.18.42.17, 172.64.145.239, 2606:4700:4400::6812:2a11, 2606:4700:4400::ac40:91ef
Redirect IPs 104.18.42.17, 172.64.145.239, 2606:4700:4400::6812:2a11, 2606:4700:4400::ac40:91ef
Response IP 104.18.42.17
Found Yes
Hash bb307318d34a1613eecc03aadc3129f8eccd89a65d8d692d9ab4e4c8ba7ef328
SimHash cc66ca209cd3

Groups

*

Rule Path
Disallow /api
Disallow /api/entry
Disallow /api/validate-preview-password
Disallow /api/digital-river/*

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /
Disallow /en/
Disallow /de/
Disallow /es/
Disallow /fr/
Disallow /it/
Disallow /zh/
Disallow /ja/
Disallow /ko/

Other Records

Field Value
sitemap https://www.maxon.net/sitemap.xml

Comments

  • Block bots that don't benefit us.