nanowerk.com
robots.txt

Robots Exclusion Standard data for nanowerk.com

Resource Scan

Scan Details

Site Domain nanowerk.com
Base Domain nanowerk.com
Scan Status Ok
Last Scan2024-11-14T12:10:35+00:00
Next Scan 2024-11-21T12:10:35+00:00

Last Scan

Scanned2024-11-14T12:10:35+00:00
URL https://nanowerk.com/robots.txt
Domain IPs 104.26.0.202, 104.26.1.202, 172.67.69.89, 2606:4700:20::681a:1ca, 2606:4700:20::681a:ca, 2606:4700:20::ac43:4559
Response IP 172.67.69.89
Found Yes
Hash 6e549149da1a3c2e90579b60274c83752283974c197ad9432b4a916d04274d92
SimHash 9808d043af23

Groups

yandex

Rule Path
Disallow /

*

Rule Path
Allow /*.js
Allow /*.css
Allow /*.jpg
Allow /*.gif
Allow /*.png
Disallow /mmServerScripts/
Disallow /Connections/
Disallow /indextest.php
Disallow /machform/
Disallow /templates/
Disallow /TriggerNote/
Disallow /spotid%3D10x.php
Disallow /spotid%3D20x.php
Disallow /spotid%3D30x.php
Disallow /spotid%3D40x.php
Disallow /spotid%3D50x.php
Disallow /spotid%3D60x.php
Disallow /spotid%3D70x.php
Disallow /spotid%3D80x.php
Disallow /spotid%3D90x.php
Disallow /spotid%3D100x.php
Disallow /spotid%3D110x.php
Disallow /spotid%3D120x.php
Disallow /spotid%3D130x.php

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.nanowerk.com/sitemapindex.xml
sitemap https://www.nanowerk.com/sitemap.xml
sitemap https://www.nanowerk.com/sitemap1.xml