arysontechnologies.com
robots.txt

Robots Exclusion Standard data for arysontechnologies.com

Resource Scan

Scan Details

Site Domain arysontechnologies.com
Base Domain arysontechnologies.com
Scan Status Ok
Last Scan2025-10-12T03:43:17+00:00
Next Scan 2025-11-11T03:43:17+00:00

Last Scan

Scanned2025-10-12T03:43:17+00:00
URL https://arysontechnologies.com/robots.txt
Redirect https://www.arysontechnologies.com/robots.txt
Redirect Domain www.arysontechnologies.com
Redirect Base arysontechnologies.com
Domain IPs 104.21.14.174, 172.67.160.26, 2606:4700:3030::6815:eae, 2606:4700:3033::ac43:a01a
Redirect IPs 104.21.14.174, 172.67.160.26, 2606:4700:3030::6815:eae, 2606:4700:3033::ac43:a01a
Response IP 104.21.14.174
Found Yes
Hash e8a06f886904917cc1c2bf2fba4cb22f66f1a91c55daff9cdde54898db0a541e
SimHash e96d5d14c097

Groups

*

Rule Path
Disallow /?s=
Disallow /search/
Disallow /settings/
Disallow /pad/
Disallow /pads/
Disallow /demo-version/
Disallow /blog/author/
Disallow /blog/tag/
Disallow /blog/2015/
Disallow /blog/2016/
Disallow /blog/2017/
Disallow /blog/2018/
Disallow /blog/2019/
Disallow /blog/2020/
Disallow /blog/2021/
Disallow /blog/2022/
Disallow /blog/2023/
Disallow /blog/2024/
Disallow /blog/wp-admin/
Disallow /blog/category/
Disallow /blog/wp-json/
Disallow /blog/wp-includes/js/
Disallow /updates/author/
Disallow /updates/tag/
Disallow /updates/2018/
Disallow /updates/2019/
Disallow /updates/2020/
Disallow /updates/2021/
Disallow /updates/2022/
Disallow /updates/2023/
Disallow /updates/2024/
Disallow /updates/wp-admin/
Disallow /updates/category/
Disallow /updates/wp-json/
Disallow /updates/amp/page/
Disallow /blog/post_tag-sitemap.xml
Disallow /blog/category-sitemap.xml
Disallow /updates/author-sitemap.xml
Disallow /updates/category-sitemap.xml
Disallow /aryson-offer/
Disallow /how-to/author/
Disallow /how-to/tag/
Disallow /how-to/2019/
Disallow /how-to/2020/
Disallow /how-to/2021/
Disallow /how-to/2022/
Disallow /how-to/2023/
Disallow /how-to/2024/
Disallow /how-to/wp-admin/
Disallow /how-to/category/
Disallow /how-to/wp-json/
Disallow /how-to/author-sitemap.xml
Disallow /how-to/category-sitemap.xml
Disallow /how-to/wp-content/themes/
Disallow /support/
Disallow /uninstallation.php
Disallow /uninstallation/success.php
Disallow /thanksforinstall.php
Disallow /gmail-email-backup/
Disallow /linux-unix/
Disallow /database-guides.html
Disallow /database-guides/msaccess.html
Disallow /database-guides/mssql.html
Disallow /database-guides/oracle.html
Disallow /comments/feed
Disallow /blog/?cat=-1%2F
Disallow /how-to/?cat=-1%2F
Disallow /updates/?cat=-1%2F
Disallow /blog/?cat=*
Disallow /how-to/?cat=*
Disallow /updates/?cat=*
Disallow /updates/*?
Disallow /?ref=
Disallow /?rsd
Disallow /feed
Disallow /comments/feed
Disallow /feed/$
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/feed/rss2/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/feed/rss2/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/feed/rss2/$
Disallow /*/*/*/trackback/$
Disallow /*/*/*/xmlrpc.php?rsd
Disallow /*/*/xmlrpc.php?rsd
Disallow /js/
Disallow /video/

Other Records

Field Value
sitemap https://www.arysontechnologies.com/sitemap.xml
sitemap https://www.arysontechnologies.com/updates/post-sitemap.xml
sitemap https://www.arysontechnologies.com/blog/post-sitemap.xml
sitemap https://www.arysontechnologies.com/how-to/post-sitemap.xml

Comments

  • FULL access (All Spiders)