axivtech.com
robots.txt

Robots Exclusion Standard data for axivtech.com

Resource Scan

Scan Details

Site Domain axivtech.com
Base Domain axivtech.com
Scan Status Ok
Last Scan2025-10-23T16:04:25+00:00
Next Scan 2025-10-30T16:04:25+00:00

Last Scan

Scanned2025-10-23T16:04:25+00:00
URL https://axivtech.com/robots.txt
Redirect https://areeblog.com/robots.txt
Redirect Domain areeblog.com
Redirect Base areeblog.com
Domain IPs 162.55.90.94
Redirect IPs 162.55.90.94
Response IP 162.55.90.94
Found Yes
Hash fee33ecb6470c9cbbcfe67264bad79d50635e561f7be8c269c1016c4fca608c1
SimHash 416ec9424ab0

Groups

googlebot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

semrushbot
semrushbot-sa
ahrefsbot
ahrefsbot-java
mj12bot
dotbot
blexbot
majestic
sistrix
screaming frog seo spider

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /license.txt
Disallow /wp-config.php
Disallow /wp-config-sample.php
Disallow /install.php
Disallow /error_log
Disallow /*?s=
Disallow /*%26s%3D
Disallow /*?orderby=
Disallow /*?filter_
Disallow /staging/
Disallow /dev/
Disallow /test/
Disallow /backup/
Disallow /temp/
Disallow /private/
Disallow /cgi-bin/
Disallow /trackback/
Disallow /comments/feed/
Disallow /wp-comments-post.php
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /wp-content/plugins/
Allow /wp-includes/

Other Records

Field Value
sitemap https://areeblog.com/wp-sitemap.xml
sitemap https://areeblog.com/sitemap-news.xml