autonesian.com
robots.txt

Robots Exclusion Standard data for autonesian.com

Resource Scan

Scan Details

Site Domain autonesian.com
Base Domain autonesian.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-16T02:56:57+00:00
Next Scan 2026-01-30T02:56:57+00:00

Last Successful Scan

Scanned2026-01-01T02:56:01+00:00
URL https://autonesian.com/robots.txt
Domain IPs 191.101.228.187, 2a02:4780:84:99cd:c1e4:5ac8:1d44:a0e3, 2a02:4780:84:9ede:52aa:f9f:7cf3:5b37, 93.127.187.141
Response IP 179.61.189.120
Found Yes
Hash b019c2407f6f6647fbda9092964c5dfccd45f4712ca62b2d83e8951d12a1e84f
SimHash 61014baec2b2

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /linkout/
Disallow /recommended/
Disallow /comments/feed/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.php

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.autonesian.com/sitemap.xml