autostadt.su
robots.txt

Robots Exclusion Standard data for autostadt.su

Resource Scan

Scan Details

Site Domain autostadt.su
Base Domain autostadt.su
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-07-01T21:54:44+00:00
Next Scan 2024-07-08T21:54:44+00:00

Last Successful Scan

Scanned2024-06-23T21:54:31+00:00
URL https://autostadt.su/robots.txt
Domain IPs 91.236.136.102
Response IP 91.236.136.102
Found Yes
Hash d071c4340c1de77d1828d8a6d80d7c661a463445cc31d72780d3092223c42d5f
SimHash 2b7cd512a216

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-json/
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /*?
Disallow /?s=
Allow /*.css
Allow /*.js

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google bard

Rule Path
Disallow /

Other Records

Field Value
sitemap https://autostadt.su/sitemap.xml