autoshite.com
robots.txt

Robots Exclusion Standard data for autoshite.com

Resource Scan

Scan Details

Site Domain autoshite.com
Base Domain autoshite.com
Scan Status Ok
Last Scan2025-08-04T15:09:00+00:00
Next Scan 2025-09-03T15:09:00+00:00

Last Scan

Scanned2025-08-04T15:09:00+00:00
URL https://autoshite.com/robots.txt
Domain IPs 104.21.10.235, 172.67.164.206, 2606:4700:3031::ac43:a4ce, 2606:4700:3034::6815:aeb
Response IP 172.67.164.206
Found Yes
Hash bfeb335a0af0341fa7a574d914d4b7aded31c6875e0ae742cc4a0beb332e08f3
SimHash 62311c94829a

Groups

*

Rule Path
Disallow /admin/
Disallow /cache/
Disallow /converge_local/
Disallow /hooks/
Disallow /ips_kernel/
Disallow /retail/
Disallow /public/style_captcha/
Disallow /index.php?&unlockUserAgent=1
Disallow /index.php?app=core&module=task
Disallow /index.php?app=core&module=usercp&tab=forums&area=forumsubs
Disallow /index.php?app=core&module=usercp&tab=forums&area=watch&watch=topic
Disallow /index.php?app=forums&module=extras&section=forward
Disallow /index.php?app=members&module=messaging
Disallow /index.php?app=members&module=chat
Disallow /index.php?app=members&module=search
Disallow /index.php?app=members&module=search&do=active
Disallow /index.php?app=members&section=friends
Disallow /index.php?app=core&module=reports
Disallow /index.php?app=core&module=global&section=login&do=deleteCookies
Disallow /index.php?app=core&module=global&section=reputation
Disallow /index.php?app=blog&module=actions&section=report
Disallow /index.php?app=forums&module=extras&section=rating
Disallow /index.php?app=forums&module=forums&section=markasread
Disallow /*app%3Dcore%26module%3Dusercp
Disallow /*app%3Dcore%26amp%3Bmodule%3Dusercp
Disallow /*app%3Dmembers%26module%3Dmessaging
Disallow /*%26p%3D
Disallow /*%26pid%3D
Disallow /*%26hl%3D
Disallow /*%26start%3D
Disallow /*view__getnewpost$
Disallow /*view__getlastpost$
Disallow /*view__old$
Disallow /*view__new$
Disallow /*view__getfirst$
Disallow /*view__getprevious$
Disallow /*view__getnext$
Disallow /*view__getlast$
Disallow /*%26view%3Dgetnewpost$
Disallow /*%26view%3Dgetlastpost$
Disallow /*%26view%3Dold$
Disallow /*%26view%3Dnew$
Disallow /*%26view%3Dgetfirst$
Disallow /*%26view%3Dgetprevious$
Disallow /*%26view%3Dgetnext$
Disallow /*%26view%3Dgetlast$
Disallow /*?s=
Disallow /*%26s%3D

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap /sitemap.xml