Log In Sign Up

superatv.com
robots.txt

Robots Exclusion Standard data for superatv.com

Resource Scan

Scan Details

Site Domain superatv.com
Base Domain superatv.com
Scan Status Ok
Last Scan2024-09-05T11:54:28+00:00
Next Scan 2024-10-05T11:54:28+00:00

Last Scan

Scanned2024-09-05T11:54:28+00:00
URL https://superatv.com/robots.txt
Redirect https://www.superatv.com/robots.txt
Redirect Domain www.superatv.com
Redirect Base superatv.com
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.61, 76.76.21.93
Response IP 76.76.21.22
Found Yes
Hash 781cd7ed50370c82ad57f6b3153820f0357cec543ef6661e618e9cfed765ea7e
SimHash 46569452c571

Groups

*

Rule Path
Allow /*graphql
Allow /*static
Allow /*media
Disallow */checkout
Disallow */cart
Disallow */account
Disallow /locales/

mediapartners-google

Rule Path
Allow /*graphql
Allow /*static
Allow /*media

storebot-google

Rule Path
Allow /*graphql
Allow /*static
Allow /*media

adsbot-google

Rule Path
Allow /*graphql
Allow /*static
Allow /*media
Disallow */checkout
Disallow */cart
Disallow */account

baiduspider
yisouspider
petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

asterias

Rule Path
Disallow /

yahoo-blogs/v3.9

Rule Path
Disallow /

yandex

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

rogerbot
dotbot
ahrefsbot
mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://www.superatv.com/sitemap.xml
sitemap https://www.superatv.com/offroad-atlas/sitemap.xml
Back to top

Comments

  • Allowed Resources
  • Account-Checkout
  • Folders-Files
  • Google's Adsense
  • Google's Storebot
  • Google's Adbot
  • Chinese Bots
  • Crawl Delays
  • XML Sitemaps
  • .....................
  • ..........:::::::::..........
  • .:.....:^^^^~~~^^^^^~~~^^^^:.....:.
  • .:. .:^^^~^^^::.........::^^^~^^^:. .::
  • ::. .^^^^^::. .::^^^^^. .::
  • .:. .^^^^^: .^^^^^. .:.
  • .: ^^^^^. .^^^^^ ::
  • ..:^^~~!~~~~~^: .: .^^^^: :^^^^. ::
  • .^!77777!~!7777777. :::::::: ^::~~~~^::::::::::::. .::::. .. .^^^^. ::
  • .~777777^. .!77777!~::::. :::::.::::^::::::. :^^^^^^^^^^:^^^~~~^^^^: .7P#BBBBBB!?BBBBBBBBBBBBBBBBBBBJ. :JBB#GJ: !7^ .^^^^ :
  • .7???????!.:!!!!!!!7????^ :!???7~7JJYJ7?YYY55J^?5PPPY5555YYPBBBP5G#####~ :?G&B5G###B^.^^?B####5~^^~G####B! :YB&&B?: .. :^^^:
  • !YYYYYYYYJ~ .!YYYY7..!YYYY77Y5557..75PPPYJPGGGJ: ~5BB#G! ^G&&&B7 ^Y#&#Y?B&&&G: :Y#&&&B7 :G&&&&P::Y#&&G?. J!^ .......:^^^:
  • . ^J5555555PJ. ~YP5PJ^ ~YP55J7YPPP5!:~5GGG5J5GGBBGYYYJ!JB####J?5#BPJ~.^5&@#Y^Y&@&@5. .?#@&@&Y: ~#@&@&?^Y&@@G!.:J7Y?^. .::^^^^^^^^^^^^^^^
  • ~JYYJJY7.~Y5YYYYYY~!YJJJ!..!J???!!JJJJJJ?JYJ?!~?5PP57!!777YPBBB5?5###BB~ ~5#&#BJ!P####J ^P&#&&P!^. !#&&&G?Y&@&P~:!~!J?...:^^^^^^:..:^^^^^^^^:
  • .!JJ???7^ :777777!!7777~. ^7777~~7?JJ7:..... !Y555?: :YGBBG! ^5#B#G?7P##BPPP###B#B! .JB#B#G7:^^. 7B#BBP5B#BY^^^~7^7^ .:^^^^^^^. :^^^^^^^^^:
  • .7777777!~~!77777~^!7777~:^!777!~7JJJ?^ ^JP55PJ~~~~:?GGGGJ:.JBBBB5JP##G?: :5BBBBG~ 7G#BBBJ: ^^..J#BBBBB#G?: !J:~7: :~^^^^^^^^..::::.^^^^^
  • .^~!!!!!!!!!~~^:. .~!!!!!!!~^:.^!777~. .~JJJJJJJYYJ7JYYYY~ .J5555YY5557. :Y5555Y:.?5555Y^.: .. 755555557. .!~^ :^^^^^^^^^: .^^^^.
  • .... . :: .:... . .^^^^^^^^^^. :^^^^.
  • :: ^^^^^. :^^^^^^:. :^^^^^^^^:^^^^^.
  • .:. .^^^^^. .^^^^^^^. :^^^^^^^^^^^^:
  • ::. .^^^^^::. .^^^^^^^^::^^^^^^^^^^^^^:
  • .:. .:^^^~^^^^^^^^^^^^^^^^^^^^^^^:.
  • .:.....:^^^^^^^^^^^^^^^^^^^::.
  • ..........:::::::::...
Back to top

Warnings

  • 1 invalid line.
Back to top