Log In Sign Up

askstruck.com
robots.txt

Robots Exclusion Standard data for askstruck.com

Resource Scan

Scan Details

Site Domain askstruck.com
Base Domain askstruck.com
Scan Status Ok
Last Scan2024-06-29T10:53:53+00:00
Next Scan 2024-07-06T10:53:53+00:00

Last Scan

Scanned2024-06-29T10:53:53+00:00
URL https://askstruck.com/robots.txt
Domain IPs 65.87.199.140
Response IP 65.87.199.140
Found Yes
Hash 318b8f25513a4afeba49b59c28cc070c6d3df80f7a171b83c140771786580edb
SimHash 9834c4c2f771

Groups

googlebot

Rule Path
Allow /
Allow /content/
Allow /blog/

facebookexternalhit

Rule Path
Allow /

bingbot

Rule Path
Allow /
Allow /content/
Allow /blog/

googlebot-image

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

gowikibot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

pinterest

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /
Back to top

Comments

  • Disallow: /
  • Disallow: /
  • User-Agent: *
  • Disallow: /
Back to top