Log In Sign Up

buyvia.com
robots.txt

Robots Exclusion Standard data for buyvia.com

Resource Scan

Scan Details

Site Domain buyvia.com
Base Domain buyvia.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-23T23:47:44+00:00
Next Scan 2024-11-21T23:47:44+00:00

Last Successful Scan

Scanned2023-10-29T23:30:38+00:00
URL https://buyvia.com/robots.txt
Redirect https://www.buyvia.com/robots.txt
Redirect Domain www.buyvia.com
Redirect Base buyvia.com
Domain IPs 104.21.9.105, 172.67.159.190, 2606:4700:3030::ac43:9fbe, 2606:4700:3036::6815:969
Redirect IPs 104.21.9.105, 172.67.159.190, 2606:4700:3030::ac43:9fbe, 2606:4700:3036::6815:969
Response IP 172.67.159.190
Found Yes
Hash eedec1257f2825217a17d503a3387743488daf75b39ce91fa8e5468dc1fa99ae
SimHash f1e592488d32

Groups

buck

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /deals/

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /j/
Back to top

Other Records

Field Value
sitemap https://www.buyvia.com/wp-sitemap.xml
sitemap https://www.buyvia.com/category-sitemap.xml
sitemap https://www.buyvia.com/coupons-sitemap.xml
sitemap https://www.buyvia.com/deals-sitemap.xml
sitemap https://www.buyvia.com/vendor-sitemap.xml
sitemap https://www.buyvia.com/vendor-complete-sitemap.xml
Back to top

Comments

  • Buck/2.3; Beta (+https://app.hypefactors.com/media-monitoring/about.html)
  • Mozilla/5.0+(compatible;+linkdexbot/2.0;++http://www.linkdex.com/bots/)
  • http://www.linkdex.com/bots/
  • ChatGPT
  • Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
  • https://platform.openai.com/docs/plugins/bot
  • Majestic Bot (MJ12bot)
  • http://www.majestic12.co.uk/bot.php
  • Mozilla/5.0+(compatible;+MJ12bot/v1.4.5;+http://www.majestic12.co.uk/bot.php?+)
  • Semrush Bot
  • http://www.semrush.com/bot.html
  • Mozilla/5.0+(compatible;+SemrushBot-SA/0.97;++http://www.semrush.com/bot.html)
  • PetalBot Bot
  • https://webmaster.petalsearch.com/site/petalbot
  • Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot)
  • Trendiction
  • http://www.trendiction.de/bot
  • Comscore
  • https://www.comscore.com/Web-Crawler
  • ChatGPT
  • https://platform.openai.com/docs/gptbot
Back to top