qyubic.com
robots.txt

Robots Exclusion Standard data for qyubic.com

Resource Scan

Scan Details

Site Domain qyubic.com
Base Domain qyubic.com
Scan Status Ok
Last Scan2025-12-01T23:21:07+00:00
Next Scan 2025-12-08T23:21:07+00:00

Last Scan

Scanned2025-12-01T23:21:07+00:00
URL https://qyubic.com/robots.txt
Domain IPs 15.184.180.194
Response IP 15.184.180.194
Found Yes
Hash 54fe55d46dd5cd82e6548969422937ebc3f7f73dd2c76489fb21041de3710c33
SimHash 6b56de22ee30

Groups

barkrowler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://api.qyubic.com/sitemap.xml
sitemap https://api.qyubic.com/bhr-sitemap.xml
sitemap https://api.qyubic.com/eg-sitemap.xml
sitemap https://api.qyubic.com/ksa-sitemap.xml
sitemap https://api.qyubic.com/kw-sitemap.xml
sitemap https://api.qyubic.com/omn-sitemap.xml
sitemap https://api.qyubic.com/qar-sitemap.xml
sitemap https://api.qyubic.com/uae-sitemap.xml

Comments

  • Block known aggressive crawlers
  • Sitemaps