qooyi.com
robots.txt

Robots Exclusion Standard data for qooyi.com

Resource Scan

Scan Details

Site Domain qooyi.com
Base Domain qooyi.com
Scan Status Ok
Last Scan2025-11-24T22:01:27+00:00
Next Scan 2025-12-01T22:01:27+00:00

Last Scan

Scanned2025-11-24T22:01:27+00:00
URL https://qooyi.com/robots.txt
Domain IPs 104.21.51.39, 172.67.220.179, 2606:4700:3030::6815:3327, 2606:4700:3035::ac43:dcb3
Response IP 172.67.220.179
Found Yes
Hash 1b0fa35f4913d000844eae65a185647c7460e4ec5c433df3f1ad885c7fc35be8
SimHash ec0551324ab2

Groups

*

Rule Path
Allow /
Disallow /wp-admin
Allow /wp-admin/admin-ajax.php
Disallow /wp-login.php
Disallow /comments/feed/
Disallow /trackback/
Disallow /index.php
Disallow /search
Disallow /*?s=*
Disallow /cdn-cgi/rum
Disallow /*?replytocom
Disallow /*?amp*
Disallow /*wpmp_switcher%3D*
Disallow /*?t=*
Disallow /*mc_cid%3D*
Disallow /*mc_eid%3D*
Disallow /*1000
Disallow /*?PageSpeed=noscript
Disallow /*?quad_cc
Disallow /*wordfence_logHuman%3D*

scrapy

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

seznambot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

facebookexternalhit

Rule Path
Allow /*?*smid=

twitterbot

Rule Path
Allow /*?*smid=

Other Records

Field Value
sitemap https://qooyi.com/sitemap_index.xml

Comments

  • WordPress CMS and low-value pages
  • Disallow paginated homepage URLs with extra query parameters
  • Disallow Rules
  • Delay Rules
  • Other Bot Rules