seroyal.com
robots.txt

Robots Exclusion Standard data for seroyal.com

Resource Scan

Scan Details

Site Domain seroyal.com
Base Domain seroyal.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-27T18:28:12+00:00
Next Scan 2024-06-25T18:28:12+00:00

Last Successful Scan

Scanned2023-02-09T04:35:03+00:00
URL https://seroyal.com/robots.txt
Redirect https://www.seroyal.com/robots.txt
Redirect Domain www.seroyal.com
Redirect Base seroyal.com
Domain IPs 3.224.123.132, 35.171.238.11
Redirect IPs 23.215.7.21, 23.215.7.32, 2600:1413:b000:1b::17d7:715, 2600:1413:b000:1b::17d7:720
Response IP 23.215.7.21
Found Yes
Hash 64a0fa1785cd02dfa6a7c9d8abd5fa213e86889d94ce5ee7862d4d3ac8c974b3
SimHash 3c04e39582f8

Groups

baiduspider
blexbot
yandex

Rule Path
Disallow /

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider

Rule Path
Disallow */CHANGELOG.md
Disallow */composer.json
Disallow */composer.lock
Disallow */CONTRIBUTING.md
Disallow */CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow */COPYING.txt
Disallow */Gruntfile.js
Disallow */ISSUE_TEMPLATE.md
Disallow */LICENSE.html
Disallow */LICENSE.txt
Disallow */LICENSE_AFL.txt
Disallow */nginx.conf.sample
Disallow */package.json
Disallow */package.json.sample
Disallow */php.ini.sample
Disallow */RELEASE_NOTES.txt

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider

Rule Path
Disallow */account/
Disallow */address/
Disallow */app/
Disallow */bin/
Disallow */cart/
Disallow */catalogsearch/
Disallow */checkout/
Disallow */contacts/
Disallow */control/
Disallow */customer/
Disallow */CVS/
Disallow */dev/
Disallow */giftcard/
Disallow */guest/
Disallow */index.php/
Disallow */newsletter/
Disallow */order/
Disallow */phpserver/
Disallow */product_compare/
Disallow */report/
Disallow */review/
Disallow */sales/
Disallow */sendfriend/
Disallow */setup/
Disallow */shell/
Disallow */storecredit/
Disallow */update/
Disallow */var/
Disallow */vault/
Disallow */vendor/
Disallow */wishlist/

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider

Rule Path
Disallow /*.CVS
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Svn$
Disallow /*.Tgz$
Disallow /*.Zip$

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider

Rule Path
Disallow /*.php$
Disallow /*SID%3D
Disallow /*sid%3D

*
googlebot
googlebot-mobile
googlebot-image
googlebot-video
googlebot-news
screaming frog seo spider

Rule Path
Disallow /*%26allergen_indicators%3D
Disallow /*?allergen_indicators=
Disallow /*%26delivery_format%3D
Disallow /*?delivery_format=
Disallow /*%26product_list_dir%3D
Disallow /*?product_list_dir=
Disallow /*%26product_list_limit%3D
Disallow /*?product_list_limit=
Disallow /*%26product_list_mode%3D
Disallow /*?product_list_mode=
Disallow /*%26product_list_order%3D
Disallow /*?product_list_order=
Disallow /*%26Price_range%3D
Disallow /*?Price_range=
Disallow /*%26q%3D
Disallow /*?q=
Disallow /*%26p%3D
Disallow /*?p=
Disallow /*%26cat%3D
Disallow /*?cat=
Disallow /*?*
Disallow /friends-and-family

Other Records

Field Value
sitemap https://www.seroyal.com/sitemap.xml

Comments

  • Bad Bots
  • Files
  • Directories
  • CVS SVN directory and dump files
  • Session ID
  • Parameters