olivemagazine.com
robots.txt

Robots Exclusion Standard data for olivemagazine.com

Resource Scan

Scan Details

Site Domain olivemagazine.com
Base Domain olivemagazine.com
Scan Status Ok
Last Scan2024-11-15T21:56:28+00:00
Next Scan 2024-11-22T21:56:28+00:00

Last Scan

Scanned2024-11-15T21:56:28+00:00
URL https://olivemagazine.com/robots.txt
Redirect https://www.olivemagazine.com/robots.txt
Redirect Domain www.olivemagazine.com
Redirect Base olivemagazine.com
Domain IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91
Redirect IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91
Response IP 199.232.45.91
Found Yes
Hash 525bea5980a5543dc0fbd306b4ae90ca24c4281b059c63efa09921f5ba615bdf
SimHash 452b18e8bc3b

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /4817/
Disallow /176986657/
Disallow /styleguide/
Disallow /author/mrben/
Disallow /account/
Disallow /register/
Disallow /signin/
Disallow /signin
Disallow /register
Disallow /user-settings
Disallow /logout
Disallow /search/
Disallow /user/
Disallow /v1/
Disallow /search
Disallow /account/
Disallow /wp-sitemap-posts-
Disallow /api/
Disallow /auth/
Disallow /account/
Disallow /registration
Disallow /registration/
Disallow /forgotten-password
Disallow /forgotten-password/
Disallow /change-password/
Disallow /reset-password
Disallow /reset-password/
Disallow /login
Disallow /login/
Disallow /log-out
Disallow /log-out/
Disallow /v5/
Allow /tag/gut-health/
Allow /tag/cake/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.olivemagazine.com/google-news.xml/
sitemap https://www.olivemagazine.com/sitemap.xml

Comments

  • GPTBot
  • News Sitemap
  • Sitemap archive