blogoergosum.com
robots.txt

Robots Exclusion Standard data for blogoergosum.com

Resource Scan

Scan Details

Site Domain blogoergosum.com
Base Domain blogoergosum.com
Scan Status Ok
Last Scan2025-05-12T12:51:32+00:00
Next Scan 2025-05-19T12:51:32+00:00

Last Scan

Scanned2025-05-12T12:51:32+00:00
URL https://blogoergosum.com/robots.txt
Redirect https://www.blogoergosum.com/robots.txt
Redirect Domain www.blogoergosum.com
Redirect Base blogoergosum.com
Domain IPs 5.135.242.217
Redirect IPs 5.135.242.217
Response IP 5.135.242.217
Found Yes
Hash 26abaaaf2ddbe2138910f30ffa4e520102668f83d1190e33e792159bfb230aaf
SimHash 5b2d4c82cab8

Groups

ahrefsbot
aspiegelbot
blexbot
barkrowler
dotbot
mj12bot
mauibot
nimbostratus-bot
petalbot
semrushbot
seznambot
sogou
serpstatbot
trendiction
textbulkerbot

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 180

amazonbot
bytespider
ccbot
cohere-ai
facebookbot
omgilibot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.blogoergosum.com/sitemap-news.xml
sitemap https://www.blogoergosum.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK

Warnings

  • 1 invalid line.