eweek.com
robots.txt

Robots Exclusion Standard data for eweek.com

Resource Scan

Scan Details

Site Domain eweek.com
Base Domain eweek.com
Scan Status Ok
Last Scan2024-11-13T05:05:13+00:00
Next Scan 2024-11-20T05:05:13+00:00

Last Scan

Scanned2024-11-13T05:05:13+00:00
URL https://eweek.com/robots.txt
Redirect https://www.eweek.com/robots.txt
Redirect Domain www.eweek.com
Redirect Base eweek.com
Domain IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91
Redirect IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91, 2a04:4e42:200::347, 2a04:4e42:400::347, 2a04:4e42:600::347, 2a04:4e42::347
Response IP 199.232.45.91
Found Yes
Hash 1b8738db2536527ad63d79839d377e87e51089b082f7c82e031c3a1f5b4688f6
SimHash 09089884e832

Groups

*

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.eweek.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK