merriam-webster.com
robots.txt

Robots Exclusion Standard data for merriam-webster.com

Resource Scan

Scan Details

Site Domain merriam-webster.com
Base Domain merriam-webster.com
Scan Status Ok
Last Scan2024-04-23T22:11:42+00:00
Next Scan 2024-04-30T22:11:42+00:00

Last Scan

Scanned2024-04-23T22:11:42+00:00
URL https://merriam-webster.com/robots.txt
Redirect https://www.merriam-webster.com:443/robots.txt
Redirect Domain www.merriam-webster.com
Redirect Base merriam-webster.com
Domain IPs 18.155.68.128, 18.155.68.71, 18.155.68.79, 18.155.68.94, 2600:9000:23d2:1800:c:3d32:e340:93a1, 2600:9000:23d2:2000:c:3d32:e340:93a1, 2600:9000:23d2:2a00:c:3d32:e340:93a1, 2600:9000:23d2:6000:c:3d32:e340:93a1, 2600:9000:23d2:7800:c:3d32:e340:93a1, 2600:9000:23d2:9400:c:3d32:e340:93a1, 2600:9000:23d2:a800:c:3d32:e340:93a1, 2600:9000:23d2:e600:c:3d32:e340:93a1
Redirect IPs 18.155.68.128, 18.155.68.71, 18.155.68.79, 18.155.68.94, 2600:9000:23d2:2c00:c:3d32:e340:93a1, 2600:9000:23d2:7c00:c:3d32:e340:93a1, 2600:9000:23d2:8200:c:3d32:e340:93a1, 2600:9000:23d2:9c00:c:3d32:e340:93a1, 2600:9000:23d2:a000:c:3d32:e340:93a1, 2600:9000:23d2:b400:c:3d32:e340:93a1, 2600:9000:23d2:c800:c:3d32:e340:93a1, 2600:9000:23d2:d200:c:3d32:e340:93a1
Response IP 18.155.68.71
Found Yes
Hash 1bfd69adeda2fc53f53641b4d25fd6f0134fd86776332fbb92ecd05604381efa
SimHash ea01b845af92

Groups

*

Rule Path
Disallow /wotd-signup-message
Disallow /wotd-signup-result
Disallow /word-of-the-day/manage-subscription
Disallow /interstitial-ad
Disallow /my-saved-words/dictionary/starclick/
Disallow /lapi
Disallow /assets/mw/static/old-games/

Other Records

Field Value
sitemap https://www.merriam-webster.com/sitemap-ssl/sitemap_index.xml

Comments

  • This is a production robots.txt
  • This is a production robots.txt