merriam-webster.com
robots.txt

Robots Exclusion Standard data for merriam-webster.com

Resource Scan

Scan Details

Site Domain merriam-webster.com
Base Domain merriam-webster.com
Scan Status Ok
Last Scan2024-11-14T15:14:24+00:00
Next Scan 2024-11-21T15:14:24+00:00

Last Scan

Scanned2024-11-14T15:14:24+00:00
URL https://merriam-webster.com/robots.txt
Redirect https://www.merriam-webster.com:443/robots.txt
Redirect Domain www.merriam-webster.com
Redirect Base merriam-webster.com
Domain IPs 18.155.68.128, 18.155.68.71, 18.155.68.79, 18.155.68.94, 2600:9000:23d2:0:c:3d32:e340:93a1, 2600:9000:23d2:2e00:c:3d32:e340:93a1, 2600:9000:23d2:6000:c:3d32:e340:93a1, 2600:9000:23d2:6a00:c:3d32:e340:93a1, 2600:9000:23d2:7400:c:3d32:e340:93a1, 2600:9000:23d2:7e00:c:3d32:e340:93a1, 2600:9000:23d2:9e00:c:3d32:e340:93a1, 2600:9000:23d2:d600:c:3d32:e340:93a1
Redirect IPs 13.33.183.114, 13.33.183.37, 13.33.183.46, 13.33.183.95, 2600:9000:23d2:1e00:c:3d32:e340:93a1, 2600:9000:23d2:200:c:3d32:e340:93a1, 2600:9000:23d2:2600:c:3d32:e340:93a1, 2600:9000:23d2:3600:c:3d32:e340:93a1, 2600:9000:23d2:5200:c:3d32:e340:93a1, 2600:9000:23d2:8400:c:3d32:e340:93a1, 2600:9000:23d2:ac00:c:3d32:e340:93a1, 2600:9000:23d2:fe00:c:3d32:e340:93a1
Response IP 18.155.68.94
Found Yes
Hash 1bfd69adeda2fc53f53641b4d25fd6f0134fd86776332fbb92ecd05604381efa
SimHash ea01b845af92

Groups

*

Rule Path
Disallow /wotd-signup-message
Disallow /wotd-signup-result
Disallow /word-of-the-day/manage-subscription
Disallow /interstitial-ad
Disallow /my-saved-words/dictionary/starclick/
Disallow /lapi
Disallow /assets/mw/static/old-games/

Other Records

Field Value
sitemap https://www.merriam-webster.com/sitemap-ssl/sitemap_index.xml

Comments

  • This is a production robots.txt
  • This is a production robots.txt