For an image associated with a New Article to appear on the Homepage instead of the Placeholder image (the grey one), you need to set a featured image.  Images added to the gallery or the article body will not appear on the Homepage.  Follow the Setting a Featured Image guide for details on how to do this.