When "viewing" updated category pg, it is not same when clicking "view the site"

Will my category page when finally published/launched look like the page I see when I click “View the site” drop-down tab in the dashboard menu or will it look like the page that I see when I click “View page” button in the page editor/customizer? Right now, I am seeing two different looks, one that shows a featured image (and the look I want) when I click “view page”; however, it is a very basic looking page when I click “view the site”. It’s not that I am changing anything in between the clicks, I just see two different page looks when I open the two tabs to view the category page. Thank you.