Next/Previous button to stay within Portfolio Category?

When viewing one of my Portfolio items, I like how users can go to another project by clicking on the next/previous buttons. However, it won’t allow me to specify to stay within the Portfolio Category. Instead, it goes by the date (in the order they were added to the portfolio).

For instance, I have three categories: Brands, Web and Print. When I’m viewing my logos, I want users to be able to hit next/previous to view other Logos ….not for it to skip to Print or Web. See the image attached. When I view the logo (left), it takes me to a print project (right) when I hit “next”.

All of my portfolio items are in their correct category. Is there a way to specify for those next/previous buttons to stay within the portfolio category and not go by when they were added?

Thanks!