I updated my site to WordPress 4.1 and I have now noticed that only Default Permalinks are working.
Posts and RSS are not appearing as well as 404 error pages if I'm using another Permalink structure. They only appear on the Default settings.
Changing to default to year/day/post doesn't resolve the issue. I was originally using Year Day PostName.
/%year%/%monthnum%/%postname%