500 internal server error, but fine on page refresh

I have a WordPress installation that I’m currently working on. Every page that I visit gives a 500 internal server error, but when I refresh the page it works fine. What could be causing this?