How to make a page on a website follow a layout from another file in HTML?

I am making a website but I am having a problem, later on I want to be able to change the layout without going through every HTML file, such as the layout (Such as the top navigation bar) being held in another file, so if I edit that file it changes all of the pages. Is there a way I can do that?
Also I would prefer if there was no server side scripts as the hosting I am using disallows it.

I suggest finding a new host. There is no way to do that with just HTML and no efficient way to do it without a server side script.

There's two really bad workarounds for this:

1. use framesets (deprecated, don't)

2. print the menu in a separate javascript file and include it in the html documents:

<script type="text/javascript" src="my_menu.js"></script>

Basically, in my_menu.js it says:

document.write("<a href='home.html'>Home</a>");

etc.