This can be done by using server side includes. Its great for anytype of thing that should be on many pages and is updated alot.

Read up on SSI, google is your friend.