In a sense, you rent space on a computer to hold your website. Your host, the computer where your website files are stored, assigns an address (DNS) for your files to your domain name so that anyone can find your website on the Internet by typing in your domain name.
Its like renting decent parking space for a car you bought, while the car represents your domain.