After I was done making the board, I was then able to use the ISP programmer I made to program the board and I had programmed the LED to light up when I push down on the pushbutton switch. The result and code is shown below.
To know which pin is the LED and the pushbutton switch, I have to refer to my schematic found here and the Attiny85 datasheet to know which pin is which. In my case, pb is pin 3 and led is pin 4.