i’m doing jalepeno’s, peppers, oregano, rosemary, and cilantro and would like to continue them through the winter

For mine i use a bulb special made for growing plants and also can be used for aquariums. When i first made an indoor garden i found a video on Youtube that helped a lot. It was easy, inexpensive, and it worked great.
The bulb i use is a 18" Phillips Plant/Aquarium Bulb you can buy from Ace Hardware or Walmart sometimes has it. You may need to buy the fixture for it too. I dont know what type of fixture you have.

Also i put the link to the video i mentioned in the sources section if it helps.