Make a list of all the bills and expenses accrued by your business; it may not be long, and that's great. The less overhead you are dealing with, the better, and working from a home office is a great way to keep the overhead down. There are inevitable costs, however, whether it is internet service, computer repairs, office supplies, long-distance charges, or specialized supplies for the type of business you run. If your work involves a tangible product, you'll have inventory costs to think about.
Most suppliers, vendors, etc., have methods of online payment available. Set up online payments with your business credit card. If one of your payees doesn't have an online method of payment, simply give them a call and ask about setting up automatic payments with your business credit card. Most businesses/individuals won't turn down the chance to have their monthly payments guaranteed by a particular date.