Be sure to go with him and watch him and calmly praise him when he goes. Don’t go crazy praising him, or he is liable to stop, just calmly let him know that he is good! It doesn’t matter if it is 100 degrees or 10 below zero; raining or snowing, if you don’t go outside and monitor your puppy, you will not know if or when he is going potty outside which means he is likely to come back inside and go potty.
Put your puppy in a crate or a safe area whenever you can’t supervise him. Always, always remember to take your puppy to his or her potty spot when they have to go! If they’re going in multiple areas, or a wide range, then A) you are more likely to stumble upon an unpleasant surprise while walking around your yard; and B) it’s easier for your puppy to create another potty spot by creating a habit of eliminating somewhere off-limits.
Teach your dog where he SHOULD take his potty breaks, instead of trying to use punishment to teach him where he should NOT go potty. If you focus on what you want him to do, instead of what you don’t want your dog to do, you’ll get faster results. Teaching your dog where it’s OK to go is very important, and one of the reasons why so many people are never successful in potty training their dogs.
Let your new dog gradually earn freedom throughout your home. A common error that many pet parents make is giving their new dog too much freedom too soon. This can easily lead to accidents relating to housetraining and destructive chewing. So, close off doors to unoccupied rooms and use baby gates to section off parts of the house, if necessary. One of the best ways to minimize incidents is to keep your dog tethered to you in the house and by using a crate or doggie safe area when you can’t actively supervise him.
If your dog isn’t giving you an obvious signal that they need to go out (like whining at the door) I suggest teaching them to ring a bell when they need to go outside. Some of the other signs dogs give that they need to go out such as pacing around or circling can be easy to miss if they’re in another room, which is why a noise based signal such as ringing a bell can make things easier.
Taxi your pup for about one month (until the pup is about 3 months old as this should give the pup enough time to develop some bladder and bowel control). By doing so, you will prevent many mistakes. At the same time you will train a stong preference in your pup to eliminate in your chosen spot. The pup will also learn that being picked up gets - kisses !
Lindsay says of this study, "Schilder and Van der Borg (2004) have published a report of disturbing findings regarding the short-term and long- term effects of shock used in the context of working dogs that is destined to become a source of significant controversy ... The absence of reduced drive or behavioral suppression with respect to critical activities associated with shock (e.g., bite work) makes one skeptical about the lasting adverse effects the authors claim to document. Although they offer no substantive evidence of trauma or harm to dogs, they provide loads of speculation, anecdotes, insinuations of gender and educational inadequacies, and derogatory comments regarding the motivation and competence of IPO trainers in its place." 
Every dog needs to learn to walk on a leash. Besides the fact that most areas have leash laws, there will be times when keeping your dog on a leash is for his own safety. Learn how to introduce your dog or puppy to the leash, then teach him how to walk properly on the leash, even beside you on a bike. A loose leash walk teaches your dog not to pull or lunge when on the leash, making the experience more enjoyable for both you and your dog.