One of the biggest mistakes new puppy owners make is expecting their puppy to hold it for longer than he is physically capable. The general guideline for puppy “hold times” is that each month of age equates to an hour of “hold time,” so a two-month-old puppy can hold it for roughly two hours. There are exceptions to the rule; your puppy should be able to hold it for slightly longer period of time at night as he gets older and you pup will need potty breaks more frequently when he’s playing.
Consistency is crucial. This may mean taking time off work to be there to take the pup outside every 20-30 minutes when they are awake. Crate training will also help the 'penny drop' as it teaches the pup to hold on until taken outside. Then, be sure to stay with the pup in the yard so you are there to reinforce how clever they are when they do go in the right place.