Try starting a square on one of the edge pegs. Look at all the other pegs in turn - could you use that peg as the second corner of a square?
Can you make a square whose edges aren't parallel to the rows or columns of pegs?