I like to add the lookahead:

  grep -oP '(?<=...)pattern(?=...)'

The caveat however is that the look{ahead,behind} pattern has to be of fixed length.