Louis Russell’s first-half strike proved the difference as the Reds were on the wrong end of a 1-0 preliminary round defeat.
It continued Fareham’s inconsistent start this term, with boss Stiles far from satisfied with a return of one win from five matches in all competitions.
The Reds boss acknowledged he must turn things around quickly and get his side firing again.
But he was particularly disappointed by the showing his squad served up on such a big occasion in the illustrious FA Cup.
Stiles fumed: ‘It’s annoying because I love the FA Cup and we didn’t do ourselves justice and let ourselves down on the day.
‘We’ll train twice this week, we’ll have it out, see where we are and move on from there.
‘I’ve got to turn this around, our start just isn’t good enough, we’ve won one game out of four and we’re out of the FA Cup – it’s not good enough.
‘We were not at it at all, certain players’ attitudes were wrong, ones who…