Heres the deal- if you are a peaceful faction, the only way you can enter conflict is if one of three things happen.
1. You piss off a faction by doing stupid things, and get attacked. This is your fault.
2. You are attacked by noob raiders for no reason. This is not your fault.
3. You are attacked by roleplay bandits. This is not your fault.
Focusing on 2 and 3, these are the conflicts you seem to be complaining about. 2 is an easy fix. Beyond the fact that a #2 enemy faction is typically very weak, and will give up fairly easily, it is also very easy to get powerful factions to help you out, if you are a generally pleasant person that will be grateful. A #3 enemy is more tricky, but still not that hard. If it is a very powerful one, they probably have bigger conflicts to deal with then small peaceful factions, so it's probably not a huge threat anyways. You simply talk to the same big powerful allies that helped you in #2, and provided that they are generally a "lawful" faction in roleplay, they will help you just the same.
Allies, allies, allies. That's the key. Even knowing one or two players that are tanks in PvP will suffice.