Gaining performance and keeping it quiet is very difficult. It seems the Toyota engineers did a good enough job of that from the start. The car was really marketed to middle aged folks like me. Someone who wanted to be able to accelerate quickly when needed but needed to be very comfortable and quiet. Oddly enough, when I selected the car, that was one of the selling points. Couldn't hear it run, couldn't feel it shift.
Somewhere along the line all that changed

! The real power restriction with the car is its breathing. As soon as you start to open up the breathing restrictions, you get noise. Weather its the intake or exhaust.
Getting more power is a fairly simple equation, you need more fuel and air and enough spark to burn it. The fuel is useless if you don't add air so lets start there. The only way to get more air in there quietly under normal load is the sc. Even that makes a kinda gear rattling noise at idle. Most of which is absorbed in that noise/heat blanket under the hood. Under normal driving, the noise is the same. Once you punch the gas though, the high pitch whine comes from the sc - instant respect!
Now for fuel. With the stock 4psi, the ECU will request the extra fuel and the stock fuel system can keep up. If you wanted a safety net, I would consider Jim's fuel upgrade kit (filter and lines). That is all that is needed at that level of boost. With the sc, you'll need to run at least 91 octane fuel. High octane without the sc is a waste, the car doesn't need it.
Spark is very easy. Upgrade to Denso IK-22 plugs. They are a little colder than the stock plugs and will handle the sc better. No need to change the wires, the stock Toyota wires are actually very good quality. The coil packs are very good too.
So as long as you don't touch the intake/exhaust and you do all that, you should be pretty quiet. Trust me though, once you get started, there's no turning back. Next the noise will be welcome and you'll start seeing a side of the car that was overlooked.

-JoeB