So after having to pull the engine to swap some parts, I have fully concluded that removing flywheel magnets does NOT add a vibration inwhich I previously reported to the forum. My issue was a spring washer that somehow got turned sideways when installing the engine after completing a alternator conversion (yes I didn't have to do this but it's easy enough for me)
