Weak walls make for weak castles.
If your personal boundaries (your castle walls) are thin, have holes, or are possibly made of cardboard and wishes; then you are in for a rocky road.
Here is how to build a strong fortress with a drawbridge that you can raise and lower as you see fit!