You’ll need SSH access, and remember to back up first!
Of course, if you want to never have to bother with updating Joomla or your extensions ever again, you can try a fully managed Joomla service like Simplweb. Real staff go through updates line by line to make sure there is nothing there that might break your site, or 3rd party extensions.
Compass Designs 