One annoying thing about installing apps from outside the Google Play Store is that they don't auto-update. It's a pain to download a new APK and reinstall it to get the updated version every time.