Main Points-
-Not enough protein
-Too much carb
-You can't lose weight and gain muscle at the same time- it's one or the other.
Add in more protein and don't eat so many bananas- eggs, chicken, fish should be your main sources of protein.
Bring in more variety of carbs and don't eat more carb than protein during any meal. oatmeal, whole grain breads, lots of fruits and veggies (pineapple especially because it contains an enzyme which assimilates protein efficiently that no other fruit has), rice, pasta.
Good on the cardio but you really should try and lift weights too and not just do calisthenics- though it gives you a good workout. Weights and cardio are a deadly combo.
Sorry my man but one day a week of eating pizza and drinking beer is going to alter a lot of the progress that you would make during the week- especially given the info you provided about yourself. It sucks- but maybe once every 3 or 4 weeks is when you should really do that and if you want it bad enough then you will make the adjustment. It takes time, A LOT of patience and a positive attitude- you'll get there...you just have to adopt it as a lifestyle and know that you can't always see changes but they're taking place once you really take charge.
"Milk is for babies"- Arnold Schwarzenegger