Minecraft Performance Help?

I have 3 GB allocated to my minecraft.
As soon as I start up minecraft it just instantly uses all of it in the task manager, I think this is causing lag because I am having quite a bit of it. Any help?

Read more: Minecraft Performance Help?