Are you afraid to talk to God?
Is talking to your pastor more comfortable for you than talking directly to God through prayer? Exodus 20:19 tells us that the Israelites had the same hang up.
"the people were afraid and trembled, and they stood far off and said to Moses, "You speak to us, and we will listen; but do not let God speak to us, lest we die."
Moses was touchable and tangible. He looked like them and had weaknesses like them. God.. well He was mysterious and powerful. People often fear what they don't understand. The solution, avoid God and just deal with what you know - the middle man.
Don't let the fear of a what you don't know keep you from the experience of who you could know - who you should know!
You don't have to be afraid to talk directly to God. The Bible tells us to come to God with boldness.
"So then, since we have a great High Priest who has entered heaven, Jesus the Son of God, let us hold firmly to what we believe. This High Priest of ours understands our weaknesses, for he faced all of the same testings we do, yet he did not sin. So let us come boldly to the throne of our gracious God. There we will receive his mercy, and we will find grace to help us when we need it most."
Jesus came to earth and experienced life as a human. He fully understands your struggles and your weaknesses. As a pastor, I love to talk with the people God puts in my life but I am definitely not qualified to replace Him. I'm here to help you, encourage you, and show you the way to Him, not to myself.
Don't wander the halls of faith, afraid to knock on God's door and ask for some time alone. God has an open door policy and He's waiting for you to come and see Him.