Depression is a genuine medical condition characterized by lethargy, suicidal thoughts, trouble in concentrating, and a general state of disarray. It is both a "biological brain disorder" and a psychological state of the mind. The World Health Organization (WHO) estimates over 280 million people worldwide suffer from depression, regardless of their culture, caste, religion, or their whereabouts. Depression affects the way a person thinks, speaks, or communicates with the outside world. The key objective of this study was to try to identify and use those differences in linguistics in Reddit posts to determine if a person may be suffering from depressive disorders. This paper proposes novel Natural Language Processing (NLP) techniques and Machine Learning approaches to train and evaluate the models. The proposed textual context-aware depression detection methodology consists of a hybrid transformer network consisting of Bidirectional Encoder Representations from Transformers (BERT) and Bidirectional Long Short-Term Memory (Bi-LSTM) with a Multi Layered Perceptron (MLP) attached in the end to classify depression indicative texts that can achieve incredible results in terms of accuracy - 0.9548, precision - 0.9706, recall - 0.9745 and F1 score - 0.9725.