Understanding causal reasoning behind decision making of RL agents is vital for enhancing trust and adaptability in real-world scenarios. Several factors influence the decision-making process of these agents, including how they perceive the world, utilize their memory in conjunction with perception, and express uncertainties inherent in decision-making. In this talk, I outline the advancements achieved in each of these domains throughout my doctoral research.