To battle Confirmation bias try the hardest to think about the disconfirming evidence of the ideas you hold.
Links: Nick Bostrom writes about it in Write Your Hypothetical Apostasy. Also see Inversion by Farnham Street
On the other hand, when relying on observational evidence to get reliable causal inference you have to control for confounders while not controlling for collider’s. link