The microbiota plays an essential role in the education, development, and function of the immune system, both locally and systemically. Emerging experimental and epidemiological evidence highlights a crucial cross-talk between the intestinal microbiota and the lungs, termed the 'gut-lung axis'. Changes in the constituents of the gut microbiome, through either diet, disease or medical interventions (such as antibiotics) is linked with altered immune responses and homeostasis in the airways. The importance of the gut-lung axis has become more evident following the identification of several gut microbe-derived components and metabolites, such as short-chain fatty acids (SCFAs), as key mediators for setting the tone of the immune system. Recent studies have supported a role for SCFAs in influencing hematopoietic precursors in the bone marrow-a major site of innate and adaptive immune cell development. Here, we review the current understanding of host-microbe cross-talk along the gut-lung axis. We highlight the importance of SCFAs in shaping and promoting bone marrow hematopoiesis to resolve airway inflammation and to support a healthy homeostasis.