The chemokine CXCL12 is essential for the function of hematopoietic stem and progenitor cells. Here we report that secretion of functional CXCL12 from human bone marrow stromal cells (BMSCs) was a cell contact–dependent event mediated by connexin-43 (Cx43) and Cx45 gap junctions. Inhibition of connexin gap junctions impaired the secretion of CXCL12 and homing of leukocytes to mouse bone marrow. Purified human CD34⁺ progenitor cells did not adhere to noncontacting BMSCs, which led to a much smaller pool of immature cells. Calcium conduction activated signaling by cAMP–protein kinase A (PKA) and induced CXCL12 secretion mediated by the GTPase RalA. Cx43 and Cx45 additionally controlled Cxcl12 transcription by regulating the nuclear localization of the transcription factor Sp1. We suggest that BMSCs form a dynamic syncytium via connexin gap junctions that regulates CXC12 secretion and the homeostasis of hematopoietic stem cells.