Sarbecoviruses such as SARS and SARS-CoV-2 have been responsible for two major outbreaks in humans, the latter resulting in a global pandemic. While sarbecoviruses primarily cause an acute respiratory infection, they have been shown to infect the nervous system. However, mechanisms of sarbecovirus neuroinvasion and neuropathogenesis remain unclear. In this study, we examined the infectivity and trans-synaptic transmission potential of the sarbecoviruses SARS and SARS-CoV-2 in human stem cell-derived neural model systems. We demonstrated limited ability of sarbecoviruses to infect and replicate in human stem cell-derived neurons. Furthermore, we demonstrated an inability of sarbecoviruses to transmit between synaptically connected human stem cell-derived neurons. Finally, we determined an absence of SARS-CoV-2 infection in olfactory neurons in experimentally infected ferrets. Collectively, this study indicates that sarbecoviruses exhibit low potential to infect human stem cell-derived neurons, lack an ability to infect ferret olfactory neurons, and lack an inbuilt molecular mechanism to utilise retrograde axonal trafficking and trans-synaptic transmission to spread within the human nervous system.