For python, visual studio code has some of this integration. It still runs a jupyter kernel, but will run "cells" directly from your source code file (where the cells are delimited by "# %%" comments) and output to a separate pane with a jupyter-driven repl in it.
I accidentally discovered this after exporting a jupyter notebook to python and opening it in vscode.
I accidentally discovered this after exporting a jupyter notebook to python and opening it in vscode.