“Debug Cell” of a Jupyter notebook in VSC does not work if underlying Python is from Anaconda.
Reason is that Anaconda distributes debugpy 1.5.1
Issue is fixed once debugpy 1.6.6 is installed - but this is only available from conda-forge with conda install -c conda-forge debugpy=1.6.6
I guess Anaconda distribution needs updating 
Stefan