Hello,
I am creating the Notebook in Jupyter where I have created the data frame(using python kernel-pyspark), from data frame I created temp view(df.createOrReplaceTempView(“df_table”)). Then in new cell I am using %%sql magic command however it is getting failed with below error message.
I have installed ipython-sql, but still getting error. But this works in Databricks community edition notebook.
Please help on this.
df1=spark.read.parquet("recon_history.snappy.20221027.parquet")
df1.createOrReplaceTempView("df_table")
In new cell:
%%sql
select * from df_table
**ERROR:**
UsageError: Cell magic `%%sql` not found