Connecting to Databricks SQL Warehouses using SQLAlchemy
I have been tasked recently to connect a Python Flask application to a Databricks SQL Warehouse using SQLAlchemy. As a good practice, I wrote a simple Threading wrapper around the query execution to time out the query if it takes too long to avoid wasting resources. Imagining that setting the timeout like this would be enough, I noticed that queries were left hanging in the cluster and not being killed....