Python Developer

I am having some troubles reading the following CSV data in UTF-16: FullName, FullLabel, Type TEST.… Read more How To Read Csv File With Additional Comma In Quotes Using Pyspark?

Error being faced in PySpark: pyspark.sql.utils.AnalysisException: 'cannot resolve '`result… Read more Cannot Resolve Column Due To Data Type Mismatch Pyspark

I need to drop a table in SQL Database using Azure Databricks (PySpark). I am required to not use a… Read more Drop Table In Sql Database From Azure Databricks

I have sample input dataframe as below, but the value (clm starting with m) columns can be n number… Read more How To Select Columns Using Dynamic Select Query Using Window Function

I have 2 dataframes A(35 Million records) and B(30000 records) A |Text | ------- | pqr | ------- |… Read more Pyspark Crossjoin Between 2 Dataframes With Millions Of Records

I have the following PySpark DataFrame: id col1 col2 A 2 3 A 2 4 A 4 6 … Read more How To Stack Two Columns Into A Single One In Pyspark?

I have sample input dataframe as below, but the value (clm starting with m) columns can be n number… Read more How To Select Columns Using Dynamic Select Query Using Window Function