Skip to content
Advertisement

Tag: data-profiling

Not able to perform operations on resulting dataframe after “join” operation in PySpark

Here I have created three dataframes: df,rule_df and query_df. I’ve performed inner join on rule_df and query_df, and stored the resulting dataframe in join_df. However, when I try to simply print the columns of the join_df dataframe, I get the following error- The resultant dataframe is not behaving as one, I’m not able to perform any dataframe operations on it.

Advertisement