How can the number of columns in a PySpark dataframe be calculated using Python?

edit

The number of columns in a PySpark dataframe can be calculated using the .count() function in Python. Here's an example:

from pyspark.sql import SparkSession

# initialize Spark
spark = SparkSession.builder.appName("column_count").getOrCreate()

# create a PySpark dataframe
data = [("John", 25, "Male"), ("Jane", 30, "Female"), ("Bob", 20, "Male")]
df = spark.createDataFrame(data, ["Name", "Age", "Gender"])

# count the number of columns
num_columns = len(df.columns)

print("Number of columns in dataframe:", num_columns)

Output:

Number of columns in dataframe: 3