Breaking News: Grepper is joining You.com. Read the official announcement!

pyspark when

Add Answer

Innocent Iguana answered on July 14, 2022 Popularity 5/10 Helpfulness 7/10

answer pyspark when

related when pyspark

related pyspark when condition

pyspark when

Comment

from pyspark.sql.functions import when
df.select("*",when(df.value == 1, 'one').when(df.value == 2, 'two').otherwise('other').alias('value_desc')).show()
# Alternative
from pyspark.sql.functions import expr 
df.withColumn("value_desc",expr("CASE WHEN value == 1 THEN  'one' WHEN value == 2 THEN  'two' ELSE 'other' END AS value_desc")).show()

Popularity 5/10 Helpfulness 7/10 Language python

Source: stackoverflow.com

Tags: pyspark python when

Link to this answer
Share Copy Link

Contributed on Feb 22 2024

Innocent Iguana

0 Answers Avg Quality 2/10

Closely Related Answers

when pyspark

Comment

from pyspark.sql.functions import when
df2 = df.withColumn("new_gender", when(df.gender == "M","Male")
                                 .when(df.gender == "F","Female")
                                 .when(df.gender.isNull() ,"")
                                 .otherwise(df.gender))
df2.show()
+-------+------+------+----------+
|   name|gender|salary|new_gender|
+-------+------+------+----------+
|  James|     M| 60000|      Male|
|Michael|     M| 70000|      Male|
| Robert|  null|400000|          |
|  Maria|     F|500000|    Female|
|    Jen|      |  null|          |
+-------+------+------+----------+

Popularity 9/10 Helpfulness 7/10 Language python

Source: sparkbyexamples.com

Tags: pyspark

Link to this answer
Share Copy Link

Contributed on Jul 14 2022

Cristian Agudelo

0 Answers Avg Quality 2/10

pyspark when condition

Comment

df = df.withColumn("outcome", F.when(F.col("v1") == 0, 1)
      .when(F.col("v1") >0, 2)
      .otherwise(0))

Popularity 8/10 Helpfulness 3/10 Language whatever

Source: stackoverflow.com

Tags: pyspark

Link to this answer
Share Copy Link

Contributed on Jan 26 2023

Busy Buffalo

0 Answers Avg Quality 2/10

pyspark when

Contents

More Related Answers

pyspark when

Closely Related Answers

when pyspark

pyspark when condition

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.