Breaking News: Grepper is joining You.com. Read the official announcement!

when pyspark

Cristian Agudelo answered on July 14, 2022 Popularity 9/10 Helpfulness 7/10

answer when pyspark

related pyspark when

when pyspark

Comment

from pyspark.sql.functions import when
df2 = df.withColumn("new_gender", when(df.gender == "M","Male")
                                 .when(df.gender == "F","Female")
                                 .when(df.gender.isNull() ,"")
                                 .otherwise(df.gender))
df2.show()
+-------+------+------+----------+
|   name|gender|salary|new_gender|
+-------+------+------+----------+
|  James|     M| 60000|      Male|
|Michael|     M| 70000|      Male|
| Robert|  null|400000|          |
|  Maria|     F|500000|    Female|
|    Jen|      |  null|          |
+-------+------+------+----------+

Popularity 9/10 Helpfulness 7/10 Language python

Source: sparkbyexamples.com

Tags: pyspark python when

Link to this answer
Share Copy Link

Contributed on Jul 14 2022

Cristian Agudelo

0 Answers Avg Quality 2/10

Closely Related Answers

pyspark when

Comment

from pyspark.sql.functions import when
df.select("*",when(df.value == 1, 'one').when(df.value == 2, 'two').otherwise('other').alias('value_desc')).show()
# Alternative
from pyspark.sql.functions import expr 
df.withColumn("value_desc",expr("CASE WHEN value == 1 THEN  'one' WHEN value == 2 THEN  'two' ELSE 'other' END AS value_desc")).show()

Popularity 4/10 Helpfulness 8/10 Language python

Source: stackoverflow.com

Tags: pyspark python when

Link to this answer
Share Copy Link

Contributed on Feb 22 2024

Innocent Iguana

0 Answers Avg Quality 2/10

when pyspark

Contents

More Related Answers

when pyspark

Closely Related Answers

pyspark when

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.