Breaking News: Grepper is joining You.com. Read the official announcement!

Please write a piece of python code, use the spacy library, read the txt file, lemmatization all words, count the frequency of all words, output the csv file, and the words are sorted by frequency.

faiyuching answered on July 25, 2023 Popularity 1/10 Helpfulness 1/10

answer Please write a piece of python code, use the spacy library, read the txt file, lemmatization all words, count the frequency of all words, output the csv file, and the words are sorted by frequency.

Please write a piece of python code, use the spacy library, read the txt file, lemmatization all words, count the frequency of all words, output the csv file, and the words are sorted by frequency.

Comment

import spacy
import csv
from collections import Counter

def lemmatize_words(text):
    nlp = spacy.load("en_core_web_sm")
    doc = nlp(text)
    words = [
        token.lemma_.lower()
        for token in doc
        if not token.is_punct and not token.is_space and not token.like_num
    ]
    return words

def count_frequencies(words):
    word_freq = Counter(words)
    return word_freq

def write_to_csv(word_freq, output_file):
    with open(output_file, mode="w", newline="", encoding="utf-8") as csvfile:
        fieldnames = ["Word", "Frequency"]
        writer = csv.DictWriter(csvfile, fieldnames=fieldnames)
        writer.writeheader()

        # Sort words by frequency in descending order
        sorted_words = sorted(word_freq.items(), key=lambda item: item[1], reverse=True)

        for word, freq in sorted_words:
            writer.writerow({"Word": word, "Frequency": freq})

def main(input_file, output_file):
    with open(input_file, mode="r", encoding="utf-8") as file:
        text = file.read()

    words = lemmatize_words(text)
    word_freq = count_frequencies(words)
    write_to_csv(word_freq, output_file)

if __name__ == "__main__":
    input_file_path = "input.txt"  # Replace with the path to your input file
    output_csv_file_path = "output.csv"  # Replace with the desired output CSV file path
    main(input_file_path, output_csv_file_path)

Popularity 1/10 Helpfulness 1/10 Language python

Source: chat.openai.com

Tags: count csv frequency lemmatization output python spacy txt words

Link to this answer
Share Copy Link

Contributed on Jul 25 2023

faiyuching

0 Answers Avg Quality 2/10

Please write a piece of python code, use the spacy library, read the txt file, lemmatization all words, count the frequency of all words, output the csv file, and the words are sorted by frequency.

Contents

More Related Answers

Please write a piece of python code, use the spacy library, read the txt file, lemmatization all words, count the frequency of all words, output the csv file, and the words are sorted by frequency.

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.