Python count word in text

In this tutorial, you’ll learn how to use Python to count the number of words and word frequencies in both a string and a text file. Being able to count words and word frequencies is a useful skill. For example, knowing how to do this can be important in text classification machine learning algorithms.

By the end of this tutorial, you’ll have learned:

• How to count the number of words in a string
• How to count the number of words in a text file
• How to calculate word frequencies using Python

Reading a Text File in Python

The processes to count words and calculate word frequencies shown below are the same for whether you’re considering a string or an entire text file. Because of this, this section will briefly describe how to read a text file in Python.

If you want a more in-depth guide on how to read a text file in Python, check out this tutorial here. Here is a quick piece of code that you can use to load the contents of a text file into a Python string:

# Reading a Text File in Python
file_path = '/Users/datagy/Desktop/sample_text.txt'

with open(file_path) as file:
    text = file.read()

I encourage you to check out the tutorial to learn why and how this approach works. However, if you’re in a hurry, just know that the process opens the file, reads its contents, and then closes the file again.

Count Number of Words In Python Using split()

One of the simplest ways to count the number of words in a Python string is by using the split() function. The split function looks like this:

# Understanding the split() function
str.split(
   sep=None     # The delimiter to split on
   maxsplit=-1  # The number of times to split
)

By default, Python will consider runs of consecutive whitespace to be a single separator. This means that if our string had multiple spaces, they’d only be considered a single delimiter. Let’s see what this method returns:

# Splitting a string with .split()
text = 'Welcome to datagy! Here you will learn Python and data science.'
print(text.split())

# Returns: ['Welcome', 'to', 'datagy!', 'Here', 'you', 'will', 'learn', 'Python', 'and', 'data', 'science.']

We can see that the method now returns a list of items. Because we can use the len() function to count the number of items in a list, we’re able to generate a word count. Let’s see what this looks like:

# Counting words with .split()
text = 'Welcome to datagy! Here you will learn Python and data science.'
print(len(text.split()))

# Returns: 11

Count Number of Words In Python Using Regex

Another simple way to count the number of words in a Python string is to use the regular expressions library, re. The library comes with a function, findall(), which lets you search for different patterns of strings.

Because we can use regular expression to search for patterns, we must first define our pattern. In this case, we want patterns of alphanumeric characters that are separated by whitespace.

For this, we can use the pattern w+, where w represents any alphanumeric character and the + denotes one or more occurrences. Once the pattern encounters whitespace, such as a space, it will stop the pattern there.

Let’s see how we can use this method to generate a word count using the regular expressions library, re:

# Counting words with regular expressions
import re
text = 'Welcome to datagy! Here you will learn Python and data science.'
print(len(re.findall(r'w+', text)))

# Returns: 11

Calculating Word Frequencies in Python

In order to calculate word frequencies, we can use either the defaultdict class or the Counter class. Word frequencies represent how often a given word appears in a piece of text.

Using defaultdict To Calculate Word Frequencies in Python

Let’s see how we can use defaultdict to calculate word frequencies in Python. The defaultdict extend on the regular Python dictionary by providing helpful functions to initialize missing keys.

Because of this, we can loop over a piece of text and count the occurrences of each word. Let’s see how we can use it to create word frequencies for a given string:

# Creating word frequencies with defaultdict
from collections import defaultdict
import re

text = 'welcome to datagy! datagy will teach data. data is fun. data data data!'

counts = defaultdict(int)
for word in re.findall('w+', text):
    counts[word] += 1

print(counts)

# Returns:
# defaultdict(<class 'int'>, {'welcome': 1, 'to': 1, 'datagy': 2, 'will': 1, 'teach': 1, 'data': 5, 'is': 1, 'fun': 1})

Let’s break down what we did here:

1. We imported both the defaultdict function and the re library
2. We loaded some text and instantiated a defaultdict using the int factory function
3. We then looped over each word in the word list and added one for each time it occurred

Using Counter to Create Word Frequencies in Python

Another way to do this is to use the Counter class. The benefit of this approach is that we can even easily identify the most frequent word. Let’s see how we can use this approach:

# Creating word frequencies with Counter
from collections import Counter
import re

text = 'welcome to datagy! datagy will teach data. data is fun. data data data!'
counts =  Counter(re.findall('w+', text))
print(counts)

# Returns:
# Counter({'data': 5, 'datagy': 2, 'welcome': 1, 'to': 1, 'will': 1, 'teach': 1, 'is': 1, 'fun': 1})

Let’s break down what we did here:

1. We imported our required libraries and classes
2. We passed the resulting list from the findall() function into the Counter class
3. We printed the result of this class

One of the perks of this is that we can easily find the most common word by using the .most_common() function. The function returns a sorted list of tuples, ordering the items from most common to least common. Because of this, we can simply access the 0th index to find the most common word:

# Finding the Most Common Word
from collections import Counter
import re

text = 'welcome to datagy! datagy will teach data. data is fun. data data data!'
counts =  Counter(re.findall('w+', text))
print(counts.most_common()[0])

# Returns:
# ('data', 5)

Conclusion

In this tutorial, you learned how to generate word counts and word frequencies using Python. You learned a number of different ways to count words including using the .split() method and the re library. Then, you learned different ways to generate word frequencies using defaultdict and Counter. Using the Counter method, you were able to find the most frequent word in a string.

Additional Resources

To learn more about related topics, check out the tutorials below:

• Python str.split() – Official Documentation
• Python Defaultdict: Overview and Examples
• Python: Count Number of Occurrences in List (6 Ways)
• Python: Count Number of Occurrences in a String (4 Ways!)

Data preprocessing is an important task in text classification. With the emergence of Python in the field of data science, it is essential to have certain shorthands to have the upper hand among others. This article discusses ways to count words in a sentence, it starts with space-separated words but also includes ways to in presence of special characters as well. Let’s discuss certain ways to perform this.

Quick Ninja Methods: One line Code to find count words in a sentence with Static and Dynamic Inputs.

Output:

Method #1: Using split() split function is quite useful and usually quite generic method to get words out of the list, but this approach fails once we introduce special characters in the list. 

The original string is : Geeksforgeeks is best Computer Science Portal
The number of words in string are : 6

Method #2 : Using regex(findall()) Regular expressions have to be used in case we require to handle the cases of punctuation marks or special characters in the string. This is the most elegant way in which this task can be performed. 

Example

The original string is : Geeksforgeeks, is best @# Computer Science Portal.!!!
The number of words in string are : 6

Method #3 : Using sum() + strip() + split() This method performs this particular task without using regex. In this method we first check all the words consisting of all the alphabets, if so they are added to sum and then returned. 
 

The original string is : Geeksforgeeks, is best @# Computer Science Portal.!!!
The number of words in string are : 6

Method #4: Using count() method

The original string is : Geeksforgeeks is best Computer Science Portal
The number of words in string are : 6

Method #5 : Using the shlex module:

Here is a new approach using the split() method in shlex module:

The shlex module provides a lexical analyzer for simple shell-like syntaxes. It can be used to split a string into a list of words while taking into account quotes, escapes, and other special characters. This makes it a good choice for counting words in a sentence that may contain such characters.

Note: The shlex.split function returns a list of words, so you can use the len function to count the number of words in the list. The count method can also be used on the list to achieve the same result.

Method #6: Using operator.countOf() method

The original string is : Geeksforgeeks is best Computer Science Portal
The number of words in string are : 6

The time complexity of this approach is O(n), where n is the length of the input string. 
The Auxiliary space is also O(n), as the shlex.split function creates a new list of words from the input string. This approach is efficient for small to medium-sized inputs, but may not be suitable for very large inputs due to the use of additional memory.

Method #7:Using reduce()

1. Initialize a variable res to 1 to account for the first word in the string.
2. For each character ch in the string, do the following:
   a. If ch is a space, increment res by 1.
3. Return the value of res as the result.

The original string is : Geeksforgeeks is best Computer Science Portal
The number of words in string are : 6

The time complexity of the algorithm for counting the number of words in a string using the count method or reduce function is O(n), where n is the length of the string. This is because we iterate over each character in the string once to count the number of spaces.

The auxiliary space of the algorithm is O(1), since we only need to store a few variables (res and ch) at any given time during the execution of the algorithm. The space required is independent of the length of the input string.

Method #8: Using  numpy:

Algorithm:

1. Initialize the input string ‘test_string’
2. Print the original string
3. Use the numpy ‘char.count()’ method to count the number of spaces in the string and add 1 to it to get the count of words.
4. Print the count of words.

Output:
The original string is : Geeksforgeeks is best Computer Science Portal
The number of words in string are : 6

Time complexity: O(n)
The time complexity of the ‘char.count()’ method is O(n), where n is the length of the input string. The addition operation takes constant time. Therefore, the time complexity of the code is O(n).

Auxiliary Space: O(1)
The space complexity of the code is constant, as we are not using any additional data structures or variables that are dependent on the input size. Therefore, the space complexity of the code is O(1).

1. Используйте методы split() и len() для подсчета слов в строке Python
2. Используйте модуль RegEx для подсчета слов в строке Python
3. Используйте методы sum(), strip() и split() для подсчета слов в строке Python
4. Используйте метод count() для подсчета слов в Python String Python

Из этого туториала Вы узнаете, как считать слова в строковом Python.

Используйте методы split() и len() для подсчета слов в строке Python

split() — это встроенный в Python метод, который разделяет слова внутри строки с помощью определенного разделителя и возвращает массив строк. Этот метод принимает в качестве аргумента не более двух параметров:

• separator (необязательно) — действует как разделитель (например, запятые, точка с запятой, кавычки или косая черта). Задает границу, на которой нужно разделить строку. По умолчанию разделителем является любой пробел (пробел, новая строка, табуляция и т. Д.), Если separator не указан.
• maxsplit (необязательно) — определяет максимальное количество разделений. Значение по умолчанию maxsplit, если не определено, равно -1, что означает, что он не имеет ограничений и разбивает строку на несколько частей.

Синтаксис split():

str.split(separator, maxsplit)

len () также является встроенным методом Python, который возвращает количество строк в массиве или подсчитывает длину элементов в объекте. Этот метод принимает только один параметр: строку, байты, список, объект, набор или коллекцию. Он вызовет исключение TypeError, если аргумент отсутствует или недействителен.

Синтаксис len():

Посмотрим, как методы split() и len() подсчитывают количество слов в строке.

Пример 1: без параметров

# initialize string
text = 'The quick brown fox jumps over the lazy dog'

# default separator: space
result = len(text.split())

print("There are " + str(result) + " words.")

Выход:

Пример 2: С параметром separator

# initialize string
bucket_list = 'Japan, Singapore, Maldives, Europe, Italy, Korea'

# comma delimiter
result = len(bucket_list.split(','))

# Prints an array of strings
print(bucket_list.split(','))

print("There are " + str(result) + " words.")

Выход:

['Japan', ' Singapore', ' Maldives', ' Europe', ' Italy', ' Korea']
There are 6 words.

Метод split() вернет новый список строк, а len() считает строку внутри списка.

Пример 3: С параметрами separator и maxsplit

# initialize string
bucket_list = 'Japan, Singapore, Maldives, Europe, Italy, Korea'

# comma delimiter
result = len(bucket_list.split(',', 3))

# Prints an array of strings
print(bucket_list.split(',', 3))

print("There are " + str(result) + " words.")

Выход:

['Japan', ' Singapore', ' Maldives', ' Europe, Italy, Korea']
There are 4 words.

maxsplit разделяет только первые три запятые в bucket_list. Если вы установите maxsplit, в списке будет элементmaxsplit+1.

Выход:

['Japan', ' Singapore', ' Maldives, Europe, Italy, Korea']
There are 3 words.

Метод split() разбивает большие строки на более мелкие. Следовательно, подсчет слов в массиве строк будет основан не на словах, а на том, как определен разделитель.

Используйте модуль RegEx для подсчета слов в строке Python

Регулярное выражение, сокращенно regex или regexp, — очень мощный инструмент для поиска и управления текстовыми строками; это можно использовать для предварительной обработки данных, проверки, поиска шаблона в текстовой строке и т. д. Regex также может помочь в подсчете слов в текстовой строке в сценариях, где есть знаки препинания или специальные символы, которые не нужны. Regex — это встроенный в Python пакет, поэтому нам просто нужно импортировать пакет re, чтобы начать его использовать.

# import regex module
import re

# initialize string
text = 'Python !! is the be1st $$             programming language @'

# using regex findall()
result = len(re.findall(r'w+', text))

print("There are " + str(result) + " words.")

Выход:

Используйте методы sum(), strip() и split() для подсчета слов в строке Python

Этот подход считает слова без использования регулярного выражения. sum(), strip() и split() — все это встроенные методы в Python. Мы кратко обсудим каждый метод и его функции.

Метод sum() складывает элементы слева направо и возвращает сумму. Метод принимает два параметра:

• iterable (обязательно) — строка, список, кортеж и т. Д. Для суммирования. Это должны быть числа.
• start (необязательно) — число, добавляемое к сумме или возвращаемому значению метода.

Синтаксис sum():

Следующим является метод strip(), который возвращает копию строки без начальных и конечных пробелов, если нет аргументов; в противном случае это удаляет строку, определенную в аргументе.

• chars (необязательно) — указывает строку, которую нужно удалить из левой и правой частей текста.

Синтаксис string.strip():

Наконец, метод split() уже обсуждался до этого подхода.

Теперь давайте используем эти методы вместе для подсчета слов в строке. Во-первых, нам нужно импортировать строку, встроенный модуль Python, прежде чем использовать его функции.

import string

# initialize string
text = 'Python !! is the be1st $$             programming language @'

# using the sum(), strip(), split() methods
result = sum([i.strip(string.punctuation).isalpha() for i in text.split()])

print("There are " + str(result) + " words.")

Выход:

Используйте метод count() для подсчета слов в Python String Python

Метод count() — это встроенный в Python метод. Он принимает три параметра и возвращает количество вхождений на основе данной подстроки.

• substring (обязательно) — ключевое слово для поиска в строке
• start (опция) — указатель начала поиска
• stop (опция) — указатель того, где заканчивается поиск

Примечание. В Python индекс начинается с 0.

Синтаксис count():

string.count(substring, start, end)

Этот метод отличается от предыдущего, поскольку он возвращает не общее количество слов, найденных в строке, а количество найденных вхождений для данной подстроки. Посмотрим, как работает этот метод, на примере ниже:

# initialize string
text = "Python: How to count words in string Python"
substring = "Python"

total_occurrences = text.count(substring)

print("There are " + str(total_occurrences) + " occurrences.")

Выход:

В этом методе не имеет значения, является ли подстрока целым словом, фразой, буквой или любой комбинацией символов или цифр.

Таким образом, вы можете выбрать любой из этих подходов в зависимости от вашего варианта использования. Для слов, разделенных пробелами, мы можем использовать простой подход: функции split() или len(). Для фильтрации текстовых строк для подсчета слов без специальных символов используйте модуль regex. Создайте шаблон, в котором подсчитываются слова, не содержащие определенных символов. Без использования regex используйте альтернативу, которая представляет собой комбинацию методов sum() + strip() + split(). Наконец, метод count() также может использоваться для подсчета конкретного слова, найденного в строке.

Strings are essential data types in any programming language, including python. We need to perform many different operations, also known as string preprocessing like removing the unnecessary spaces, counting the words in a string, making the string in the same cases (uppercase or lowercase). In this article, we will learn how to count words in a string in python. 

We will learn how to count the number of words in a string. For example- We have a string-” Hello, this is a string.” It has five words. Also, we will learn how to count the frequency of a particular word in a string. 

• Count Words Using For loop- 
• Using split() to count words in a string
• Count frequency of words in a string using a dictionary
• Count frequency of words in string Using Count() 

1. Count Words Using For loop- 

Using for loop is the naïve approach to solve this problem. We count the number of spaces between the two characters. 

<pre class="wp-block-syntaxhighlighter-code">def count_words(string):
    # Removing the spaces from start and end
    string1=string.strip()
    # Initializing the count from 1 because we there is no space at the last 
    count=1
    # <a href="https://www.pythonpool.com/python-iterate-through-list/" target="_blank" rel="noreferrer noopener">Iterating</a> through the string
    for i in string1:
    # If we encounter space, increment the count with 1.
        if i==" ":
            count+=1
     
    return count
string="Python is an interpreted, high-level, general-purpose programming language"
print("'{}'".format(string),"has total words:",count_words(string))
string2=" Hi. My name is Ashwini "
print("'{}'".format(string2),"has total words:",count_words(string2))</pre>

Output- 

''Python is an interpreted, high-level, general-purpose programming language' has total words: 8'' 
Hi. My name is Ashwini ' has total words: 5 

2. Using split() to count words in a string

We can use split() function to count words in string. 

def word_count(string):
    # Here we are removing the spaces from start and end,
    # and breaking every word whenever we encounter a space
    # and storing them in a list. The len of the list is the
    # total count of words.
    return(len(string.strip().split(" ")))

string="Python is an interpreted, high-level, general-purpose programming language"
print("'{}'".format(string),"has total words:",count_words(string))
string2=" Hi. My name is Ashwini "
print("'{}'".format(string2),"has total words:",word_count(string2))

Output- 

''Python is an interpreted, high-level, general-purpose programming language' has total words: 8'' 
Hi. My name is Ashwini ' has total words: 5 

3. Count the frequency of words in a String in Python using Dictionary

<pre class="wp-block-syntaxhighlighter-code">def wordFrequency(string):
    # converting the string into lowercase
    string=string.lower()
    # Whenever we encounter a space, break the string
    string=string.split(" ")
    # Initializing a dictionary to store the frequency of words
    word_frequency={}
    # <a href="https://www.pythonpool.com/python-iterate-through-list/" target="_blank" rel="noreferrer noopener">Iterating</a> through the string
    for i in string:
    
    # If the word is already in the keys, increment its frequency
        if i in word_frequency:
            word_frequency[i]+=1
            
    # It means that this is the first occurence of the word
        else:
            word_frequency[i]=1
    return(word_frequency)
string="Woodchuck How much wood would a woodchuck chuck if a woodchuck could chuck wood ?" 
print(wordFrequency(string)) </pre>

Output- 

{'woodchuck': 3, 'how': 1, 'much': 1, 'wood': 2, 'would': 1, 'a': 2, 'chuck': 2, 'if': 1, 'could': 1, '?': 1} 

4. Count frequency of words in string in Python Using Count() 

Count() can be used to count the number of times a word occurs in a string or in other words it is used to tell the frequency of a word in a string. We just need to pass the word in the argument.  

def return_count(string,word):
    string=string.lower() 
    # In string, what is the count that word occurs
    return string.count(word)

string2="Peter Piper picked a peck of pickled peppers. How many pickled peppers did Peter Piper pick?"
return_count(string2,'piper')

Output- 

2 

If we want to know the number of times every word occurred, we can make a function for that. 

set1=set()
string="Woodchuck How much wood would a woodchuck chuck if a woodchuck could chuck wood ?"
string=string.lower()
# splitting the string  whenever we encounter a space
string=string.split(" ")
# iterate through list-string
for i in string:
    # Storing the word and its frequency in the form of tuple in a set
    # Set is used to avoid repetition
    set1.add((i,string.count(i)))
print(set1)

Output- 

{('how', 1), ('would', 1), ('woodchuck', 3), ('a', 2), ('chuck', 2), ('could', 1), ('if', 1), ('?', 1), ('wood', 2), ('much', 1)} 

If we want to know how many times a particular word occur in a string in an interval, we can use start and end parameters of count(). 

For example- 

string="Can you can a can as a canner can can a can?"
# if you want to take cases into account remove this line
string=string.lower()
# between index=8 and 17, how many times the word 'can' occurs
print(string.count("can",8,17))

Output- 

2 

Must Read

• How to Convert String to Lowercase in
• How to Calculate Square Root
• User Input | Input () Function | Keyboard Input
• Best Book to Learn Python

Conclusion 

In the current era, data is very important. And as the world of Data Science is growing rapidly, and that too using python, data preprocessing is very important. We need to count words in a string in python to preprocess textual data and for that, the above-discussed methods are very important. 

Try to run the programs on your side and let us know if you have any queries.

Happy Coding!

In this Python tutorial, we will learn about Python Count Words in File. Here we assume the file as a simple Text file (.txt). Also, we will cover these topics.

• Python Count Words in File
• Python Count Specific Words in File
• Python Count Words in Multiple Files
• Python Count Unique Words Files
• Python Count Words in Excel File
• Python Count Unique Words in Text File
• Python Program to Count Number of Words in File
• Python Count Word Frequency in a File
• Python Word Count CSV File

In this section, we will learn about python count words in file. In other words, we will learn to count the total number of words from a text file using Python.

• The entire process is divided into three simple steps:
  • open a text file in read only mode
  • read the information of file
  • split the sentences into words and find the len.
• Using file = open('file.txt', 'r') we can open the file in a read-only mode and store this information in a file variable.
• read_data = file.read() this statement is used to read the entire data in one go and store it in a variable named read_data.
• It’s time to split the sentences into words and that can be done using
  per_word = read_data.split() here split() method is used to split each sentence in read_data and all this information is stored in a variable named per_word.
• final step is to print the length of per_word variable. Please note that lenght is counting total words in the file. Here is the statement to print a message with total count of words print('Total Words: ', len(per_word)).

Source Code:

Here is the source code to implement the Python Count Words in a File.

file = open('file.txt', 'r')
read_data = file.read()
per_word = read_data.split()

print('Total Words:', len(per_word))

Output:

Here is the output of counting words in a file using Python. In this output, the text file we have used has 221 words.

Read: Python Counter

Python Count Specific Words in File

In this section, we will learn about Python Count Specific Words in File. The user will provide any word and our program will display the total occurrence of that word.

• Occurrence of specific word can be counted in 5 simple steps:
  • Ask for user input
  • Open the file in read only mode
  • Read the data of the file
  • convert the data in lower case and count the occurrence of specific word
  • Print the count
• seach_word_count = input('Enter the word') in this code, user input is collected and stored in a variable. Whatever word user will iput here that word will be searched in a file.
• file = open('file.txt', 'r') in this code file.txt is a file that is opened in a read only mode and the result is stored in a ‘file’ variable.
• Once we have opened a file, next step is to read the data in it so using the code read_data = file.read() we have read the entire data and stored the information in a variable named ‘read_data’.
• word_count = read_data.lower().count(search_word_count) In this code, we have converted the data to lower case and using count method we have searched for the word that user has provided. The entire result is stored in a variable named ‘word_count’.
• Last step in the process is to print the message with count. We have used formatted string to make our message descriptive. Here is the code for that.
  print(f"The word '{search_word_count}' appeard {word_count} times.")

Source Code

Here is the complete source code to perform python count specific words in a file.

# asking for user input
search_word_count = input('Enter the word: ')

# opening text file in read only mode
file = open("file.txt", "r")

# reading data of the file
read_data = file.read()

# converting data in lower case and the counting the occurrence 
word_count = read_data.lower().count(search_word_count)

# printing word and it's count
print(f"The word '{search_word_count}' appeared {word_count} times.")

Output:

Here is the output of Python Count Specific Word in a File. In this output, we searched for the word ‘the’ in a text file. The result showed that ‘the’ has appeared 4 times in a text file.

Read: Python get all files in directory

Python Count Words in Multiple Files

In this section, we will learn about Python Count Words in Multiple Files. We have three text files that we are going to use and we will count words from all of these files.

• Counting words from multiple files can be done in five easy steps:
  • import glob module in Python
  • create an empty list to store text files and a counter with 0 as default value.
  • start a loop, recognize the text file using glob and add it to emty list we created in previous step.
  • start another loop on that empty list, total number of files will decide the number of times loop will run. Each time loop runs a file is opened, read, splitted in words and then length of total words in added to words variable.
  • In the end print the word variable with descriptive message.
• glob is used to return all file with a specific extension. Since we need all the files with .txt extension so we have used glob here.
• text_file=[] this empty list will store all the files with .txt extension. word=0 this will keep a track of all the words in multiple files.

for file in glob.glob("*.txt"):
    txt_files.append(file)

• In this code, we have started a loop and glob is used to scan all the files with .txt extension.
• each file is added to an empty list. So everytime loop runs a filename from the current folder having txt extension is added to an empty list.

for f in txt_files:
    file = open(f, "r")
    read_data = file.read()
    per_word = read_data.split()
    words += len(per_word)

• In this code we have started a loop on the empty list because not that empty list has all the text files in it.
• Each time loop runs a file is opened, read, all the sentences are splitted in words and total count of words are added to a variable.
• In this way lets say file one has 20 words and file two has 30 then the words variable will show 50 (20+30) words in the end of the loop.
• print('Total Words:',words) total words are printed with descriptive message.

Source Code:

Here is the source code to implement Python Count Words in Multiple Files.

import glob

# empty list and variable
txt_files = []
words = 0

# loop to add text files to a list
for file in glob.glob("*.txt"):
    txt_files.append(file)

# loop to read, split and count word of each file
for f in txt_files:
    file = open(f, "r")
    read_data = file.read()
    per_word = read_data.split()
    words += len(per_word)

# print total words in multiple files
print('Total Words:',words)

Output:

Here is the output of the above source code to implement Python Count Words in Multiple Files.

Read: Python dictionary of lists

Python Count Unique Words in a File

In this section, we will learn about Python Count Unique Words in a File. The python program will check the occurrences of each word in a text file and then it will count only unique words in a file.

• Using Python we can count unique words from a file in six simple steps:
  • create a counter and assign default value as zero
  • open a file in read only mode.
  • read the data of file
  • split the data in words and store it in a set
  • start a for loop and keep on incrementing the counter with each word.
  • Ultimately, print the counter
• count = 0 is the counter with default value set to zero. This counter will increment later.
• file = open("names.txt", "r") in this code we are opening a text file in a read-only mode and information is stored in a file variable.
• read_data = file.read() in this code, we are reading the data stored in a file.
• words = set(read_data.split()) In this code, we have split the data and also we have removed the duplicate values. Set always keep only unique data.
• we have started a for loop on total words and each time the loop runs it adds one to the counter. So if there are 35 unique words then loop will run 35 times and counter will have 35.
• In the end, count is printed as an output.

Source Code:

Here is the source code for implementing Python Count Unique Words in a File.

count = 0
file = open("names.txt", "r")
read_data = file.read()
words = set(read_data.split())
for word in words:
    count += 1
    
print('Total Unique Words:', count)

Output:

Here is the output of a program to count unique words in a file using Python. In this output, we have read a file and it has 85 unique words in it.

Read: Python Dictionary to CSV

Python Count Words in Excel File

In this section, we will learn about Python Count Words in Excel File.

• The best way to count words in excel files using python is by using Pandas module in python.
• you need to install pandas on your device

# anaconda 
conda install pandas

# pip
pip install pandas

• Using df.count() method in pandas we can count the total number of words in a file with columns.
• Using df.count().sum() we can get the final value of total words in a file.
• Here is the implementation on Jupyter Notebook.

Read: Pandas in Python

Python Count Unique Words in Text File

n this section, we will learn about Python Count Unique Words in a File. The python program will check the occurrences of each word in a text file and then it will count only unique words in a file.

• Using Python we can count unique words from a file in six simple steps:
  • create a counter and assign default value as zero
  • open a file in read only mode.
  • read the data of file
  • split the data in words and store it in a set
  • start a for loop and keep on incrementing the counter with each word.
  • Ultimately, print the counter
• count = 0 is the counter with default value set to zero. This counter will increment later.
• file = open("names.txt", "r") in this code we are opening a text file in a read-only mode and information is stored in a file variable.
• read_data = file.read() in this code, we are reading the data stored in a file.
• words = set(read_data.split()) In this code, we have split the data and also we have removed the duplicate values. Set always keep only unique data.
• we have started a for loop on total words and each time the loop runs it adds one to the counter. So if there are 35 unique words then loop will run 35 times and counter will have 35.
• In the end, count is printed as an output with the descriptive message.

Source Code:

Here is the source code to implement Python Count Unique Words in Text File.

count = 0
file = open("names.txt", "r")
read_data = file.read()
words = set(read_data.split())
for word in words:
    count += 1
    
print('Total Unique Words:', count)

Output:

Here is the output of a program to count unique words in a file using Python. In this output, we have read a file and it has 85 unique words in it.

Read: Python Pandas CSV

Python Program to Count Number of Words in File

In this section, we will learn about python count words in files. In other words, we will learn to count the total number of words from a text file using Python.

• The entire process is divided into three simple steps:
  • open a text file in read only mode
  • read the information of file
  • split the sentences into words and find the len.
• Using file = open('file.txt', 'r') we can open the file in a read-only mode and store this information in a file variable.
• read_data = file.read() this statement is used to read the entire data in one go and store it in a variable named read_data.
• It’s time to split the sentences into words and that can be done using
  per_word = read_data.split() here split() method is used to split each sentence in read_data and all this information is stored in a variable named per_word.
• final step is to print the length of per_word variable. Please note that lenght is counting total words in the file. Here is the statement to print a message with total count of words print('Total Words: ', len(per_word)).

Source Code:

Here is the source code to implement the Python Count Words in a File.

file = open("file.txt", "r")
read_data = file.read()
per_word = read_data.split()

print('Total Words:', len(per_word))

Output:

Here is the output of counting words in a file using Python. In this output, the text file we have used has 221 words.

Read: Python built-in functions 

Python Count Word Frequency in a File

In this section, we will learn about Python Count Word Frequency in a File. In other words, we will count the number of times a word appeared in the file.

• Frequency of each word can be counted in 3 simple steps in Python.
  • Import counter from collections module in python.
  • create a function that accepts filename, inside the function open the file, read the data and split sentences to words. and keep all of these inside the counter method.
  • call the function and print it with descriptive message.
• In this we have imported Counter from collections. Counter holds the data in key-vaue format. Dictionary format would be best to display name and their occurrences.
• in the function count_word(), we have opened the textfile and then returned each word with their total occurrences
• In the end we have called the function and print it with descriptive message.

Source Code:

Here is the source code to implement Python Count Word Frequency in a File.

from collections import Counter

def count_word(file_name):
        with open(file_name) as f:
                return Counter(f.read().split())

print("Frequency :",count_word("names.txt"))

Output:

In this output, each word is displayed with their total occurrences in Python.

Read: Get current directory Python

Python Word Count CSV File

In this section, we will learn about Python Word Count in CSV files.

• The best way to count words in excel files using python is by using Pandas module in python.
• you need to install pandas on your device.

# anaconda 
conda install pandas

# pip
pip install pandas

• df.count()method in pandas we can count the total number of words in a file with columns.
• Using df.count().sum() we can get the final value of total words in a file.
• Here is the implementation on Jupyter Notebook.

You may also like to read the following articles.

• Create an empty array in Python
• Python find index of element in list
• Python Array with Examples
• Hash table in python
• If not condition in python
• Python create empty set
• Python find number in String

In this tutorial, we have learned about Python Count Words in File. Also, we have covered these topics.

• Python Count Words in File
• Python Count Specific Words in File
• Python Count Words in Multiple Files
• Python Count Unique Words Files
• Python Count Words in Excel File
• Python Count Unique Words in Text File
• Python Program to Count Number of Words in File
• Python Count Word Frequency in a File
• Python Word Count CSV File