DEV Community

Cover image for BeautifulSoup: REPLACEMENT CHARACTER
YURII DE.
YURII DE.

Posted on • Edited on

BeautifulSoup: REPLACEMENT CHARACTER

#python #beautifulsoup

BeautifulSoup: Some characters could not be decoded, and were replaced with REPLACEMENT CHARACTER

Use UnicodeDammit, more https://www.crummy.com/software/BeautifulSoup/bs4/doc/#unicode-dammit

self.bs = BeautifulSoup(
    UnicodeDammit(
        content, 
        ["latin-1", "iso-8859-1", "windows-1251"]
    ).unicode_markup,
    "html.parser")
Enter fullscreen mode Exit fullscreen mode

Top comments (0)

Read next

blamsa0mine profile image

Interactive DataFrame Management with Streamlit Fragments ๐Ÿš€

A0mineTV -

98ip profile image

Python crawler practice: using 98ip proxy IP to obtain cross-border e-commerce data

98IP ไปฃ็† -

highcenburg profile image

How to Add Quotes and Commas to Each Line in a Text File Using Python

Vicente G. Reyes -

szabgab profile image

Python ๐Ÿ and variable types

Gabor Szabo -