i am currently trying to run a python script that navigate on the web with selenium and get the html of the product page on a web site and then do scraping to collect info. The info are stored in a database mariadb. I am on a Rasberry pi 5 on Ubuntu, the version of Chromium is Chromium 134.0.6998.88 snap and the version of the chromedriver is ChromeDriver 134.0.6998.88 (7e3d5c978c6d3a6eda25692cfac7f893a2b20dd0-refs/branch-heads/6998@{#1898}). As the title said i can't run the script without getting the error:
Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir
Stacktrace:
#0 0xaaaadab81694 <unknown>
#1 0xaaaada6b58a4 <unknown>
#2 0xaaaada6e89c8 <unknown>
#3 0xaaaada6e51a4 <unknown>
#4 0xaaaada72a0b8 <unknown>
#5 0xaaaada729944 <unknown>
#6 0xaaaada6f0b84 <unknown>
#7 0xaaaadab4fd28 <unknown>
#8 0xaaaadab531d8 <unknown>
#9 0xaaaadab3f5e4 <unknown>
#10 0xaaaadab53854 <unknown>
#11 0xaaaadab276d0 <unknown>
#12 0xaaaadab70980 <unknown>
#13 0xaaaadab70b50 <unknown>
#14 0xaaaadab8048c <unknown>
#15 0xffffa7fad5c4 <unknown>
#16 0xffffa8015ed8 <unknown>
Traceback (most recent call last):
File "/home/realtalker/data_workers/scraping_best/get_info_best.py", line 402, in <module>
driver.quit()
^^^^^^
NameError: name 'driver' is not defined. Did you mean: 'webdriver'?
My chrome options are:
options = Options()
options.add_argument('--no-sandbox')
options.add_argument('--disable-dev-shm-usage')
options.add_argument('--headless=new')
options.add_argument('--disable-gpu')
options.add_argument('--disable-extensions')
options.add_argument('--remote-debugging-port=9222') # Specify a port
options.add_argument('--disable-setuid-sandbox')
options.add_argument("--incognito")
options.add_argument("--disable-application-cache")
options.add_argument("--enable-do-not-track")
options.add_argument("--disable-popup-blocking")
options.binary_location = '/snap/bin/chromium'
service = Service('/usr/bin/chromedriver'
I saw in a github report that maybe there is a problem when running as root, i checked and i am not running as root, i tried to run the chromedriver and:
(.venv) realtalker@ubuntu:~/data_workers/scraping_best$ chromedriver
Starting ChromeDriver 133.0.6943.141 (2a5d6da0d6165d7b107502095a937fe7704fcef6-refs/branch-heads/6943@{#1912}) on port 0
Only local connections are allowed.
Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully on port 42027.
so i checked with ps -aux | grep chromedriver and i got:
realtal+ 167950 4.1 0.1 33614684 13824 pts/2 Sl+ 16:46 0:00 /snap/chromium/3053/usr/lib/chromium-browser/chromedriver
realtal+ 168021 0.0 0.0 6676 1920 pts/1 S+ 16:46 0:00 grep --color=auto chromedriver
then i tried to run the same command to check with chromium before i could get the error and:
realtal+ 168029 14.4 0.1 33622940 14720 pts/2 Sl+ 16:48 0:00 /snap/chromium/3053/usr/lib/chromium-browser/chromedriver --port=60075
realtal+ 168103 0.0 0.0 6676 1920 pts/1 S+ 16:48 0:00 grep --color=auto chromium
IMPORTANT: I am on a raspberry pi 5 that runs ubuntu server (Linux ubuntu 6.8.0-1018-raspi #20-Ubuntu SMP PREEMPT_DYNAMIC Fri Jan 17 12:35:36 UTC 2025 aarch64 aarch64 aarch64 GNU/Linux)
I even tried to launch chromium from the command line:
realtalker@ubuntu:~/data_workers/scraping_best$ /snap/bin/chromium --headless --disable-gpu --remote-debugging-port=9222
[171851:171946:0319/084459.213021:ERROR:object_proxy.cc(576)] Failed to call method: org.freedesktop.DBus.ListActivatableNames: object_path= /org/freedesktop/DBus: org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.23" (uid=1000 pid=171851 comm="/snap/chromium/3053/usr/lib/chromium-browser/chrom" label="snap.chromium.chromium (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus)
X11 connection rejected because of wrong authentication.
[171959:171959:0319/084459.253731:ERROR:angle_platform_impl.cc(44)] DisplayVkXcb.cpp:58 (initialize): xcb_connect() failed, error 1
ERR: DisplayVkXcb.cpp:58 (initialize): xcb_connect() failed, error 1
[171959:171959:0319/084459.255771:ERROR:angle_platform_impl.cc(44)] Display.cpp:1085 (initialize): ANGLE Display::initialize error 12289: Not initialized.
ERR: Display.cpp:1085 (initialize): ANGLE Display::initialize error 12289: Not initialized.
[171851:171946:0319/084459.257144:ERROR:object_proxy.cc(576)] Failed to call method: org.freedesktop.DBus.ListActivatableNames: object_path= /org/freedesktop/DBus: org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.25" (uid=1000 pid=171851 comm="/snap/chromium/3053/usr/lib/chromium-browser/chrom" label="snap.chromium.chromium (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus)
[171959:171959:0319/084459.257431:ERROR:gl_display.cc(495)] EGL Driver message (Critical) eglInitialize: Not initialized.
[171959:171959:0319/084459.259674:ERROR:gl_display.cc(767)] eglInitialize SwANGLE failed with error EGL_NOT_INITIALIZED
[171959:171959:0319/084459.261020:ERROR:gl_display.cc(802)] Initialization of all EGL display types failed.
[171959:171959:0319/084459.261338:ERROR:gl_ozone_egl.cc(26)] GLDisplayEGL::Initialize failed.
X11 connection rejected because of wrong authentication.
DevTools listening on ws://127.0.0.1:9222/devtools/browser/0af8722f-4fb6-4558-893d-01bc49c978e6
[171959:171959:0319/084459.291606:ERROR:angle_platform_impl.cc(44)] DisplayVkXcb.cpp:58 (initialize): xcb_connect() failed, error 1
ERR: DisplayVkXcb.cpp:58 (initialize): xcb_connect() failed, error 1
[171959:171959:0319/084459.291969:ERROR:angle_platform_impl.cc(44)] Display.cpp:1085 (initialize): ANGLE Display::initialize error 12289: Not initialized.
ERR: Display.cpp:1085 (initialize): ANGLE Display::initialize error 12289: Not initialized.
[171959:171959:0319/084459.292095:ERROR:gl_display.cc(495)] EGL Driver message (Critical) eglInitialize: Not initialized.
[171959:171959:0319/084459.292220:ERROR:gl_display.cc(767)] eglInitialize SwANGLE failed with error EGL_NOT_INITIALIZED
[171959:171959:0319/084459.292324:ERROR:gl_display.cc(802)] Initialization of all EGL display types failed.
[171959:171959:0319/084459.292424:ERROR:gl_ozone_egl.cc(26)] GLDisplayEGL::Initialize failed.
[171959:171959:0319/084459.296504:ERROR:viz_main_impl.cc(185)] Exiting GPU process due to errors during initialization
[171851:172048:0319/084459.485882:ERROR:object_proxy.cc(576)] Failed to call method: org.freedesktop.DBus.Properties.Get: object_path= /org/freedesktop/UPower: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
[171851:172048:0319/084459.486640:ERROR:object_proxy.cc(576)] Failed to call method: org.freedesktop.UPower.GetDisplayDevice: object_path= /org/freedesktop/UPower: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
[171851:172048:0319/084459.487404:ERROR:object_proxy.cc(576)] Failed to call method: org.freedesktop.UPower.EnumerateDevices: object_path= /org/freedesktop/UPower: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
[171851:171851:0319/084459.489651:ERROR:object_proxy.cc(576)] Failed to call method: org.freedesktop.DBus.ListActivatableNames: object_path= /org/freedesktop/DBus: org.freedesktop.DBus.Error.AccessDenied: An AppArmor policy prevents this sender from sending this message to this recipient; type="method_call", sender=":1.24" (uid=1000 pid=171851 comm="/snap/chromium/3053/usr/lib/chromium-browser/chrom" label="snap.chromium.chromium (enforce)") interface="org.freedesktop.DBus" member="ListActivatableNames" error name="(unset)" requested_reply="0" destination="org.freedesktop.DBus" (bus)
X11 connection rejected because of wrong authentication.
[172043:172043:0319/084459.527283:ERROR:angle_platform_impl.cc(44)] DisplayVkXcb.cpp:58 (initialize): xcb_connect() failed, error 1
ERR: DisplayVkXcb.cpp:58 (initialize): xcb_connect() failed, error 1
[172043:172043:0319/084459.528824:ERROR:angle_platform_impl.cc(44)] Display.cpp:1085 (initialize): ANGLE Display::initialize error 12289: Not initialized.
ERR: Display.cpp:1085 (initialize): ANGLE Display::initialize error 12289: Not initialized.
[172043:172043:0319/084459.532064:ERROR:gl_display.cc(495)] EGL Driver message (Critical) eglInitialize: Not initialized.
[172043:172043:0319/084459.532936:ERROR:gl_display.cc(767)] eglInitialize SwANGLE failed with error EGL_NOT_INITIALIZED
[172043:172043:0319/084459.533325:ERROR:gl_display.cc(802)] Initialization of all EGL display types failed.
[172043:172043:0319/084459.533495:ERROR:gl_ozone_egl.cc(26)] GLDisplayEGL::Initialize failed.
X11 connection rejected because of wrong authentication.
[172043:172043:0319/084459.566273:ERROR:angle_platform_impl.cc(44)] DisplayVkXcb.cpp:58 (initialize): xcb_connect() failed, error 1
ERR: DisplayVkXcb.cpp:58 (initialize): xcb_connect() failed, error 1
[172043:172043:0319/084459.566815:ERROR:angle_platform_impl.cc(44)] Display.cpp:1085 (initialize): ANGLE Display::initialize error 12289: Not initialized.
ERR: Display.cpp:1085 (initialize): ANGLE Display::initialize error 12289: Not initialized.
[172043:172043:0319/084459.567212:ERROR:gl_display.cc(495)] EGL Driver message (Critical) eglInitialize: Not initialized.
[172043:172043:0319/084459.567754:ERROR:gl_display.cc(767)] eglInitialize SwANGLE failed with error EGL_NOT_INITIALIZED
[172043:172043:0319/084459.568070:ERROR:gl_display.cc(802)] Initialization of all EGL display types failed.
[172043:172043:0319/084459.568351:ERROR:gl_ozone_egl.cc(26)] GLDisplayEGL::Initialize failed.
[172043:172043:0319/084459.578120:ERROR:viz_main_impl.cc(185)] Exiting GPU process due to errors during initialization
The code that now i try to run is a simple one (ignore the import library because i copied from an other code):
[172043:172043:0319/084459.567212:ERROR:gl_display.cc(495)] EGL Driver message (Critical) eglInitialize: Not initialized.
[172043:172043:0319/084459.567754:ERROR:gl_display.cc(767)] eglInitialize SwANGLE failed with error EGL_NOT_INITIALIZED
[172043:172043:0319/084459.568070:ERROR:gl_display.cc(802)] Initialization of all EGL display types failed.
[172043:172043:0319/084459.568351:ERROR:gl_ozone_egl.cc(26)] GLDisplayEGL::Initialize failed.
[172043:172043:0319/084459.578120:ERROR:viz_main_impl.cc(185)] Exiting GPU process due to errors during initialization
The code that now i try to run is a simple one (ignore the import library because i copied from an other code):
from selenium import webdriver
from selenium.webdriver.chrome.service import Service
from selenium.webdriver.chrome.options import Options
from selenium.webdriver.common.by import By
from selenium.webdriver.common.action_chains import ActionChains
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.keys import Keys
from selenium.common.exceptions import TimeoutException, ElementClickInterceptedException
import time
from datetime import date, datetime, timedelta
from bs4 import BeautifulSoup as bs4
import mysql.connector
import re
options = Options()
options.add_argument('--no-sandbox')
options.add_argument('--disable-dev-shm-usage')
options.add_argument('--headless=new')
options.add_argument('--disable-gpu')
options.add_argument('--disable-extensions')
options.add_argument('--remote-debugging-port=9222') # Specify a port
options.add_argument('--disable-setuid-sandbox')
options.add_argument("--incognito")
options.add_argument("--disable-application-cache")
options.add_argument("--enable-do-not-track")
options.add_argument("--disable-popup-blocking")
options.binary_location = '/snap/bin/chromium'
service = Service('/usr/bin/chromedriver')
driver = webdriver.Chrome(service=service, options=options)
driver.get("https://www.google.com")
time.sleep(2)
title = driver.title
print("Title of the page:", title)
driver.quit()
Top comments (0)