Selenium 4 / Python

Tomás Vírseda — Wed, 27 May 2020 22:07:52 +0000

Hi there,

Yesterday, after more than one year without working in one of my pet projects, I cloned the repository in a new Ubuntu desktop 20.04

Most of the GUI code worked out, but it wasn't the case for the Selenium bits. So I decided to take a closer look, and then, I realized that Selenium python bindings had been updated from the stable version 3.141.0 to the new pre-release 4.0.0a5

After many tries, I was only getting these messages:

DeprecationWarning: executable_path has been deprecated, please pass in a Service object

DeprecationWarning: firefox_profile has been deprecated, please pass in a Service object

So, I took a look to the source code and, finally, I was able to solve the issue:

#!/usr/bin/env python3
# -*- coding: utf-8 -*-

from selenium import webdriver
from selenium.webdriver.firefox.service import Service
from selenium.webdriver.firefox.options import Options

# Options
options = Options()

## Option for using a custom Firefox profile
options.profile = '/home/t00m/.basico/opt/webdrivers/basico.default'

## Enable headless
options.headless = False

# Specify custom geckodriver path
service = Service('/home/t00m/.basico/opt/webdrivers/geckodriver')

# Test
browser = webdriver.Firefox(options=options, service=service)
browser.get('https://dev.to')
print(browser.title)
browser.quit()

Bonus track

My application needs to load a page via SSO. In the past, I used a timeout. Now, I keep the timeout but I've added the following code to skip it if it loads the page faster:

# Extra imports
from selenium.common.exceptions import TimeoutException
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.by import By

# Test
timeout = 10
browser = webdriver.Firefox(options=options, service=service)
browser.get('https://dev.to')

try:
    element_present = EC.presence_of_element_located((By.ID, 'snack-zone'))
    WebDriverWait(browser, timeout).until(element_present)
except TimeoutException:
    print("Timed out waiting for page to load")
finally:
    print("Page loaded")
print(browser.title)
browser.quit()

Take care. Stay safe.

KB4IT

Tomás Vírseda — Wed, 13 Nov 2019 22:02:25 +0000

Introduction

KB4IT is a static website generator based on Asciidoctor sources mainly for technical documentation purposes.

KB4IT stands for Knowledge Base for IT.

Taking advantage of the user-defined attributes feature in Asciidoctor, KB4IT can parse Asciidoctor sources, extract all metadata available and create something similar to a wiki. In this way, all information provided by the user can be easily related.

Please, note that the application is still under development. However, I use it in my day to day for my own documentation repository.

I'd be very grateful if you could test it and tell me your opinion.

Demo

Before continue reading the details, you might take a look to a demo to have an idea of what is this project all about.

Motivations

The main aim is to provide an easy way to write technical documentation.

Don’t care about the formatting and focus on the contents.
To allow teams to manage their knowledge database easily.
Do not depend on third software products like word processors or complex web applications.

Features

Pros

Easy to write technical documentation

Documents must be in Asciidoctor format which is easy to learn.

For each document published, there is its corresponding Asciidoctor source. So you can use it as a template to write another document without spending too much time.

Easy to find documentation

Each document has properties which can be browsed. These property pages use filters.

Moreover, there is a search entry to filter results by writing some of the letters of the title.

Easy to publish documentation

All documents you write are compiled/converted to HTML files.

Just put them in any folder and point your browser to:

/target/path/index.html
c:\target\path\index.html

However, you can upload/copy them to your own web server.

Easy to backup/restore documentation

Just backup your sources directory and restore them in another PC or server. Use the KB4IT application to compile them again.

Of course, you can backup the target directory with all the html files and resources and it will work anywhere.

Serverless

There is no need for a web server. Of course, you can use one if you please.

KB4IT was designed to work in mixed environments where people use shared folders (Eg.: Windows shares or directories mounted by NFS).

Smart compiling

Only those documents added or modified are compiled. It reduces drastically the amount of time and CPU needed to generate the website.

To achieve this, KB4IT uses a cache. If the cache is deleted or missing, the whole repository is compiled again.

To speed up the compilation, KB4IT uses threading. By default, it launches 30 threads in parallel. So, please, be aware of this feature, as it will eat all CPU available until the compilation finishes.

Cons

No online editor.
There is no dynamic search (search is based on static filters generated each time a page is compiled).
KB4IT doesn't work on Windows due a limitation with the length of parameters passed (sad but true)

Dependencies

Python
Asciidoctor
UIKit (bundled with KB4IT)

License

The code is licensed under the terms of the GPL v3 so you're free to grab, extend, improve and fork the code as you want.

Download

You can donwload the source code in GitHub:

t00m / KB4IT

KB4IT is a static website generator based on Asciidoctor sources mainly for technical documentation purposes.

About KB4IT

Introduction

KB4IT is a static website generator based on Asciidoctor sources mainly for technical documentation purposes.

You can see some demos here: https://github.com/t00m/kb4it-adocs

Motivations

The main aim is to provide an easy way to write my technical documentation.
Don’t care about the formatting and focus on the contents.
To allow teams to manage their knowledge database easily.
Do not depend on third software products like word processors or complex web applications.

Features

Pros

Writing documentation: Documents must be in Asciidoctor format which is easy to learn.
Finding documents: Once a document is converted to html, properties can be browsed. Moreover, property pages have filters and a search entry to filter by title.
Publishing your repository: all necessary files are inside a directory. Browse it or copy it to your web server.
Serverless: There is no need for a web server. Of course, you can use one if you…

View on GitHub

DEV Community: Tomás Vírseda

Selenium 4 / Python

KB4IT

Introduction

Demo

Motivations

Features

Pros

Cons

Dependencies

License

Download

t00m / KB4IT

KB4IT is a static website generator based on Asciidoctor sources mainly for technical documentation purposes.

About KB4IT

Introduction

Motivations

Features

Pros