DEV Community: Marius Teufelweich

Sharing the WWW with a remote host that has no internet connection

Marius Teufelweich — Thu, 07 Sep 2023 13:58:12 +0000

Recently I had the following issue with my Turtlebots: They are only connected to a local network without a route to an uplink with internet connection. This is okay as I just want them to communicate with other ROS2 devices inside the local network. But sometimes I want to update or install a new package with apt or pip. Usually the Turtlebot/Pi would need a internet connection for this. But inside this local network only my notebook has internet access through a different network interface. I could use the notebook as a router but I don't want to get into the hassle of doing this, as network stuff with ROS2 is already complex enough.

But there is another way to achieve this communication from the Turtlebot to the WWW via my notebook: the SOCKS5 proxy.

SSH SOCKS5 proxy

When I ssh onto the Turtlebot (remotehost) I can use the -R option to open a SOCKS5 proxy port on the remotehost which forwards the communication to my notebook.

With ssh -R 1080 user@remotehost I open the connection on the default SOCKS5 port.

We can check if the proxy works with curl --socks5-hostname localhost http://captive.apple.com which should return:

<HTML><HEAD><TITLE>Success</TITLE></HEAD><BODY>Success</BODY></HTML>

The --socks5-hostname is especially important here, as this forwards the DNS resolving on to the notebook, where as --socks5 would try to resolve it on the remotehost (which can't do it because it has no internet connection).

APT

Now we have to tell apt to use this proxy. For this we have to add a config to /etc/apt/apt.conf.d/ and write Acquire::http::proxy "socks5h://localhost:1080"; into it.
This one liner does it:

echo "Acquire::http::proxy "socks5h://localhost:1080";"  | sudo tee -a /etc/apt/apt.conf.d/12proxy

(You can remove the port, as 1080 is the default one, but I like it more explicit as it doesn't hurt inside such config files)
As with curl it is important to use Acquire::http::proxy and not Acquire::socks::proxy with socks5h and not socks5 as only the combination used above forwards the DNS resolving to the notebook.

Now you can happily run sudo apt update and you should see something like:
0% [Connecting to SOCKS5h proxy (socks5h://localhost:1080)]

pip

Out of the box, pip can't use SOCKS sockets. We first have to install pysocks. We could do this by downloading it with curl or scp the file from the notebook, but the more convenient way would be to install it with apt (this isn't ideal, but bootstrapping never is):
sudo apt install python3-socks

Now we can install any python package with pip:
pip install --proxy socks5h://localhost:1080 <package>

tsocks for everything else

If I would have other software that I want to connect via the SOCKS5 socket, but doesn't bring support for it, I would try using tsocks.

pipewire on Linux Mint 21.1

Marius Teufelweich — Wed, 19 Apr 2023 16:19:51 +0000

Though pipewire-pulse is finally available on Linux Mint 21.1, it's not straight forward to install and use piperwire.

To me (with Cinnamon), pipewire came installed and I tried all the guides (Mint Forum, PipeWire Guide) I could find, but there were some catches:

/etc/pipewire/ isn't created during install, you need to copy it from /usr/share/pipewire Artix Forum
(maybe we don't have to copy it at all or can place it locally as the configs are suggesting)
thanks to this I've found out, that pipewire-media-sessions is outdated now and one should use wireplumber.
Installing it with apt install wireplumber and enabling it with systemctl enable --now --force --user wireplumber resolved it (--force was necessary because the pipewire-media-session symlink was still existent Failed to enable unit: File /local/marius/.config/systemd/user/pipewire-session-manager.service already exists and is a symlink to /usr/lib/systemd/user/pipewire-media-session.service.)
you don't need to create the /usr/share/pipewire/media-session.d/with-pulseaudio file

Workflow for recording a talk and post-processing it

Marius Teufelweich — Fri, 24 Mar 2023 09:42:58 +0000

Capture screen and in-build notebook microphone during talk with OBS
Cut the video to the desired length with Kdenlive. Export as h264 for maximum end-user compatibility
Upload recording to auphonic.com for automated processing (volume leveling -> pretty clean audio, speech recognition -> subtitles)
Correct generated subtitles with Subtitle Composer (latest git development version for WebVTT (.vtt) support)
Export subtitles as SubRip (.srt) with Suptitle Composer
Translate the .srt with deepl.com by opening the file with a text editor and copying twenty captions at a time for translation (auto translation from Subtitle Composer was not working for me). Save the translations in a new .srt
Embed the subtitles with ffmpeg with the following command (taken from bannerbear.com)

ffmpeg -i input.mp4 -i subtitle.en.srt -i subtitle.chi.srt -map 0 -map 1 -map 2 -c copy -c:s mov_text -metadata:s:s:0 language=eng -metadata:s:s:1 language=chi output_eng_chi.mp4
Share :)