What's the One Script You Wrote That You Still Use Every Day?

#python #programming #productivity #discuss

I'll go first.

Three years ago I wrote a 20-line Python script that watches a folder for new CSV files, deduplicates them, and moves the clean version to Dropbox.

I wrote it in 15 minutes. It has saved me roughly 200 hours since then.

import time
from pathlib import Path
import pandas as pd
import shutil

watch = Path('~/Downloads').expanduser()
done = Path('~/Dropbox/clean-data').expanduser()
done.mkdir(exist_ok=True)
seen = set()

while True:
    for f in watch.glob('*.csv'):
        if f.name not in seen:
            df = pd.read_csv(f).drop_duplicates()
            df.to_csv(done / f.name, index=False)
            seen.add(f.name)
            print(f'Cleaned: {f.name} ({len(df)} rows)')
    time.sleep(10)