I wonder if throwing more compute power like Spark at data projects will encourage these kind of queries to continue, rather than rewriting them with filters and aggregation to perform better.
I've faced many issues with this... Developers are using PySpark and they're blindness writing shitty code. That's a huge problem.
For further actions, you may consider blocking this person and/or reporting abuse
We're a place where coders share, stay up-to-date and grow their careers.
I've faced many issues with this... Developers are using PySpark and they're blindness writing shitty code. That's a huge problem.