How to Save PySpark Dataframe to a Single Output File

Save a Spark dataframe to a single output csv file

August 27 2023  ·  6 min

How to search and replace across multiple files using Vim

Vim commands to search and replace in files across your entire project

How to use allure-pytest and allure-pytest-bdd in the same project

Dealing with pytest plugins with conflicting command line arguments

How to mock sending SMTP emails using PyTest

Use pytest-mock to mock sending SMTP emails during your unittests

February 28 2023  ·  13 min

How to save the output of PySpark DataFrame 'show' to a variable

There is no obvious way to save the nicely formatted DataFrame show() string to a variable. But here is how you can do it

Top tips for using PyTest

Top tips for using PyTest

November 19 2022  ·  11 min

Unit testing PySpark code using Pytest

How to unit test PySpark code using Pytest

October 29 2022  ·  12 min

How to set up Logging for Python Projects

Improve your data science projects with logging instead of using print statements

Pytest: How to use fixtures as arguments in parametrize

Using fixtures in parametrized pytest tests

How to Always Enable Autoreloading of Modules in iPython

Update your iPython configuration to automatically enable auto-reloading of modules