Sometimes, we need a way to configure the variables from the admin UI of airflow so that we can change the value of that variable whenever required. Instead of digging into code and modify it and then deploy and test…. Continue Reading →
The default base URL of airflow is http://localhost:8080 and because of this, you may get an issue that log files URL is still showing localhost and you have to remove localhost and replace it with your actual domain on which… Continue Reading →
You can run the below commands to stop tracking a file into git. Let’s say we want to remove the data/snapshot.rds file from the git. git rm -r –cached ‘Data/snapshot.rds’ git commit -m “stop tracking Data/snapshot.rds” Happy Coding!!
If you are using airflow in your production environment then you must have come across a requirement to trigger an email if any Dag fails so that you will be notified and fix the issue in the flow. We will… Continue Reading →
To uninstall all the packages in your python virtual environment, run the below command. It will first fetch the list of all the installed packages using pip freeze and then will pass this list to the pip uninstall command. pip… Continue Reading →
Today, we are going to discuss the implementation of copying files from one S3 bucket to another S3 bucket, and both the S3 bucket has different credentials. We will go step by step to implement this and then will explain… Continue Reading →
You may have seen the version number like X.Y.Z something like this. This denotes the format MAJOR.MINOR.PATCH, increment. MAJOR version when you make incompatible API changes, MINOR version when you add functionality in a backwards compatible manner, and PATCH version… Continue Reading →
It is really difficult to type the full command in the terminal when we can autocomplete it by just typing the initial few characters and then pressing the tab. So to enable the autocomplete feature for git commands in the… Continue Reading →
If you want to use your external hard drive in both windows and Mac OS then we need to change the format of the hard drive. I am using WD hard drive that comes with the default NTFS format and… Continue Reading →
Sometimes, it happens that docker takes a lot of spaces when you create images and containers and over the period of time this space takes most of the part of your hard disk so it becomes necessary to clean this… Continue Reading →
© 2024 My Beliefs
Write us at [email protected]
