rsync - exclude files and folders
rsync - exclude files and folders
rsync is cool. What would be even cooler would be excluding particular files or even a whole folder from the backup process.
That's no problem using the rsync '--exclude' option.
Why?
In the previous article, we looked at backing up files and folders to another server.
This was easily completed but there may well be some time sensitive files that are not needed such as log files. Sure, there are some log files (perhaps Apache logs) that you want to keep but others you won't such as a Ruby on Rails production log.
Perhaps there are files containing your DB password, such as a PHP mysqli connection file. Although needed on the main server, it is not needed on the backup.
A folder I always exclude when completing an rsync on my home folder is the 'sources' directory: I don't need copies of the source code I have download.
Let's see how to exclude that directory.
Single files and folders
The original command was like this:
rsync -e 'ssh -p 30000' -avl --delete --stats --progress demo@123.45.67.890:/home/demo /backup/To exclude the sources directory we simply add the '--exclude' option:
--exclude 'sources'Note: the directory path is relative to the folder you are backing up.
So looking at the original command, I am backing up /home/demo. Adding the name 'sources' to the exclude pattern will exclude the 'home/demo/sources' folder.
As such, the final command would look like this:
rsync -e 'ssh -p 30000' -avl --delete --stats --progress --exclude 'sources' demo@123.45.67.890:/home/demo /backup/The same can be applied to files. I have decided that in addition to the sources folder, I want to exclude the file named 'database.txt' which resides in the public_html folder. So I add this:
--exclude 'public_html/database.txt'So now the command looks like:
rsync -e 'ssh -p 30000' -avl --delete --stats --progress --exclude 'sources' --exclude 'public_html/database.txt' demo@123.45.67.890:/home/demo /backup/Multiple files and folders
Unfortunately, I have a load of files and folders I don't want to backup and adding each one like that will get tedious very quickly.
Not only will it get boring, it will make the command super long and prone to easy mistakes.
That's OK as I can define all the files and folders I want exclude in a single file and have rsync read that.
To do this create a file called 'exclude.txt' on the destination machine (the system you give the rsync command on):
nano /home/backup/exclude.txtDefine
Then define the files and folders you want to exclude from the rsync:
sources public_html/database.* downloads/test/*As you can see, you can define patterns.
The first entry is straight forward. It will exclude any file or folder called 'sources' (remember the path is relative).
The second entry will look int the public_html folder and exclude any files (or folders) that begin with 'database.'. The * at the end indicates a wild card, so 'public_html/database.txt' and 'public_html/database.yaml' will be excluded from the backup.
Using a wildcard, the final entry will exclude the contents of the 'downloads/test/' but still download the folder (in other words, I will end up with an empty 'test' folder).
Final command
Now we have defined what to exclude we can direct rsync to the file with:
--exclude-from '/home/backup/exclude.txt'Note: the path for this file is absolute. You are defining where in the file system rsync should look for the exclude patterns.
So, this time the final command would be:
rsync -e 'ssh -p 30000' -avl --delete --stats --progress --exclude-from '/home/backup/exclude.txt' demo@123.45.67.890:/home/demo /backup/That's better.
Summary
Excluding files from a backup can be time and space saver. They usually include superfluous downloads or files that contain sensitive information such as passwords that just don't need to be in several locations.
Using the exclude-from option allows for easy control over the exclude patterns - you can even define several exclude files and simply point rsync to the one that is convenient.
PickledOnion.
From http://articles.slicehost.com/2007/10/10/rsync-exclude-files-and-folders
2023年1月19日 00:01
Rsync is an incredibly powerful tool that can help you easily exclude certain files and folders when copying data. This is a great feature for those who need cbd for athletes to make sure certain sensitive files are not being copied. With rsync, you can quickly and easily exclude any files or folders that you need to, giving you greater control and peace of mind when transferring data.
2023年12月08日 21:21
I’d ought to seek advice from you here. Which isn’t some thing Which i do! I enjoy reading an article which will make people believe. Also, thanks for allowing me to comment! 玫瑰花
====================
Can I say that of a relief to uncover somebody that actually knows what theyre preaching about on the web. You actually realize how to bring a concern to light and make it crucial. Workout . should check this out and see why side in the story. I cant believe youre not more well-liked as you definitely develop the gift. 開張花籃花牌
=====================
Fantastic! In general My husband and i by no means examine completely articles nonetheless the option you penned this post is purely remarkable which preserved my best rise in popularity of reading through and so i savored the following. 訂花推介
=====================
Imagine you’re witout a doubt inside your university a short time in addition to destin breast augmentation however anyone can’t choose a day. Or perhaps inquiring an individual for a time can be a misery for yourself. As well as, you see that hard that will solution girls along with lacks self-assurance in you. 網上訂花
2023年12月09日 06:00
Youre so cool! I dont suppose Ive read anything such as this before. So nice to uncover somebody by incorporating original applying for grants this subject. realy we appreciate you starting this up. this fabulous website is one thing that is needed on-line, somebody with a little originality. beneficial work for bringing new stuff for the web! amazon
2023年12月26日 07:30
This constantly amazes me exactly how blog owners for example yourself can find the time and also the commitment to keep on composing fantastic blog posts. Your site isexcellent and one of my own ought to read blogs. I simply want to thank you. universitas medan
2024年1月10日 23:30
There are various posts out there near this, I do believe taking there reference could experience made this spot or article really informative. That’s not me expression this information is poor quality. Simply I need to pronounce the fact that info provided here was unique, merely rebuild more near complete, supporting to former information will receive been actually good. The points you have touched listed below are really important, thus I’ll spot many of the information here to make this actually best for entirely the newbie’s here. Thank you this info. Actually helpful! Agencja Reklamowa Gdańsk
==============
Nice blog entre. I really have to say, good work. 網上訂花
==============
you employ a excellent weblog here! do you wish to develop invite posts on my weblog? 訂花推介
==============
When I visit this site there’s new things and improved will be able to study from. Haha I’ve experienced your source code too many times to master how you’re doing things so we could wear them my site. Thanks! I can teach you about methods to easy. 開張花籃花牌
==============
An interesting discussion may be worth comment. I do believe that you ought to write much more about this topic, it might certainly be a taboo subject but usually folks are too few to communicate on such topics. Yet another. Cheers 玫瑰花
==============
This is actually interesting, You’re a particularly proficient article author. I’ve registered with your feed additionally expect finding the fabulous write-ups. Furthermore, I’ve shared your internet-site with our social networks. seiko prospex
==============
oh cool, this information is really useful and definately is comment worthy! hehe. I’ll see if I can try to use some of this information for my own blog. Thanks! seiko watch bands
==============
I’m curious to find out what blog platform you are utilizing? I’m experiencing some small security issues with my latest blog and I would like to find something more safe. Do you have any solutions? seiko skx
==============
I just could not leave your web site before suggesting that I actually enjoyed the standard info an individual provide on your visitors? Is gonna be back regularly in order to check up on new posts. seiko 5 sports gmt
==============
The color of your blog is quite great. i would love to have those colors too on my blog.,*:~- 二手電腦
2024年1月26日 04:11
Following study a few of the articles on your website these types of few days, and that i really much like your style of blogging. I tag this to my personal save website checklist and will likely be checking back quickly. Pls check out my personal website too and tell me your thought. 산타카지노보증
2024年2月15日 11:35
Your blog has the same post as another author but i like your better.*’”,: UAE
=============
When do you think this Real Estate market will go back up? Or is it still too early to tell? We are seeing a lot of housing foreclosures in Winter Springs Florida. What about you? I would love to get your feedback on this. 開張花籃花牌
=============
When visiting blogs, i always look for a very nice content like yours “ 玫瑰花
=============
I am really impressed with your writing abilities neatly as with the layout on your blog. Is that this a paid subject matter or did you modify it your self? Anyway stay up the excellent high quality writing, it is uncommon to see a nice blog like this one today. 訂花
=============
Do you have a spam issue on this website; I also am a blogger, and I was wanting to know your situation; we have created some nice practices and we are looking to trade methods with others, please shoot me an email if interested. 法式花藝
=============
Terrific write-up! Thought about savored the actual scanning. I’m hoping you just read additional by you. There’s no doubt you could have wonderful awareness in addition to ability to see. My corporation is really prompted keeping this particulars. 手機回收
=============
produce,Whitened froth, rather same interest to find area, mild white over a chin, there’s magnificence that the rhythm, and then make a shout might be kinda hot. seiko prospex
=============
Wow, fantastic weblog layout! How lengthy have you been blogging for? you made blogging glance easy. The full glance of your website is excellent, neatly as the content material! seiko watch bands
=============
An impressive share, I just with all this onto a colleague who has been doing little analysis on this. And the man in reality bought me breakfast since I found it for him.. smile. So let me reword that: Thnx for the treat! But yeah Thnkx for spending enough time to debate this, I feel strongly regarding it and really like reading on this topic. If you can, as you become expertise, could you mind updating your blog post with more details? It is highly ideal for me. Huge thumb up in this article! seiko skx
=============
Have you ever considered adding more videos to your blog posts to keep the readers more entertained? I mean I just read through the entire article of yours and it was quite good but since I’m more of a visual learner,I found that to be more helpful well let me know how it turns out! I love what you guys are always up too. Such clever work and reporting! Keep up the great works guys I’ve added you guys to my blogroll. This is a great article thanks for sharing this informative information.. I will visit your blog regularly for some latest post. seiko 5 sports gmt
2024年2月17日 10:28
This would be the right blog for everyone who hopes to learn about this topic. You already know a great deal its virtually not easy to argue to you (not that I really would want…HaHa). You actually put a fresh spin with a topic thats been discussed for decades. Fantastic stuff, just excellent! ZLD SYSTEM MANUFACTURER (ZERO LIQUID DISCHARGE SYSTEM)
-------------------------------------------
Great post. I was checking constantly this blog and I am impressed! Extremely useful info particularly the last part I care for such info a lot. I was seeking this certain info for a long time. Thank you and good luck. .Chlebek Dukana ARSENIC REMOVAL PLANT MANUFACTURER
2024年3月20日 00:01
I am constantly browsing online for content articles that can benefit me personally. Thanks! Download WordPress
2024年3月21日 06:57
This is really interesting, You are a very skilled blogger. I’ve joined your rss feed and look forward to seeking more of your magnificent post. Also, I’ve shared your site in my social networks! 開張花籃花牌
======================
This web-site is often a walk-through its the data you wanted concerning this and didn’t know who to inquire about. Glimpse here, and you’ll undoubtedly discover it. 玫瑰花
======================
Your blog never ceases to amaze me, it is very well written and organized.”\"*”- 訂花
======================
It’s always good to see it from a different perspective My experience confirms that. I have to think about it some more. Can you expand on this? 法式花藝
======================
Thanks for another informative blog. The place else may I get that type of information written in such an ideal approach? I’ve a project that I’m simply now running on, and I’ve been on the look out for such info. iphone trade in
======================
Your understanding definitely fills a necessity. I’ve been wanting to locate this type of article and you truly came through. Can you believe that that which you have written just about accurately duplicates my own experience. seiko prospex
======================
This is the fitting weblog for anybody who desires to seek out out about this topic. You notice a lot its virtually arduous to argue with you (not that I really would want…HaHa). You undoubtedly put a new spin on a subject thats been written about for years. Nice stuff, just great! seiko watch bands
======================
The the next occasion Someone said a blog, I hope who’s doesnt disappoint me approximately this place. After all, It was my substitute for read, but I just thought youd have some thing interesting to convey. All I hear can be a handful of whining about something that you could fix when you werent too busy searching for attention. seiko skx
======================
There are a couple of interesting points soon enough in this post but I don’t know if I see these people center to heart. You can find some validity but I’ll take hold opinion until I consider it further. Good post , thanks and we want much more! Combined with FeedBurner also seiko 5 sports gmt
2024年3月28日 00:27
Many thanks for making the effort to discuss this, I feel strongly about this and like learning a great deal more on this topic. If feasible, as you gain expertise, would you mind updating your webpage with a great deal more details? It’s really beneficial for me. Tech
============================
enoyed the read, well i didnt cause i didnt agree but well explained. Tech
2024年3月30日 09:17
Thanks for this post, I am a big big fan of this site would like to keep updated. najlepszy klub piłkarski
=======================
The next occasion I read a weblog, I am hoping that this doesnt disappoint me just as much as this. I mean, Yes, it was my substitute for read, but I just thought youd have something fascinating to talk about. All I hear can be a bunch of whining about something that you could fix when you werent too busy searching for attention. Clean black money in Africa
2024年4月12日 04:54
I just extra this particular give food to to my book marks. I must say, I truly take pleasure in reading the weblogs. Continue the good work! Yep Marketing Agency