Project Talk:Infrastructure/Rsync

From Gentoo Wiki
Jump to:navigation Jump to:search
Note
This is a Talk page - please see the documentation about using talk pages. Add newer comments below older ones, sign comments using four tildes (~~~~), and indent successive comments with colons (:). Add new sections at the bottom of the page, under a heading (== ==). Please remember to mark sections as "open for discussion" using {{talk|open}}, so they will show up in the list of open discussions.

Question about excluding distfiles from rsync

Talk status
This discussion is done.

Here:

Offline Install, how to check and log as emerge installs? http://forums.gentoo.org/viewtopic-p-7527608.html#7527608

I mention how it is not really a solution to have this kind of local rsync mirror.

Actually I wonder what is the rationale behind

/etc/rsyncd.conf

...[snip]...

exclude=distfiles/ packages/

Actually I understand packages may need to be excluded. But pls. why excluding the distfiles?

On a system of mine I have:

$ du -hs /usr/portage/

18G /usr/portage/

$

of which:

$ du -hs /usr/portage/distfiles/

17G /usr/portage/distfiles/

$

So what's the benefit for a network to spare the bandwith in not going online for the, true, slow syncing of text files (ebuilds and associates), but having to go online for the distfiles? Those may be slow, but are still less of a download that the distfiles: 1G to 17G, roughly.

Why exclude distfiles/ directory from rsyncing locally?

Or did I miss something?

On an afterthought, maybe here:

/etc/portage/mirrors

/etc/portage/mirrors

gives the solution, that is having distfiles being fetched not by rsync, but in a different manner...

It'd be a good thing to mention that in the article then. If noone else does, I'll do it, but in my next spare time.

Miroslav Rovis Zagreb, Croatia www.CroatiaFidelis.hr

— Preceding unsigned comment added by MiroR (talkcontribs)

Gentoo has separate rsync (=ebuild) and distfile mirrors on purpose: You need every ebuild while you certainly don't need every distfile (or can't even have fetch or mirror restricted ones). This guide explicitly talks about the former type of mirror.
A general note: Please sign your comments using ~~~~ and try to use less vertical space, for instance by using the appropriate templates for your terminal output (see Help:Contents#Templates) —a3li 11:42, 1 April 2014 (UTC)