[wp-hackers] Load Balancing | Media Uploads to Multiple Servers

[Steve Pellham]

Thanks for the responses.  RSYNC is the solution that we were looking into,
but my concern is the update frequency.   It would be overly simple to sync
the directories once per day, but if the sync is not immediate, the concern
is that a post would render without its associated images.    I'm looking
for a real-time upload sync solution where the files are pushed out to 1 or
more remote servers as the file is uploaded.

Therefore the question about a plugin that triggers the file push as content
is uploaded, I'm envisioning something like this.

1. create new post
2. upload image - this should trigger a server process (rsync, ssh, scp,
rsh, rcp) that pushes the file to additional servers real-time.
3. view post on any available servers (with full content, images, etc..) in
the LB pool.

I understand that a nightly sync may work in cases where backup servers were
used strictly for failover, but not in a real-time load balancing scenario
where all servers should have updated content at the time (or very shortly
after) it was uploaded.

We will have to build a solution for this both inside and external of WP
anyway since the site is custom and WP only runs our blog.




On Wed, Jul 29, 2009 at 9:20 AM, Tim Schoffelman <tim at silentgap.com> wrote:

> We have a current system that does this very thing. Basically, the servers
> we run are using a *nix type OS and we just RSYNC the wp-content/uploads
> directory w/ our backups. This solution has worked really well for us.
> We've
> messed around with a few other plugin ideas, but found that this one suited
> our needs the best. I'm interested in seeing other solutions though.
> ~tim
>
>
> On Wed, Jul 29, 2009 at 9:02 AM, Simon Wheatley
> <simon at sweetinteraction.com>wrote:
>
> > The load balanced solution I'm deploying to as I type has file syncing
> > in the OS File System. Perhaps worth looking at as well as a WP
> > solution?
> >
> > S
> >
> >
> > On Wed, Jul 29, 2009 at 3:00 PM, Steve Pellham<spellham at gmail.com>
> wrote:
> > > Is anyone aware of an existing plugin for the post editor pages and/or
> > media
> > > gallery that would push uploaded media (images, video, etc....) to
> > multiple
> > > servers in cases where a WP installation is load balanced?
> > >
> > > DB changes are handled via local and wan replication, but I'm looking
> for
> > a
> > > solution for keeping other media in sync as new images/videos are added
> > to
> > > the gallery, inside posts, etc...  I can think of ways to accomplish
> this
> > > (ftp, rsync...), but I haven't yet found an existing plugin for this.
> >  Don't
> > > want to reinvent the wheel unless absolutely necessary.
> > >
> > > Thanks, Steve
> > > _______________________________________________
> > > wp-hackers mailing list
> > > wp-hackers at lists.automattic.com
> > > http://lists.automattic.com/mailman/listinfo/wp-hackers
> > >
> >
> >
> >
> > --
> > Simon Wheatley
> > Sweet Interaction Ltd
> > Web Interaction Design & Development
> > Tel: 07971 687295
> >
> > Consulting for Stephen Fry: http://stephenfry.com/
> > Blog functionality for DfID - http://blogs.dfid.gov.uk/
> > House of Illustration site - http://houseofillustration.org.uk/
> > Blog for the Royal Navy - http://jackspeak.royalnavy.mod.uk/
> >
> > ---
> > Sweet Interaction Ltd is Registered in England/Wales, no. 6610741
> > Registered office: 7 Malton Av, Manchester, M21 8AT
> > _______________________________________________
> > wp-hackers mailing list
> > wp-hackers at lists.automattic.com
> > http://lists.automattic.com/mailman/listinfo/wp-hackers
> >
> _______________________________________________
> wp-hackers mailing list
> wp-hackers at lists.automattic.com
> http://lists.automattic.com/mailman/listinfo/wp-hackers
>