Comments on: Packing and copying Data.fs from production server for local development http://blog.mfabrik.com/2009/09/01/packing-and-copying-data-fs-from-production-server-for-local-development/ Freedom delivered. Mon, 19 Sep 2011 19:02:42 +0000 hourly 1 http://wordpress.org/?v=3.2.1 By: Mikko Ohtamaa http://blog.mfabrik.com/2009/09/01/packing-and-copying-data-fs-from-production-server-for-local-development/comment-page-1/#comment-1690 Mikko Ohtamaa Mon, 09 Nov 2009 09:27:47 +0000 http://blog.twinapex.fi/?p=267#comment-1690 /tmp/packer/bin/easy_install ZODB=3.8.3 should be /tmp/packer/bin/easy_install ZODB3==3.8.3 /tmp/packer/bin/easy_install ZODB=3.8.3

should be

/tmp/packer/bin/easy_install ZODB3==3.8.3

]]> By: Mikko Ohtamaa http://blog.mfabrik.com/2009/09/01/packing-and-copying-data-fs-from-production-server-for-local-development/comment-page-1/#comment-1689 Mikko Ohtamaa Mon, 09 Nov 2009 09:23:47 +0000 http://blog.twinapex.fi/?p=267#comment-1689 /tmp/packer/bin/easy_install ZODB=3.8.3 should be /tmp/packer/bin/easy_install ZODB==3.8.3 /tmp/packer/bin/easy_install ZODB=3.8.3

should be

/tmp/packer/bin/easy_install ZODB==3.8.3

]]> By: Dylan Jay http://blog.mfabrik.com/2009/09/01/packing-and-copying-data-fs-from-production-server-for-local-development/comment-page-1/#comment-1039 Dylan Jay Thu, 17 Sep 2009 06:35:32 +0000 http://blog.twinapex.fi/?p=267#comment-1039 Even better challenge. Get those ssh snippets into a fabfile, and put it into a collective.hostout.filestorage recipe the following would work. [host1] recipe=collective.hostout host=myhost.com path=/remotepath extends=hostfs [hostfs] recipe=collective.hostout.filestorage Once added to your local buildout you can then run $ bin/hostout pullfs hostfs $ bin/hostout pushfs hostfs The hostout plugins are new but there should be enough there to do this http://pypi.python.org/pypi/collective.hostout Even better challenge. Get those ssh snippets into a fabfile, and put it into a collective.hostout.filestorage recipe the following would work.

[host1]
recipe=collective.hostout
host=myhost.com
path=/remotepath
extends=hostfs

[hostfs]
recipe=collective.hostout.filestorage

Once added to your local buildout you can then run

$ bin/hostout pullfs hostfs
$ bin/hostout pushfs hostfs

The hostout plugins are new but there should be enough there to do this

http://pypi.python.org/pypi/collective.hostout

]]> By: Alex Clark http://blog.mfabrik.com/2009/09/01/packing-and-copying-data-fs-from-production-server-for-local-development/comment-page-1/#comment-1018 Alex Clark Thu, 03 Sep 2009 10:15:43 +0000 http://blog.twinapex.fi/?p=267#comment-1018 Once you pack your db, there is: http://pypi.python.org/pypi/collective.recipe.rsync_datafs/0.1 which lets you do (in UNIX, with rsync in your PATH only): [buildout] parts = database [database] source = remotehost:/path/to/packed/Data.fs target = ${buildout:directory}/var/filestorage I find using this recipe makes it easy to grab a remote Data.fs to develop with locally. Once you pack your db, there is: http://pypi.python.org/pypi/collective.recipe.rsync_datafs/0.1 which lets you do (in UNIX, with rsync in your PATH only):

[buildout]
parts = database

[database]
source = remotehost:/path/to/packed/Data.fs
target = ${buildout:directory}/var/filestorage

I find using this recipe makes it easy to grab a remote Data.fs to develop with locally.

]]> By: Andreas Zeidler http://blog.mfabrik.com/2009/09/01/packing-and-copying-data-fs-from-production-server-for-local-development/comment-page-1/#comment-1012 Andreas Zeidler Thu, 03 Sep 2009 00:24:48 +0000 http://blog.twinapex.fi/?p=267#comment-1012 eek, that should have been: $ ssh plone@server bin/packer > Data.fs of course... /me too sleepy again :) eek, that should have been:

$ ssh plone@server bin/packer > Data.fs

of course… /me too sleepy again :)

]]> By: Andreas Zeidler http://blog.mfabrik.com/2009/09/01/packing-and-copying-data-fs-from-production-server-for-local-development/comment-page-1/#comment-1011 Andreas Zeidler Wed, 02 Sep 2009 23:32:58 +0000 http://blog.twinapex.fi/?p=267#comment-1011 mikko, yep, that was actually my "goal" when i put together that buildout snippet. unfortunately, though, `fsrecover` needs to be given a proper file name, i.e. writing things to stdout directly doesn't work. at least not ootb. otherwise you could of course simply use something like: $ rsync -az plone@server:~/bin/packer > Data.fs mikko,

yep, that was actually my “goal” when i put together that buildout snippet. unfortunately, though, `fsrecover` needs to be given a proper file name, i.e. writing things to stdout directly doesn’t work. at least not ootb.

otherwise you could of course simply use something like:

$ rsync -az plone@server:~/bin/packer > Data.fs

]]> By: Matt Hamilton http://blog.mfabrik.com/2009/09/01/packing-and-copying-data-fs-from-production-server-for-local-development/comment-page-1/#comment-1008 Matt Hamilton Wed, 02 Sep 2009 09:42:35 +0000 http://blog.twinapex.fi/?p=267#comment-1008 Andi, Great! :) The power of buildout and some knowledge ;) -Matt Andi,
Great! :) The power of buildout and some knowledge ;)

-Matt

]]> By: Mikko Ohtamaa http://blog.mfabrik.com/2009/09/01/packing-and-copying-data-fs-from-production-server-for-local-development/comment-page-1/#comment-1007 Mikko Ohtamaa Wed, 02 Sep 2009 09:19:54 +0000 http://blog.twinapex.fi/?p=267#comment-1007 How about this: doing the whole repoze packing and copying using one or two SSH commands without the need to login to the server shell? How about this: doing the whole repoze packing and copying using one or two SSH commands without the need to login to the server shell?

]]> By: Barry Page http://blog.mfabrik.com/2009/09/01/packing-and-copying-data-fs-from-production-server-for-local-development/comment-page-1/#comment-1004 Barry Page Wed, 02 Sep 2009 02:04:40 +0000 http://blog.twinapex.fi/?p=267#comment-1004 I use repozo.py to back up so I have the full version and deltas shipped remotely each night. Then I can recover the Data.fs again using repozo and use that copy for testing (and verify my backups at the same time). In practise you need to either do a full repozo back every few days or do a pack which forces a full repozo backup the next time. I do the latter. I use repozo.py to back up so I have the full version and deltas shipped remotely each night. Then I can recover the Data.fs again using repozo and use that copy for testing (and verify my backups at the same time). In practise you need to either do a full repozo back every few days or do a pack which forces a full repozo backup the next time. I do the latter.

]]> By: Andreas Zeidler http://blog.mfabrik.com/2009/09/01/packing-and-copying-data-fs-from-production-server-for-local-development/comment-page-1/#comment-1003 Andreas Zeidler Tue, 01 Sep 2009 22:53:27 +0000 http://blog.twinapex.fi/?p=267#comment-1003 heh, it seems anything that looks like html is filtered here — the command invokation was meant to have an extra parameter, like so: $ bin/packer path/to/packed/Data.fs this will save a packed version of you current `Data.fs` into the given file... heh, it seems anything that looks like html is filtered here — the command invokation was meant to have an extra parameter, like so:

$ bin/packer path/to/packed/Data.fs

this will save a packed version of you current `Data.fs` into the given file…

]]>