Setting up emonhub + emoncms on Hard Drive

Hi

I have set up a new system on an SD card using  emonSD-13-08-14.img.zip on a PI with RFM12Pi (RFM69CW).

This was pretty straightforward. It did not work at first but upgrading the software as in this thread

http://openenergymonitor.org/emon/node/6244

solved the problem and everything is working fine. In fact I initially used the same network group as my current system which is in another building about 40 metres away with substantial walls between and picked up signal from 2 of the sensors in the other building which I had not expected.

I would now like to move this setup to a hard drive. Do these instructions still apply as they refer to a different image?

https://github.com/emoncms/emoncms/blob/bufferedwrite/docs/hddsetup.md

Regards

Ian

pb66's picture

Re: Setting up emonhub + emoncms on Hard Drive

Hi Ian.

If running a hdd I would recommend using the full emoncms and raspbian versions. It is possible to use the emonSD-13-08-14.img.zip on a hdd but it will require some changes. 

Although there are instructions on how to add a hdd and/or change to a full emoncms from the buffered write, I believe this to be an upgrade "option" and isn't (IMO) the best way to start out if you know you want full emoncms on a hdd. 

The SD image is a cut-down version of emoncms to achieve the low write levels needed to not ruin the SD card, installed to a version of raspbian that has been modified to add to the protection with a read-only file system, since neither of these are required with full emoncms on hdd further adapting the adapted software may lead to unexpected results.

I would recommend installing the latest raspbian image to the hdd as we previously did but instead of using apt-get to install emoncms, use git to install both emonHub and emonCMS.

​You can use this thread http://openenergymonitor.org/emon/node/5092 upto the reboot and then install emoncms using the "to linux from git" instructions.

​installing emonHub is straight forward using this one line takes care of everything

git clone https://github.com/emonhub/dev-emonhub.git ~/dev-emonhub && ~/dev-emonhub/install

Paul

 

Ian Eagland's picture

Re: Setting up emonhub + emoncms on Hard Drive

Thanks Paul

I will go that route.

Ian

pb66's picture

Re: Setting up emonhub + emoncms on Hard Drive

installing emonHub is straight forward using this one line takes care of everything

Sorry, that's a bit misleading, you will still need to edit "emonhub.conf" (or keep a copy of the one you have)

Paul Reed's picture

Re: Setting up emonhub + emoncms on Hard Drive

I can only echo Paul's comments above.

I installed the buffered write version from an image probably around August after (yet another) SD card failure, and then went onto transferring it to a USB HDD, updating emoncms to the full 'git' version in the process, but... I hit so many problems thereafter, that I ended up deleting the whole lot, and installing it from scratch via Git.

One thing you may wish to consider before you start (maybe for future development), is partitioning your HDD into 2 or more partitions, and use the first for your emoncms installation, and the second, third etc for other purposes.
I have 3 partitions, 1) emoncms, 2) Media server files, 3) Data Backup files and now store very little on my laptop, and can access music, videos, pictures & documents from my phone, tablet, laptop and also stream them to my TV.
The HDD is auto backed up to a free copy.com cloud backup (they have a Raspberry Pi client app).

I try & make the raspberry earn it's keep!

Paul

Bill Thomson's picture

Re: Setting up emonhub + emoncms on Hard Drive

Always a good idea to have your Linux installation spread across two or more partitions.

A sound practice I learned from an IT specialist is to put your /home directory on a separate partition. That way, when you upgrade the OS, your data and apps won't get overwritten by the upgrade.
 

pb66's picture

Re: Setting up emonhub + emoncms on Hard Drive

It is also a wise idea to keep the partitions small and increase the size as needed, that way it is very easy to create compact images quickly.

Paul Reed's picture

Re: Setting up emonhub + emoncms on Hard Drive

It is also a wise idea to keep the partitions small and increase the size as needed, that way it is very easy to create compact images quickly.

I've been using FSArchiver via a live disk for some time now to create backups, which has proved very reliable and as it only backs up actual data, the resultant archives are small, irrelevant of the partition size, and are quick.

I've probably restored 3 or 4 times totally successfully, including different drives/sizes whilst checking out a new OS (Debian Jessie) and new hardware.

 

Paul
(going off-topic!!)

Bill Thomson's picture

Re: Setting up emonhub + emoncms on Hard Drive

Sometimes off-topic is good. (Well, at least this time!)

Thanks for the link/heads-up about FSArchiver. I hadn't heard of it till now. Sounds like just what I've been looking for in a backup/restore tool.

Ian Eagland's picture

Re: Setting up emonhub + emoncms on Hard Drive

Hi

One thought just struck me. This is a new setup I am working on for deployment in another building and to keep up to date with emoncms developments.

I already have a PI with HDD (no  RFM12Pi ) acting as a server. This is fully up to date and working perfectly.

Would it be possible to take an image of that SD card and HDD, transfer it to the new set up and then install the RFM12Pi software and the emonhub software?

Regards

Ian

 

pb66's picture

Re: Setting up emonhub + emoncms on Hard Drive

It's certainly possible, however it may not be the best way forward, what versions are you running on the other Pi?

Working from memory I believe you have a debian "apt-get" installation. If that i the case you won't be able to update it to the latest emoncms without some "minor butchery" so if you want to tinker with the developments you may be better off with a clean git install.

I would be tempted to leave an established working system as it is, play with a all new set up and once confident with the new setup and there was some value in doing so, swap out the new for the old.

Paul

Ian Eagland's picture

Re: Setting up emonhub + emoncms on Hard Drive

Hi Paul

I am up to 8.4.0 on the established server.

I switched to the Git version when I realised the apt-get was falling behind. It is because the established system is so up to date that I thought cloning might be the way to go.

I have now got the emonhub posting to the established Pi server.  The only other thing I would like to do on the new Pi with emonhub is to switch to WiFi if that is possible. 

Ian

pb66's picture

Re: Setting up emonhub + emoncms on Hard Drive

If it's git installed then yeah, there should be no problems cloning that server. What input stage(s) if any are you using? You said you are not using RFM2Pi on the established server so are you just using the emoncms input api?

I see no reason why wi-fi shouldn't work if you have emonHub installed to a full raspbian OS.

Paul

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.