Mean temperature in emonCMS?

Is it possible to calculate the mean temperature in the CMS like kwh/d??

If possible please tell me how!

Thanks!

TrystanLea's picture

Re: Mean temperature in emonCMS?

Not yet, but certainly would be a nice feature! One to add to the list probably would not take too long

joskim's picture

Re: Mean temperature in emonCMS?

perfect! I'm waiting ... :)

joskim's picture

Re: Mean temperature in emonCMS?

Hi Trystan,

Is there any news about mean temperature in the CMS?

Thanks!

joskim's picture

Re: Mean temperature in emonCMS?

Hi Trystan,

I will bounce this question again.

Thanks!

TrystanLea's picture

Re: Mean temperature in emonCMS?

Hello Joskim Yes this has been implemented, the input process is called - average and will generate a daily average of any input. Let me know how you get on with it.

joskim's picture

Re: Mean temperature in emonCMS?

Oh sorry! I didn't see this...
I seems to work very well!

Thanks!

Jérôme's picture

Re: Mean temperature in emonCMS?

Hi.

I've got a Temperature input. I multiply it by 0.01 to have it in Celsius degrees, then I log it to Temperature feed. Then I average it into average temperature feed.

Then, when I choose histgraph in the Vis menu, I get a daily average, but the unit is kWh instead of Celsius degrees.

Is this hardcoded ? Is there a way to modify it ? Isn't histgraph the proper visualiser to use ?

Thanks.

TrystanLea's picture

Re: Mean temperature in emonCMS?

Hello Jerome, 

The visualisations you want to use are:

Raw data for the temperature feed, in the visualisations selector you should see an input box to set custom units. If you enter C there that should work.

and for the average temperature I realise that there is a bug here that the average feed is set as a histogram datatype when in fact it should be set to daily. Try changing the datatype manually in the feed list by using the drop down datatype selector and then clicking on bar graph in the visualisation selector.

There isnt yet a cutom units input for the bar graph, certainly a good thing to add for the future. It would be good to make emoncms a lot more temperature friendly.

Trystan

 

Jérôme's picture

Re: Mean temperature in emonCMS?

Hi Trystan.

Yes, I'm using rawdata and I noticed the "units" field.

I was wondering what the fill field was for. I peaked into the code and got the answer : 1 means True : fill the space under the curve, any other value means False. Perhaps a boolean would be nice, apparently it already exists :

    /*
      1 - realtime
      2 - daily
      3 - histogram
      4 - boolean (not used uncomment line 122)
      5 - text
      6 - float value
      7 - int value
    */
 

The GUI could then automatically propose a drop-down True/False list.

(In the meantime, a tooltip could help.)

I changed HISTOGRAM into DAILY and I get a nice chart (except for the units).

Thanks.

David L's picture

Re: Mean temperature in emonCMS?

The average input process seems to have been removed some time ago, if i want to get an average temperature feed, how would i go about doing that? 

Readd the average input process in my local emoncms, write some kind of module to calculate the average, or perhaps just a crontabbed hourly script outside of emoncms every hour that calculates averages?

I guess the average input process was removed for performance reasons?

I tried using the timestoredaily vis but what i really want is to use the average in a multigraph.

/ David

rapzak's picture

Re: Mean temperature in emonCMS?

Hi,

Same issue here, using the online version, want to get average day temperature

I had no success getting the system installed on my synology :(

Kasper

 

David L's picture

Re: Mean temperature in emonCMS?

It would be nice to know if anyone is working on this or if i should start building something myself (i actually did but it's only for simplezoom and probably really specific to my needs).

I added a issue as well but the comments so far are only from myself

https://github.com/emoncms/emoncms/issues/136

/ David

Schism's picture

Re: Mean temperature in emonCMS?

I've dropped a comment on the issue. A daily mean of an input would be very useful to me, but I haven't done anything on it yet.

EmilianoM's picture

Re: Mean temperature in emonCMS?

It would be nice to have average input available for temperature.

jonrescca's picture

Re: Mean temperature in emonCMS?

Although I can't help with getting the data from emoncms, I have the average temperature showing in the graphs like this:

But that is probably not what you are looking for.

EmilianoM's picture

Re: Mean temperature in emonCMS?

I wish to have it daily to compare with daily heath pump energy.

arwed's picture

Re: Mean temperature in emonCMS?

Wouldn't it be cool and quite flexible to have a separate editable column on the feeds page (like the "Tag" or "Name") where one could enter a unit to be shown in the graphs? Okay, this does not yet solve the histogram unit problem, which then would require yet another column ... But these units could be used in all other visualisations. I'm currently using several multigraphs in my dashboards  because with these I got rid off the "Average: .." text in the charts. BTW even the tooltip could make use of the unit.

Unfortunately I do not yet feel ready for such a change by myself ...

 

David L's picture

Re: Mean temperature in emonCMS?

I performed some testing by adding a third feed to the simplezoom visualisation, it uses the same code as timestoredaily to get daily averages, i run it locally and it looks like this, the dots are the daily temperature averages:

I still think that the proper way to do it would be adding real average feeds but for my needs right now this works, it would be nice if someone from the emoncms team would weigh in to share their thoughts on how averaging should/could work.

David L's picture

Re: Mean temperature in emonCMS?

If anyone wants to look at the changes to simplezoom they are in my fork here: https://github.com/davle/emoncms

commit 

https://github.com/davle/emoncms/commit/8ec5058ee133e523507c81fec712a7bd54cb5466

and 

https://github.com/davle/emoncms/commit/a623a3838e03ba9396e4c599a7dc680eab284379

I don't know if there is a way to make a feed choice optional, at least i didn't find it during my quick test so be aware that this change breaks current dashboards using simplezoom, you have to go and manually select the third feed, and since it's not optional you have to select something (i guess you could use an empty feed but still...).

Schism's picture

Re: Mean temperature in emonCMS?

David, looks neat. Do you have a link to your source? 

David L's picture

Re: Mean temperature in emonCMS?

I wrote a reply earlier that disappeared for some reason, anyway, here is my fork:

https://github.com/davle/emoncms

The two last two submits are my changes.

I didn't find a way to add an optional feed and still get a nice dropdown of feeds so in my current quick test it seems to "break" all current dashboards that uses simplezoom since it forces you to use the third feed even if you don't want to (and it turns blank if you don't select all feeds).

If it was to be used in the main branch i think the third feed would have to be made optional.

David L's picture

Re: Mean temperature in emonCMS?

Yes arwed, i agree, the unit could be specified on the feeds page and follow through everywhere, that would be really neat.

ratniks's picture

Re: Mean temperature in emonCMS?

Hi, Jon!

I am looking for such a solution for my internal temperature monitoring. Could you explain me how did you got such nice temperature line?

I am sure such feature is necessary for OEM and EMONCMS! There are at least two functions it is needed for: mean internal temperature shows existing comfort level of building and together with mean outside temperature it gives difference how much heating is necessary both are needed for dynamic heating demand calculations and setup of baseline.

prelude's picture

Re: Mean temperature in emonCMS?

I'm also looking for solution to create/record feed with daily average temperatures. I have input where i get temperature update about every minute but i cannot understand how i can create daily average feed from it using virtual feeds (or anything).

Any hint what i can look bit deeper?

 

amgican's picture

Re: Mean temperature in emonCMS?

I second (or third or fourth) the motion. Having the ability to output average temps is hugely important in the field of energy efficiency. This thread has been going for over 3 1/2 years and still there is no ability to create a feed for average temperatures with emoncms? Even more valuable would be a way to calculate degree days (HDD and CDD) per a chosen time period based on base temperatures. It seems this feature is way overdue... I'd love to take on this project, but I'm a VB.net guy (I know, MS sucks) and I don't really have time to learn a new language. Where do we put in our official feature requests?

TrystanLea's picture

Re: Mean temperature in emonCMS?

I've been doing this with an external python script for some recent data analysis of heatpump data, I have also put together a script that processes a feed in order to find the number of hours spent at different temperatures throughout a year. Im going to try and document the use of these as part of my write up on the results of my heat pump testing soon.

I agree being able to extract this kind of information is critical for making use of the energy monitoring in many applications. Its a large task to build comprehensive user interfaces that would integrate with backend processes to carry out these kind of tasks within emoncms. I think the best way forward is to better document how to read through the data files created by emoncms and how to write scripts that can then extract the information required. Or how to export and import the data in other programs such as a spreadsheet program.

amgican's picture

Re: Mean temperature in emonCMS?

"Its a large task to build comprehensive user interfaces that would integrate with backend processes"

As a former DB programmer, I remember our common mantra to be, "Oh, you want a user interface for that database?" ;) I hear you.

Yes, I agree that more documentation on the database design and some useful extraction tools are very much needed. I have to admit that getting my head into all that is quite daunting. But for the interim, one of the biggest needs for me, as an energy auditor who goes to a residence and collects data for a period of one week, then exports that data and creates graphs for reports with overlays of environmental data for the period monitored, is with the date formatting. Currently, the export feature only outputs dates in Julian format. There are obviously functions built into cms to convert to standard date/time formatting as indicated by the dates shown at the bottom (x-axis) for the graph outputs. What would be super nice is a checkbox for "use Gregorian date formatting", or a drop-down list of about 4 different date/time formats to choose from when you're on the export dialog. Then I could graph the data easily for any feed without having to first convert the dates to Gregorian format in my spreadsheet app, which is very time consuming. Is this a feature request I should be addressing to Matthew Wire or one of those CMS development folks? Or are you the guy?

As for development of mean/average temperature output as a feed... waiting for that with bated breath ;) If you do attack this in the near future, please consider my suggestion of outputting degree days (HDD and/or CDD) based on base temperature variables, as that would be a most handy bit of information.

I'm still very new to the OEM project, but I love where it's going. As a niche-based energy auditor in the US I needed an affordable and flexible monitoring system I could install for a short period of time to monitor up to 30 circuits in various locations such as the mains feed, sub-panels, and individual appliances, all over the house. OEM was the only thing I found to accomplish this without breaking the bank. Once I have my system dialed in and I'm comfortable with the whole system, I will be writing a very thorough article to post on many forums and websites, specifically for the independent energy auditor like myself, talking about your products and your very fine project. I'll post links to those articles here when I've done so. Keep up the good work. Climb on!

Rodney

TrystanLea's picture

Re: Mean temperature in emonCMS?

Thanks, Yes I agree some additional time formatting export options would be great, but not sure if its something ll get the opportunity to do in the short term. How do you do the conversions at the moment? do you do it with a script or in the spreadsheet software?

I'll update on the mean temperature script soon.

amgican's picture

Re: Mean temperature in emonCMS?

Well in the interim, it seems the makers of emonCMS have been kind enough to get us an easy way to get the mean, the min, max, stddev, and npoints, but I had no idea the data was visible there. Just go on over to feeds, click on a visualization for a feed, super nice graph, but scroll down after the graph, all the stuff you could need. Exporting of data from a textarea box, copy/paste, niice. Done. Thanks for that! And now it's documented. :)

chrismyers81's picture

Re: Mean temperature in emonCMS?

I'd definitely be interested in this as well, it'd be awesome to be able to compare average outdoor temperature with power used :D

Jon's picture

Re: Mean temperature in emonCMS?

I'd definitely be interested in this as well, it'd be awesome to be able to
compare average outdoor temperature with power used :D

+1 for me!  Is an average temperature (per day) possible?

john.b's picture

Re: Mean temperature in emonCMS?

I believe daily averaging used to be part of Emoncms, but it disappeared somewhere around V5 or V6.  I copied the code from from that earlier version sometime ago and have been using it ever since to calculate Heating Degree Days (HDD).  It will obviously also calculate average daily temperature etc.

If you look in V9 of emoncms\Modules\process\process_processlist.php you will find the remnants of the Daily average code that were deleted.

I have attached a modified version of the process_processlist.php which will enable you to create a mysql daily average feed such as daily average temperature or Heating Degree Days.

Heating Degree Days are a fundamental part of energy monitoring for heating and I really hope this simple feature is officially implemented soon

Jon's picture

Re: Mean temperature in emonCMS?

John - Thank you for the response.  I'll look thru the code.  Heating Degree Days is exactly what I was looking for!  Just curious if there are other methods you use to analyze the energy data? Thanks again!

john.b's picture

Re: Mean temperature in emonCMS?

Jon, I mainly use an excel speadsheet to do a regression analysis against the HDD and energy used.  I just use emoncms to capture the data and then output via a csv file.

I've tried to do a more detailed realtime model but due to the variation in user habits etc. its nearly impossible to get a good correlation, so in my view the HDD method is the appropriate method.

This is how I do the HDD calculation https://openenergymonitor.org/emon/node/2117

and you can always get HDD data from nearby weather stations here http://www.degreedays.net/

its obviously not as good as data measured at the property, but still useful

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.