Archived Forum

Hi Trystan

Just tried the new myelectric and found the settings button takes me back to the main emoncms login screen despite already having logged in. the only way back to the page is via the link above and that bypasses the sttings if you have already setup. So you only get one chance to setup, there no current way of changing the settings once set. aside from that it seems to be ok. I will try the mysolar on my own account later, there's no PV on this one I'm logged into right now.

I had tried to test for the exposed settings using the read apikey but I cannot test as using the read key doesn't recognize the settings have been previously set and takes me to the initial setup page but with no feeds to select.

This test also seems to wipe out the settings for the live myelectric app, I had to reconfigure the settings again in that. not a huge problem if you are aware but I could of easily left it in the unconfigured state. so testers beware go back and test the live versions after trying the appdev versions.

Paul

PS can we have the total on each bar of the barchart rounded the same as all the other totals so that the numbers add up whilst you are in there tinkering?

So I have just tried the mysolarpv appdev and found it has picked up my original settings and they do not provide the second part of the screen, the bargraph is not shown.

If I click the cog (settings) it takes me back to the main log in screen as per the myelectric test above (this is a different account and I am logged in) there doesn't seem to be any way to access the settings page to change the settings, This too has knocked out my original settings for the live mysolar app. I will not reconfigure yet in case you need further tests on this.

Paul

Thanks for testing Paul, Not sure if I can replicated fully:

If I go to: https://emoncms.org/appdev#mysolarpv I can set the settings, navigate to myelectric by changing the URL. settings still work.

If I authenticate with https://emoncms.org/appdev?apikey= the settings icon is not shown.

If I authenticate with https://emoncms.org/appdev?readkey= the settings icon is shown and I can edit, save, launch the app and then re-edit the settings.

Ok so I've sussed part of it, the log out hotspot covers a large area and the settings is tiny. even now I am aware of the tricky targeting I am still regularly logging out rather than going into settings. 

I just tried uploading a screenshot to show you but the mouse cursor isn't shown.

Shouldn't the settings be available only using the write key not the read key?

Paul

Ah ok, maybe we can look at the sizing so its easier. The readkey - while it is the read apikey uses a different authentication path to the parameter 'apikey=' which goes via the full user authentication route first modifying the session to be a readonly session even if your logged in.

So if you login with username, password it sets the session to be a write session and the session is persisted with a session cookie. If you then add apikey= (with read apikey) to the url this will override the user login session placing it in a readonly session.

the readkey parameter is different in that it is only used by the app module and even if present the cookie session with write access is not overwritten and so your able to access the settings when logged in. Once logged out the readkey will allow for normal readonly access and the config icon will be hidden. 

The new app module is now running as default on emoncms.org under:

emoncms.org/app#mysolarpv

Hi Trystan, The new apps cannot be accessed via the read apikey or the readkey, the "appdev" links seem to still work correctly though. see screenshots below, the title notes the url and key used.

The appdev link with the readkey is the better one as it is much cleaner and doesn't show the dashboard links, effectively an "appkey" 

Paul

PS please look at the hotspot areas, it's really not useable on a touch screen laptop, I had stopped testing the appdev versions as my laptop was destined for flying lessons but now the older apps are no longer available. I do prefer the layout of the new app settings but the settings hotspot and the read only access are an issue for me.

Thanks Paul, I've fixed the readkey issue I think, does that part work for you now?

I'll have a look at how to make the spanner easier to click. Is that a long running issue, or do you think its harder with this update?

Yes, thanks the readkey and original url work again, and the settings spanner isn't shown either, fantastic.

The spanner hotspot is definitely since the update, I have been using the myelectric app a lot recently without an issue, likewise when I returned to the "app" version after trying the "appdev" version.

You may want to take a look at the currency side of things (see image) Ok now, the word "pound" must've been carried over from old app, replaced with "£" in settings. It works as expected now.

Paul

PS there doesn't seem to be any way of backing out of settings, an incomplete setup, accidentally landing in settings or a quick peek at the feeds used etc. You can only "Launch app" if you select the feeds. you cannot use browser "back" to get out of settings without going back to the page previous to viewing myelectric (effectively going back 2 pages) and even reusing the "myelectric" menu doesn't exit settings mode, nor does browser refresh. Perhaps the spanner should remain so that you can toggle in and out of settings.

PPS there is also no way to view what feeds are currently being used. This is the settings of a fully configured myelectric app.

The currency and unit price are populated, but the feeds are not.

Thanks for checking this. I notice your using phptimeseries for your feeds, the apps require phpfina feeds, so I think the config is showing up because it cant find the correct feeds. Once the feeds are selected the [auto] text is replaced with the name of the selected feed.

I would like to provide a way to convert phptimeseries feeds on emoncms.org to phpfina where applicable - this should not be too much work and I could at least implement a way to do this on request in the next few days.

The idea with there not being a back button is that when the app is un-configured it should not display the actual app, this is designed to avoid any data empty errors. The app should only be displayed if everything is present and of the right form.

Hi Trystan - I'm not sure what makes you think I'm using phptimeseries feeds, perhaps you have looked at my personal account ??? That is not the account that I am testing with here.

In fact the myelectric app on this account will only list the phpfina feeds so it is not possible to set it up with phptimeseries. The phpfina feeds used for myelectric in this account were created for this sole purpose.

The screenshot above is for that account and is currently working as expected with the correct phpfina feeds and yet the set up page continues to show [auto] on both settings.

"The idea with there not being a back button is that when the app is un-configured it should not display the actual app, this is designed to avoid any data empty errors. The app should only be displayed if everything is present and of the right form."

I see these as 2 very separate things that do not really work together. If the app can only be shown if fully and correctly configured that's fine and the settings page being shown in place of the app is great. but if there is no other exit once you arrive in the settings page because the app isn't configured (correctly) where do you go if the feeds you need are not listed, or if the only feeds listed do not fit the correct requirement and permit the app to open? once in the settings page the only graceful way out is via a fully and correctly configured app which may not always be possible.

If you do manage to select incompatible feeds the "launch app" button doesn't do anything and doesn't identify the culprit either. if you do not find the right combination of feeds to unlock the "launch app" button the only way out is to back out using the browser button.

For example. whilst testing the spanner button, on the occasions I didn't manage to log out instead and successfully opened the settings page, I then did not want to reselect and reconfigure a perfectly functional app so I have to use the back button to get out or run the risk of potentially selecting the wrong feeds and screwing up the settings just to exit.

I have just rechecked this again and attached the screenshots which are for a fully configured and functional myelectric app, note also the formatting issue with the field label text, I have seen this several times but it seems to clear and not happen with any detectable pattern eg first login, refresh, new browser window, new feed config etc.  

There is also a pic of the feeds in question on the feeds page to show they are phpfina.

Paul

PS Is there a reason only the phpfina feeds show on this account but all feeds show on my own account?

Okay, I have just come back to this and tried setting up my own myelectric and we have a very different result.

The settings are displayed when you enter the settings page, but the feed lists contain all feeds not just phpfina.

When I first opened the app I was greeted with an error message (see pic 1) as the feeds previously tried were not the right type. I entered settings and can see the feed names (definitely not possible on the other account). The button was shown (see pic2) and when clicked the app will open with the wrong feed types (not possible in other account).

I tried to use [auto] but I guess there must be a check for the feed names as the button wasn't shown (see pic3). What are the auto names? are they "use" and "use_kwh" ?

You can see from the size of the scroll bar on the dropdown in pic4 that there are a vast number of feeds to choose from, but only a couple are phpfina so they are not filtered on the account but they are on the other as seen in the previous pics.

These 2 accounts behave very differently and I have tried from 2 machines get the same results per account, both pc's are windows 10 running chrome so it doesn't appear to be a caching issue.

Paul

Hi Trystan - Sorry, I also just noticed the week and month view axis labels are just displaying "1.00" not days of the week or months of the year. The month view only shows one label at (presumably) 6mths can that be up'd to at least quarterly or is that not possible?

Plus (sorry again!!) things get a bit messy on the other axis too with some overlapping at the top adding to the existing busyness, perhaps the white/very light grey would be more appropriate for labels? 

I've checked and the "1.00" labels are present on both accounts. 

Paul

PS - Honestly I am not looking for issues, but I had left the webapp on the week view after taking the "overlapping" screenprint and just noticed whilst supping a cuppa tea that the "1.00"s are not even in the right place, this companies energy profile is that regular you set a clock by it and in that pic there appears to be an increasing time span between the "1.00" and the start of the workday for each day towards the right. 

PPS Finished my cuppa now so I've added some green arrows to highlight the time span increasing and provided a pic of the raw feed to show the data is very regular.

I'm not sure if this is related to the new mysolarpv app as i only started logging grid data yesterday but after configuring the app the page now does nothing whenever i try to access it. An error is also logged in the console.

@fillash, could you try again now, I may have fixed it, you will need to do a full page refresh to get the latest javascript. If that didnt work could you pm me your account name and I can investigate.

Paul, I wonder if some of the issues you're seeing are browser related? struggling to replicate the issues around settings configuration. Perhaps the showing of all feeds vs only phpfina happened as I was updating. Could you try a full refresh now?

I'll look into the overlapping and labeling issues.

PS: I think I may have solved the get_data_DMY error.

Sorry read more carefully, you have tried on several machines to check for caching issues. hmm

I think I found the cause of the issue that showed the dropdown selectors even though the app was configured. It may start to make a bit more sense now. It will need a cache refresh.

Can I echo pb66's comment about the scale being the same colour as the graph, it's not easy to see, both x & y axis.

There's an inconsistency here because My Solar and My Solar & Wind have the scale on the outside & below of the graph, and in grey, whilst My Electric, the scale is on the inside (& blue).
The My Solar scale is much cleaner looking IMO.

The < and > navigation buttons don't seem to work properly - they only move a fraction each click.

On the W (eekly) and M (onthly) views, I also see the row of 1.00's along the x axis.

The x axis scaling doesn't go lower than an hour when zoomed in, ie zoom in to less than an hour and there is no time scale at all.

Also (nitpicking!) is there any need to put 'W' after the scale value, as the legend above tells you it's Watts.

Paul

Thanks Paul, I think I've fixed the panning issue looks like that must have been there for some time! Yes the weekly and monthly views dont have very good axis units support at the moment - il look into that and your other points.

Hi Trystan - Thanks, the fix to the dropdown's retaining/displaying the settings has made a big difference to the operation of myelectric. although it's no longer as big an issue for me I do still think you need a way back out, a good example is a new user exploring the site before creating any feeds, there is no way out except the back button.

I haven't experimented at all yet but how will the name recognition work with the possibility of multiple feeds named the same? Does it record the feedid of a feed found by [auto] or does it always look for the feed by name? does it stop looking after it's found the name or will it continue to find others?

MyElectric on both accounts seem to work well now but the MySolarPV app on my own account won't load, the other account does not have PV but the app does open.  See attached screenshot, 

When I last checked MyEnergy on the other account I had to close 5 error messages before the app opened, this has not happened this morning so may have been fixed with the "get_data_DMY error." fix.

MyEnergy on my personal account seems to work ok despite the MySolar not working, (note there is a typo in the headings exess should be excess) 

It would be great if you could look at the axis labels and other formatting items Paul and I have mentioned  I will keep you posted if I see the time axis out of alignment again, it's only happened a couple of times to my knowledge but it not something I usually look for, it seems fine right now though.

Paul

I think I've found one issue that was causing Mysolar not to load but it involved rolling back a recent change to get_data_DMY but now Im not sure if I can replicate the initial issue that was solved with the fix I made.

To answer your question about the autoname: it does assume each feed is named uniquely. If there are two feeds with the same name that matches the autoname i.e use or use_kwh (has to match completely + case sensitive) then it will be the last feed in the feed list with that name that is selected.

Im not sure about the need for the back button, isnt it possible / natural to press on the top bar menu items to navigate away from the page?

Rolling back the changes has indeed brought back the Mysolar page to my personal account but unfortunately also brought back the "get_data_DMY" error to the (partially unconfigured) myEnergy app on the other account without PV.

I guess navigating to another page is perfectly acceptable, the backing out only became an issue when trying repeatedly to configure the same app as reselecting the MyElectric link will not take you out of settings to the front page, effectively it does nothing as you are already in the app. I've also noticed that when you have an issue like the "get_data_DMY" and the page will not load, none of the app links will work unless followed by a refresh. eg MyEnergy won't load and I click on MySolarPV nothing happens to the displayed page but if you then refresh it will load the MySolarPV. So it is getting the request but not able to break away from the page that won't load. Going to a link outside of the apps eg the inputs page etc does work as intended.

Paul

Yes the reason for this is that the javascript error stops the javascript at that point and page navigation is done via javascript between apps. Which means if there is an error it wont change the page..

Could you PM me the account name for the account with the get_data_DMY error?

Done!!

That account will not ever need the PV aspects and the MyEnergy app may never get looked at so I'm not too fussed about the message coming up. but I pm'd you the details just in case it may help you.

Paul

Ok I think its sorted but probably being optimistic :)

Seems ok. Both the MySolarPV and MyEnergy apps seem to open/load ok on both accounts. However, I don't know what the figures are telling me or if they are incorrect! My own account shows 11.2kWh use today, but the MySolarPV shows 3.2kWh's use today that is then split 0.5 solar and 2.8 grid.

This is also the case on the other account showing 108kWh today in MyElectric. MySolar isn't configured, but MySolarWind shows 19.1kWh split 17.2kWh grid and 1.8kWh wind (see attached). Is this because you have reset something and it's not a full day, or am I reading it wrong? I expected the total use today to be the same across the apps.

Paul

Great to hear they are opening and loading ok. Thanks a lot again for testing this.

The values below the graph in mysolarpv and myenergy are both for the window selected rather than the 'today' figure. Hence, the reason your second figure is 19.1 kWh rather than 108 kWh as it's only covering the period 16:30 to 22:30. If you zoom out and start at midnight and end at the present time, you should get the 108 kWh reading.

Trystan,

Not sure if this is the spot to post this issue. If not, let me know and I'll start a new thread. I am running a standalone version of EmonCMS (latest version) with the latest version of your apps. 

I am having issues getting the apps to work. The heat pump app works great, no problems there. When I named my feeds, everything populated and it runs and looks great.

Myenergy did not recognize the house_power feed automatically, but once I went into setup and selected that feed manually, it started to show up right away.

Mysolar did not recognize the solar_power feed automatically. When I went into the setup and selected the solar_power feed, it still did nothing. The numbers remain at zero.

For some weird reason, once I select an app from the dropdown list, I cannot select another one. Or rather I can selelct it, but the page does not change (latest version on chrome). I have to force-refresh the page in order to get it to change. If I open the myenergy page first, then go to the mysolar app, the mysolar app background is dark. But the next time I visit it, it will be white, and will remain white, until I force a refresh, or log out of EmonCMS and log in again.

Any help with these issues would be greatly appreciated.

Have you tried clearing your browser cache?
The javascript used by the app is downloaded and cached by your browser, and may need flushing to download the latest version of the app's javascript.

I'm also running standalone, v9.4 | 2016.03.15 with latest app version and can't replicate your issue here.

Paul

Hi Paul

Yes I did. In fact I used a browser that I never use (firefox) as well as using Chromes incognito mode. Same experience all the way around.

I haven't tried the local version but if it's the same as the emoncms.org version the automatically detected feeds are "use", "use_kwh", "solar" and "solar_kwh" so the older keywords are no longer searched for except, presumably in the MyHeatpump app since that hasn't to my knowledge had a revamp.

The inability to select any other apps once a javascript error or dead end is reached has been mentioned above, and, is how it is, unfortunately. IMO, there should be some sort of watchdog in the main page code to refresh periodically, but I expect Trystan will have already explored that option.

The white background has been reported before, but not recently, to my knowledge. So that may be a known issue. I do not recall the detail. Maybe a forum search on "white background" or something similar, may turn something up. If I remember correctly, it was about the same time as, or additionally reported as, the settings button missing due to being white on white.

Paul

Thank Paul 

I think the stand alone version uses something different than the hosted version. I pulled the latest version of apps from GitHub and it uses house_power and solar_power as the feed names it is looking for, I do not see anywhere in the code for mysolarpv.js where it looks for anything other than those feeds. 

Regardless, for me, I have feeds names what the code is looking for and I get nothing, AND I have gone into the setup form the app page and set them there and it still does not display anything for the solar. The heatpump and energy pages work ok, although I did have to use the setup page on the Energy app to get it to work.

Thank you for the pointer on the white background, it does look like it is a known issue.

Thanks Paul

I think the stand alone version uses something different than the hosted version. I pulled the latest version of apps from GitHub and it uses house_power and solar_power as the feed names it is looking for, I do not see anywhere in the code for mysolarpv.js where it looks for anything other than those feeds. 

Thank you for the pointer on the white background, it does look like it is a known issue.

In either case, naming the feed what the code is looking for does not work for me for the mysolarpv app, nor does setting the names via the setup interface for it. The heatpump worked great, found the feeds immediately. And while the energy did not find them automatically, it did work once I set them via the setup utility.

OK, I think I have found part of the problem with my setup. No matter what I name the feeds, the mysolar app will not auto detect them. When I clicked on the setup icon in the app itself, I was putting in the name of the feed instead of the feed id. Once I put in the feed ID I started to see information.

I am seeing part of the info but not any of the solar, just the house usage. In following the instructions here (are these the latest and greatest instructions?), I tried to do this:

Setup Grid Import Feed

Assuming CT2 (power 2) = Grid import/export

Click on spanner icon to configure emonPi/power2
Select allow positive to isolate import component
Select power to feed and create a feed called import with the feed engine set toPHPFina and feed interval=10s
Select power to kwh, create a feed called import_kwh with feed engine PHPFina and feed interval=10s

and ran into a problem with:

Select power to feed

Under all of my options, Power to Feed is not one of the available options. What option should be selected in it's place or how to I add that option?

Thanks

"Select power to feed" should have been "log to feed" (now corrected).

It sounds like the "apps" you are using are not the latest, I do not know off hand if the versions are currently the same on emoncms.org as the emoncms repo, I had thought they were both the latest, but on the latest the settings are applied by selecting the feeds from a dropdown box. There is no option to use feed ids to my knowledge.

Further along the guide you are using there is a picture showing the new style with the 5 settings down the right hand side. 

If not using the latest then the "house_power" and "solar_power" keywords should still be used.

Paul

Thanks Paul, 

I am running the latest version of the code (updated 22 days ago) from github so I am not sure where the disconnect is on the setup. 

Here is the link to the version I am running: HERE

If there is a different version, I would appreciate a pointer to where I can get it! Maybe that is half (or more) of my problem!

Thanks

It looks like the default branch is "9.0" that is a name not a version, it signifies the branch that was made emoncms v9 compatible. The recent changes to the apps seem to be mainly on the "mysolar_history" branch.

Paul

Its probably a good time now to merge mysolar_history into 9.0. Are there any objections? Happy to allow for more testing time.

I've merged the mysolar_history branch into branch v9.0 of the app module. I've also updated the emoncms master and stable with the recent bug fixes found on emoncms.org.

Thanks Trystan - 

I will grab the latest and install it!

Hi Trystan and the others

First of all, thanks for your great work folks. It’s really a pleasure to work with emoncms and its extensions.  I’m running emoncms on a raspberry pi 2 (manual installation) for more than a half a year now and it’s running perfectly. Currently the most recent version 9.5 (stable branch) and the latest apps version from github are installed. From the apps I’m using only the myelectric part.

With the latest apps version the new configuration dialog was shown on first access. I configured the correct feeds and added the € sign instead of the former “euro”. I soon realized, that the € sign was not saved to the database because every time I refreshed the page (not from the cache) the € sign was gone. I fixed this by manually adding it to my database (perhaps it’s only a specific problem of my installation). May be you want to test this in your environment.

The bigger issue is the “use today” value and the bar graph. Previous to the update the “use today” value was counting up from zero after midnight and the bar graph was adding a new bar for the new day. With the new version the “use today” value comprises also the consumption of the previous day as well as the bar graph visualization (no new bar for today). I assume that this not the intended behaviour of the app – or am I wrong? May this issue be related to my time zone (I’m living in Germany)?

Any help would be appreciated!

Holger

Hi Holger, see the recent issues posted in the The Official Emoncms Android App thread 

Paul

Thanks Paul. That's it. As I am on the stable branch of emoncms, I will wait until the fixes are available.

Holger

Hey Everyone - 

I am still beating my head against the wall on the mysolar and myelectric apps and could really use another set of eyes on this to see what I have missed.

I have followed the instruction listed here (several times in fact). Even though I am seeing readings in my feeds, and those feeds are named like the instructions have said, and the apps found the feeds automatically, the data displayed is not making it to the app. 

For example, USE NOW is showing -1018, EXPORTING is showing 1018 and SOLAR PV is showing 0. On the mypower, I never see the export (even though on the Android app the graph goes negative when I am exporting) it never does that on the mypower app.

I have attached some screen shots showing my config. Any guidance would be greatly appreciated!

I think your PV gen should be positive, then solar plus grid (positive import or negative export) would equal use.

Paul

Paul - 

WOW. Thanks for the quick catch on that one...I just assumed that solar would be a negative! I just added a x -1 to my feed for the solar and everything looks like it is showing up correctly now!

Thanks Again

OK, so maybe it is not quite set up correctly. According to the guide, solar generation should be showing up on the graph in yellow. I see that it is showing that I am generating, but yet it does not appear to be showing up on the graph. 

I think (just looking to see if I am correct) that I would only see yellow if I am exporting solar to the grid (ie - I am producing more power than I am using) is that correct...?

Although it does show that I exported 8% but I don't see that on the graph anywhere.

Just trying to understand what I am looking at....

Thanks

Well, it looks like I just had to give it time to start populating data! Thanks for helping me get it all going!!