problems after update from 8.4 to 9.3

Submitted by MueThoS on Tue, 05/01/2016 - 16:34

Hello there,

sorry for my bad English. I have a problem and no idea to search for a solution.

I have an raspberry pi with low write functionality.

And i have updated the emoncms to 9.3.

After i have solved the problems with settings.php i have common problems.

1. updates from nodes per url is OK but the emontx over 433mhz will not update.

2. i am not sure if this normal: when i look at "top" in command line i see the apache2 service up to 12 times.

3. the emonhub.log where flooded with messages.

#0 /var/www/emoncms/Modules/process/process_processlist.php(905): DateTimeZone->__construct('0')

#1 /var/www/emoncms/Modules/process/process_processlist.php(315): Process_ProcessList->getstartday(1452010226)

#2 [internal function]: Process_ProcessList->power_to_kwhd('5', 1452010226, 14, Array, Object(Process))

#3 /var/www/emoncms/Modules/process/process_model.php(48): call_user_func_array(Array, Array)

#4 /var/www/emoncms/Modules/process/process_model.php(88): Process->__call('power_to_kwhd', Array)

#5 /var/www/emoncms/Modules/process/process_model.php(88): Process->power_to_kwhd('5', 1452010226, 14, Array)

#6 /var/www/emoncms/Modules/input/input_controller.php(165): Process->input(1452010226, 14, '1:1,4:4,5:5', Array)

#7 /var/www/emoncms/core.php(64): input_controller()

#8 /var/www/emoncms/index.php(146): controller('input')

#9 {ma in /var/www/emoncms/Modules/process/process_processlist.php on line 905 

2016-01-05 17:29:42,629 INFO emonCMS_local sending: http://localhost/emoncms/input/bulk.json?apikey=E-M-O-N-C-M-S-A-P-I-K-E-...

=[[1452010226.63,10,14,17,158,0,230,163,-27],[1452010237.74,10,16,17,156,0,230,163,-30],[1452010248.85,10,16,16,160,0,231,163,-27]

,[1452010260.17,10,11,17,160,0,230,163,-29],[1452010271.28,10,14,17,157,0,230,163,-32],[1452010282.4,10,14,16,235,0,230,163,-28],[

1452010293.73,10,10,17,189,0,230,163,-30],[1452010304.84,10,12,18,181,0,230,163,-26],[1452010315.94,10,12,18,179,0,231,163,-31],[1

452010327.28,10,14,17,177,0,231,163,-27],[1452010338.38,10,11,15,159,0,231,163,-28],[1452010349.49,10,14,15,156,0,230,163,-28],[14

52010360.83,10,13,18,153,0,231,163,-30],[1452010371.94,10,16,16,157,0,231,163,-29],[1452010383.05,10,14,14,156,0,230,163,-28],[145

2010394.36,10,14,16,155,0,229,163,-28],[1452010405.48,10,13,17,155,0,230,163,-29],[1452010416.59,10,11,17,156,0,230,163,-28],[1452

010427.92,10,11,17,156,0,230,163,-30],[1452010439.05,10,13,18,156,0,230,163,-30],[1452010450.17,10,11,15,154,0,230,163,-27],[14520

10461.48,10,12,16,156,0,230,163,-28],[1452010483.91,10,11,16,158,0,230,163,-34],[1452010495.01,10,25,16,155,0,230,163,-27],[1452010506.13,10,23,18,155,0,229,162,-30],[1452010517.46,10,22,15,154,0,230,163,-27],[1452010528.58,10,23,16,156,0,230,163,-30],[1452010539.69,10,22,16,155,0,230,163,-29],[1452010551.01,10,20,15,157,0,229,163,-33],[1452010562.12,10,20,17,155,0,230,163,-27],[1452010573.23,10,18,15,157,0,230,163,-28],[1452010584.55,10,21,18,156,0,230,163,-34],[1452010595.68,10,19,17,155,0,230,163,-34],[1452010606.8,10,18,14,154,0,230,163,-29],[1452010618.12,10,19,17,156,0,230,163,-30],[1452010629.23,10,18,16,156,0,230,163,-30],[1452010640.34,10,18,18,155,0,230,163,-29],[1452010651.65,10,18,16,157,0,231,163,-30],[1452010662.78,10,17,16,158,0,230,163,-21],[1452010673.91,10,16,18,157,0,231,163,-28],[1452010685.26,10,18,114,155,0,230,163,-22],[1452010696.38,10,17,122,158,0,230,163,-30],[1452010707.49,10,18,120,154,0,230,163,-27],[1452010718.81,10,17,120,156,0,230,163,-28],[1452010729.94,10,19,121,155,0,230,162,-29],[1452010741.04,10,17,119,156,0,230,162,-32],[1452010763.48,10,17,117,155,0,230,163,-23],[1452010774.6,10,17,117,158,0,231,163,-27],[1452010785.92,10,17,114,158,0,231,163,-31],[1452010797.02,10,16,111,159,0,231,163,-27],[1452010808.15,10,19,107,157,0,231,163,-28],[1452010819.48,10,18,106,219,0,230,163,-24],[1452010830.62,10,18,104,186,0,230,163,-30],[1452010841.73,10,17,105,183,0,230,163,-31],[1452010852.84,10,17,104,178,0,230,163,-28],[1452010864.17,10,15,103,176,0,230,163,-30],[1452010875.29,10,17,102,160,0,230,163,-28],[1452010886.39,10,19,102,161,0,230,163,-28],[1452010897.71,10,18,102,156,0,231,163,-29],[1452010908.83,10,19,102,155,0,230,163,-29],[1452010919.94,10,17,102,153,0,230,163,-29],[1452010931.26,10,11,102,153,0,230,163,-28],[1452010942.37,10,13,103,154,0,230,163,-31],[1452010953.68,10,15,103,157,0,230,163,-23],[1452010964.79,10,17,102,154,0,230,163,-29],[1452010975.91,10,15,102,157,0,230,163,-27],[1452010987.04,10,12,103,156,0,230,163,-28],[1452010998.38,10,16,125,156,0,230,163,-25],[1452011009.5,10,13,118,154,0,230,163,-29],[1452011020.62,10,13,114,155,0,230,163,-32],[1452011031.95,10,14,116,154,0,230,163,-28],[1452011043.06,10,14,112,156,0,230,163,-22],[1452011054.19,10,14,113,157,0,230,163,-26],[1452011065.51,10,15,111,159,0,230,163,-30],[1452011076.64,10,13,110,155,0,230,163,-28],[1452011087.75,10,15,109,157,0,230,163,-31],[1452011099.07,10,12,110,154,0,230,163,-28],[1452011110.19,10,14,107,156,0,230,163,-30],[1452011121.3,10,23,106,156,0,230,163,-23],[1452011132.62,10,21,106,157,0,231,163,-32],[1452011143.73,10,19,106,160,0,231,163,-27],[1452011154.87,10,20,106,189,0,231,163,-30],[1452011166.0,10,21,106,185,0,231,163,-29],[1452011177.31,10,21,105,181,0,231,163,-28],[1452011188.43,10,19,105,174,0,231,163,-30],[1452011199.54,10,18,103,173,0,231,163,-29],[1452011210.88,10,66,105,159,0

i have make a big mistake by making the backup: i have removed the files instead of rename. Wrong command, shit. i cant go back :,-(

I hope someone can tell me what to do.

Re: problems after update from 8.4 to 9.3

Submitted by MueThoS on Tue, 05/01/2016 - 20:25.

addendum:

Emoncms Version low-write 9.3 | 2015.12.30
Buffer 389 feed points pending write
Writer Daemon is not running, start it at ~/scripts/feedwriter

Is this my Problem?

i tryed to strart it with: sudo ./feedwriter start

does not work

something from error.log:

Tue Jan 05 18:33:48 2016] [error] [client ::1] PHP Fatal error: Uncaught exception 'Exception' with message 'DateTimeZone::__construct(): Unknown or bad timezone (0)' in /var/www/emoncms/Modules/process/process_processlist.php:905\nStack trace:\n#0 /var/www/emoncms/Modules/process/process_processlist.php(905): DateTimeZone->__construct('0')\n#1 /var/www/emoncms/Modules/process/process_processlist.php(315): Process_ProcessList->getstartday(1452014945)\n#2 [internal function]: Process_ProcessList->power_to_kwhd('5', 1452014945, 11, Array, Object(Process))\n#3 /var/www/emoncms/Modules/process/process_model.php(48): call_user_func_array(Array, Array)\n#4 /var/www/emoncms/Modules/process/process_model.php(88): Process->__call('power_to_kwhd', Array)\n#5 /var/www/emoncms/Modules/process/process_model.php(88): Process->power_to_kwhd('5', 1452014945, 11, Array)\n#6 /var/www/emoncms/Modules/input/input_controller.php(165): Process->input(1452014945, 11, '1:1,4:4,5:5', Array)\n#7 /var/www/emoncms/core.php(64): input_controller()\n#8 /var/www/emoncms/index.php(146): controller('input')\n#9 {ma in /var/www/emoncms/Modules/process/process_processlist.php on line 905

Re: problems after update from 8.4 to 9.3

Submitted by Paul Reed on Tue, 05/01/2016 - 21:19.

Did it work OK after the update and before you put it in low-write mode? - you need to isolate where the issue has occurred, if necessary change the mode back to full-write mode and test.

Which guide did you follow to get this far?

Have you activated feedwriter as per the low-write guide?

Paul

Re: problems after update from 8.4 to 9.3

Submitted by joyrider3774 on Tue, 05/01/2016 - 21:35.

just a wild guess but since the exceptions message is saying "'DateTimeZone::__construct(): Unknown or bad timezone (0)" couldn't it be that the database still has the offset value written in it instead of the timezone like europe/brussels for example. I saw anothet thread with someone else that upgraded as well and still had that offset value in it's database instead of an actual timezone. Perhaps going to account settings and chosing a new timezone saving it and the going back to the correct timezone saves it correctly to the database ? i'm refering to the feedwriter error in the last post and changes in timezone settings / handling from emoncms 8.xx to 9.xx

this was the other thread with the timezone problems and still having the integer offset value in it http://openenergymonitor.org/emon/node/11720 i think the exception above might be refering to the same issue

Re: problems after update from 8.4 to 9.3

Submitted by MueThoS on Wed, 06/01/2016 - 06:15.

first thank you for the tips.
the problem with the Feed Updates was really the Time Zone.
I would not have thought so.

I have also worked thru the manual again for low-write mode.
and once started with logging:

PHP Fatal error: Call to undefined method PHPFiwa::post_bulk_prepare() in /var/www/emoncms/Modules/feed/engine/RedisBuffer.php on line 213

this is the reason why it not runs.

is there another settings file to modify for this?

Re: problems after update from 8.4 to 9.3

Submitted by joyrider3774 on Wed, 06/01/2016 - 08:14.

all i can tell from that is that the PHPFIWA class has no function post_bulk_prepare and looking at the sources that is indeed the case. I know you have to disable PHPFIWA engine in the settings but i don't know what happens to existing PHPFIWA feeds and what you have to do with them to make them work (like converting to another engine or something). Maybe @paul reed knows more about that, can't really help with that one.

edit: looking at http://openenergymonitor.org/emon/node/11009 low write mode is not availible for PHPFIWA it's not implemented (yet) and you have to disable it in settings.php but as said before i don't know what that means for existing phpfiwa feeds.

Re: problems after update from 8.4 to 9.3

Submitted by MueThoS on Wed, 06/01/2016 - 08:51.

in settings.php i have this:

//4 #### Engine settings
    $feed_settings = array(
        // Supported engines. Uncommented engines will not be available for user to create a new feed using it. Existing feeds with a hid
den engine still work.
        // Place a ',' as the first character on all uncommented engines lines but first.
        // If using emoncms in low-write mode, ensure that PHPFIWA is disabled by removing the leading //, from the PHPFIWA entry
        'engines_hidden'=>array(
            Engine::MYSQL,           // 0 Mysql traditional
            //Engine::MYSQLMEMORY,   // 8 Mysql with MEMORY tables on RAM. All data is lost on shutdown
            //Engine::PHPTIMESERIES, // 2
            //Engine::PHPFINA,       // 5
            Engine::PHPFIWA          // 6 PHPFIWA disabled for compatibility with Low-write mode
        ),

i has the low-write bevor the update. And everything works.

Re: problems after update from 8.4 to 9.3

Submitted by Paul Reed on Wed, 06/01/2016 - 09:20.

Do you have any phpfiwa feeds?

Re: problems after update from 8.4 to 9.3

Submitted by MueThoS on Wed, 06/01/2016 - 11:13.

ok, the problem was the phpfiwa feeds.
I have all deleted and the feedwriter is running.
which just amazes me that it worked before.
Although there are now 1 year data away but punishment must be 8-)

For now all my problems are solved.

I have to set up my feeds and will see is there another problem.

Thanks for now you saved my day.

Re: problems after update from 8.4 to 9.3

Submitted by Paul Reed on Wed, 06/01/2016 - 11:23.

You could of course have converted the phpfiwa feeds to phpfina, instead of deleting them.
See git repo emoncms/usefulscripts for the script.

Paul

Re: problems after update from 8.4 to 9.3

Submitted by MueThoS on Wed, 06/01/2016 - 15:05.

Now that you mention it.
No matter, the main thing is that ist is running again.

the data come on by themselves...

Thanks a lot

Archived Forum