Archived Forum

Doesnt look particularly healthy, looks like its logging every function call, Can you turn off the logging, I would turn off both access logs and the php stack trace, should be possible from someware in your php or apache settings, that should sort the logging.

Would be good then to establish how often and why the Fatal error: Allowed memory size of 134217728 bytes exhausted error occurs.

Ok, have to find where I can turn off the logging.

The error warning that comes most often is:

[Wed Mar 26 08:24:36.052269 2014] [:error] [pid 7976:tid 1504] [client 127.0.0.1:63946] PHP Warning:  unpack(): Type I: not enough input, need 4, have 0 in C:\\wamp\\www\\emoncms\\Modules\\feed\\engine\\PHPFiwa.php on line 465
 

I have no clue what that means.

After another crash (?) of the server:

This warning:

[Wed Mar 26 22:58:12.788141 2014] [:error] [pid 2040:tid 1480] [client 127.0.0.1:64724] PHP Warning:  unpack(): Type I: not enough input, need 4, have 0 in C:\\wamp\\www\\emoncms\\Modules\\feed\\engine\\PHPFiwa.php on line 465

seems to be the root cause for the crashes. Always after these events will the server stop working correctly. Sometimes with the fatal error shown above, this time with a hint:

[Thu Mar 27 01:04:26.931158 2014] [mpm_winnt:error] [pid 2040:tid 3480] AH00326: Server ran out of threads to serve requests. Consider raising the ThreadsPerChild setting

Anyone with an idea what happens in line 465 of PHPFiwa.php? It seems that the .meta file has fewer entries (bytes) than expected. But I checked it and all .meta files in the PHPFiwa folder have 44 bytes.

A bit of background on what the unpack error means. Each datapoint in a PHPFiwa feed takes up 4 bytes, which is the length of a single float value, (timestamps are calculated from the start time recorded in the meta file and the datapoint position in the file). The unpack error saying not enough input means it tried to read a location that was either partially or fully off the end of the file which would have caused not enough bytes to be given to unpack.

So It sounds to me like you might have one feed that is somehow corrupt, or was never created properly in the first place. Can you see a feed in your feeds list that has no data in it?

Can you recreate that feed and see if the error goes away?

Ah, just looking at the code, line 465 is actually the meta file, which also suggests the feed was not initialized properly the first time it was created

This is what I thought. Can I debug somehow, which file name is causing this error (as I said already, I have no experience with Python, PHP and the like at all)?

And there is another warning now (have not seen that before):

[Thu Mar 27 11:24:16.162816 2014] [:error] [pid 7220:tid 1488] [client 127.0.0.1:52745] PHP Warning:  filesize(): stat failed for F:/emoncmsdata/phpfiwa/1.dat in C:\\wamp\\www\\emoncms\\Modules\\feed\\engine\\PHPFiwa.php on line 437, referer: http://localhost/emoncms/feed/list
[Thu Mar 27 11:24:16.162816 2014] [:error] [pid 7220:tid 1488] [client 127.0.0.1:52745] PHP Stack trace:, referer: http://localhost/emoncms/feed/list
[Thu Mar 27 11:24:16.162816 2014] [:error] [pid 7220:tid 1488] [client 127.0.0.1:52745] PHP   1. {main}() C:\\wamp\\www\\emoncms\\index.php:0, referer: http://localhost/emoncms/feed/list
[Thu Mar 27 11:24:16.162816 2014] [:error] [pid 7220:tid 1488] [client 127.0.0.1:52745] PHP   2. controller() C:\\wamp\\www\\emoncms\\index.php:98, referer: http://localhost/emoncms/feed/list
[Thu Mar 27 11:24:16.162816 2014] [:error] [pid 7220:tid 1488] [client 127.0.0.1:52745] PHP   3. feed_controller() C:\\wamp\\www\\emoncms\\core.php:66, referer: http://localhost/emoncms/feed/list
[Thu Mar 27 11:24:16.162816 2014] [:error] [pid 7220:tid 1488] [client 127.0.0.1:52745] PHP   4. Feed->update_user_feeds_size() C:\\wamp\\www\\emoncms\\Modules\\feed\\feed_controller.php:47, referer: http://localhost/emoncms/feed/list
[Thu Mar 27 11:24:16.162816 2014] [:error] [pid 7220:tid 1488] [client 127.0.0.1:52745] PHP   5. PHPFiwa->get_feed_size() C:\\wamp\\www\\emoncms\\Modules\\feed\\feed_model.php:497, referer: http://localhost/emoncms/feed/list
[Thu Mar 27 11:24:16.162816 2014] [:error] [pid 7220:tid 1488] [client 127.0.0.1:52745] PHP   6. filesize() C:\\wamp\\www\\emoncms\\Modules\\feed\\engine\\PHPFiwa.php:437, referer: http://localhost/emoncms/feed/list

This warning comes for all feeds (1.dat, 2.dat, 3.dat, 5.dat). Why does filesize(): stat fail? Has this something to do with using slashes instead of backslashes?

After deleting all feeds and creating them anew, I have exactly the same errors. I have then changed all feeds to PHPFINA and this works for me. File size is shown correctly and no error messages anymore. Very strange as the code for these two feed engines is nearly identical ( e.g for function get_feed_size() which seems to throw the warning in my last posting).

Is there any good reason why PHPFIWA does not work (for me)?

BR, Jörg.

Could it be a folder permissions related problem, are the permissions the same on both folders?

Yes, as far as I can say permission is exactly the same (I have simply set all permissions for all users). The files were also created correctly and the feed data was shown correctly in the graphs.

I'm currently posting in http://openenergymonitor.org/emon/node/4386 about my randomly broken "live" Pi. I've got the same symptoms (PHPFIWA doesn't work, PHPFINA is OK) on raspian.

$ ls -al /var/lib/ | grep php
drwx-wx-wt  2 root      root       4096 Mar 27 17:46 php5
drwxrwxrwx  2 www-data  root       4096 Mar 27 18:25 phpfina
drwxrwxrwx  2 www-data  root       4096 Mar 27 18:22 phpfiwa
drwxrwxrwx  2 www-data  root       4096 Mar 18 00:46 phptimeseries

It's a puzzler.

Preliminary work-around: it seems that restarting the rfm12piphp process allows the PHPFIWA feeds to be updated.

Dave,

my problem is a little bit different. For me the PHPFiwa feeds work as far as storing data is concerned and the data is also presented correctly in the graphs. But the size of the feeds is not shown correctly because the filesize() function returns with an error. Very strange.

Ah, OK. I also get the stat error, but I guess that's in addition to whatever my underlying problem is!

Did you perhaps relocate the directories for the feeds in settings.php into a non-default location? Then you might have to change the directory also in the PHPFiwa.php (and the others you use). I just found this by coincidence some days ago. One of the many small mistakes one can make ..... (and updating to a new version brings the same 'feature' up again and again).

Ah I've just found the problem with the getting the size of the phpfiwa feeds, i will push a fix up.

Fix has been uploaded v8.0.6

There's no dat file (without index number) for FIWA I'm guessing? :-)

no thats it :)

I'm getting a similar behavior with the phptimeseries

​

2014-12-18 13:29:07: (mod_fastcgi.c.2676) FastCGI-stderr: PHP Warning:  unpack(): Type x: not enough input, need 1, have 0 in /var/www/emoncms/Modules/feed/engine/PHPTimeSeries.php on line 248
PHP Warning:  unpack(): Type x: not enough input, need 1, have 0 in /var/www/emoncms/Modules/feed/engine/PHPTimeSeries.php on line 248

My machine has rebooted and that means that it may have halted at the moment of writting into the feeds file and that it did not logged points for a certain period. Would any of those be a reason for the feed to become corrupt?

Is there an easy way to check through the MYD files if they are corrupt?

Cheers