Pandora FMS community forums

Full Version: yum update to FMS v7.0NG.734 - Build 191231 - MR 25 broke the system
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
I ran yum update on the server today which update PandoraFMS to 
pandorafms_console-7.0NG.734-1.noarch
pandorafms_server-7.0NG.734-1.noarch


After a restart the stylesheets appear to be broken in the console 

And none of the agents are updating either via remote checks, plugins or remote install agents. Effectively the system is broken

I've checked the MR directory and have ensured that all *.sql are applied

I also search for release notes and found that .734 is not mentioned at all. So perhaps this slipped into the repository as an error?

Any assistance or news of a nightly fix would be appreciated

Cheers
Jodi

Partial logs below
[[email protected] ~]# tail /var/log/pandora/pandora_server.log
2019-05-24 15:37:57 pandora [V1] [E] 'pandora': DBD::mysql::db do failed: Unknown column 'ff_normal' in 'field list' at /usr/lib/perl5/PandoraFMS/DB.pm line 1146.

2019-05-24 15:37:57 pandora [V1] Pandora FMS Server 'pandora' unhandled error.
2019-05-24 15:37:57 pandora [V1] [E] 'pandora': 21 at /usr/lib/perl5/PandoraFMS/DB.pm line 1154.

2019-05-24 15:37:57 pandora [V1] Pandora FMS Server 'pandora' unhandled error.
2019-05-24 15:38:01 pandora [V1] [E] 'pandora': 21 at /usr/lib/perl5/PandoraFMS/DB.pm line 1154.

2019-05-24 15:38:01 pandora [V1] Pandora FMS Server 'pandora' unhandled error.
2019-05-24 15:38:01 pandora [V1] Pandora FMS Server restarting () in 60 seconds.

[[email protected] ~]# tail /var/log/pandora/pandora_server.error
DBD::mysql::db do failed: Unknown column 'ff_normal' in 'field list' at /usr/lib/perl5/PandoraFMS/DB.pm line 1146.
Use of uninitialized value in numeric eq (==) at /usr/lib/perl5/PandoraFMS/Core.pm line 1626.
Use of uninitialized value in numeric eq (==) at /usr/lib/perl5/PandoraFMS/Core.pm line 1648.
DBD::mysql::db do failed: Unknown column 'ff_normal' in 'field list' at /usr/lib/perl5/PandoraFMS/DB.pm line 1146.
Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
(05-24-2019, 03:36 AM)jwthomson Wrote: [ -> ]I ran yum update on the server today which update PandoraFMS to 
pandorafms_console-7.0NG.734-1.noarch
pandorafms_server-7.0NG.734-1.noarch


After a restart the stylesheets appear to be broken in the console 

And none of the agents are updating either via remote checks, plugins or remote install agents. Effectively the system is broken

I've checked the MR directory and have ensured that all *.sql are applied

I also search for release notes and found that .734 is not mentioned at all. So perhaps this slipped into the repository as an error?

Any assistance or news of a nightly fix would be appreciated

Cheers
Jodi

Partial logs below
[[email protected] ~]# tail /var/log/pandora/pandora_server.log
2019-05-24 15:37:57 pandora [V1] [E] 'pandora': DBD::mysql::db do failed: Unknown column 'ff_normal' in 'field list' at /usr/lib/perl5/PandoraFMS/DB.pm line 1146.

2019-05-24 15:37:57 pandora [V1] Pandora FMS Server 'pandora' unhandled error.
2019-05-24 15:37:57 pandora [V1] [E] 'pandora': 21 at /usr/lib/perl5/PandoraFMS/DB.pm line 1154.

2019-05-24 15:37:57 pandora [V1] Pandora FMS Server 'pandora' unhandled error.
2019-05-24 15:38:01 pandora [V1] [E] 'pandora': 21 at /usr/lib/perl5/PandoraFMS/DB.pm line 1154.

2019-05-24 15:38:01 pandora [V1] Pandora FMS Server 'pandora' unhandled error.
2019-05-24 15:38:01 pandora [V1] Pandora FMS Server restarting () in 60 seconds.

[[email protected] ~]# tail /var/log/pandora/pandora_server.error
DBD::mysql::db do failed: Unknown column 'ff_normal' in 'field list' at /usr/lib/perl5/PandoraFMS/DB.pm line 1146.
Use of uninitialized value in numeric eq (==) at /usr/lib/perl5/PandoraFMS/Core.pm line 1626.
Use of uninitialized value in numeric eq (==) at /usr/lib/perl5/PandoraFMS/Core.pm line 1648.
DBD::mysql::db do failed: Unknown column 'ff_normal' in 'field list' at /usr/lib/perl5/PandoraFMS/DB.pm line 1146.
Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.

Greetings, jwthomson

Our interface changes in version 734, so you will have to delete cache to properly see the new environment. 

However, please access console's Update Manager to check that every package is up to date and send us a screenshot of the footer to check which version and MR you have applied. 

Kind regards, 

Eduardo.
Hello

Refreshing cache did resolve stylesheet issue. However that was a minor problem

The real issue is that none of the checks are working. Attached are screenshots showing last contact being 3-days ago, which is when I did update. And also from online update manager showing latest package installed


Also attached is latest log file showing errors and restarts - partial shown below


[[email protected] ~]# tail /var/log/pandora/pandora_server.log
2019-05-24 17:28:10 pandora [V1] [E] 'pandora': Can't call method "disconnect" on an undefined value at /usr/lib/perl5/PandoraFMS/DB.pm line 202.

2019-05-24 17:28:10 pandora [V1] Pandora FMS Server 'pandora' unhandled error.
2019-05-24 17:28:15 pandora [V1] [E] 'pandora': DBI connect('pandora:127.0.0.1:3306','pandora',...) failed: Too many connections at /usr/lib/perl5/PandoraFMS/DB.pm line 128 thread 4321.

2019-05-24 17:28:15 pandora [V1] Pandora FMS Server 'pandora' unhandled error.
2019-05-24 17:28:15 pandora [V1] Pandora FMS Server restarting () in 60 seconds.
2019-05-24 17:29:21 pandora [V1] [E] 'pandora': DBI connect('pandora:127.0.0.1:3306','pandora',...) failed: Too many connections at /usr/lib/perl5/PandoraFMS/DB.pm line 128.

2019-05-24 17:29:21 pandora [V1] Pandora FMS Server 'pandora' unhandled error.


[attachment=2870][attachment=2869][attachment=2868]
(05-26-2019, 08:06 PM)jwthomson Wrote: [ -> ]Hello

Refreshing cache did resolve stylesheet issue. However that was a minor problem

The real issue is that none of the checks are working. Attached are screenshots showing last contact being 3-days ago, which is when I did update. And also from online update manager showing latest package installed


Also attached is latest log file showing errors and restarts - partial shown below


[[email protected] ~]# tail /var/log/pandora/pandora_server.log
2019-05-24 17:28:10 pandora [V1] [E] 'pandora': Can't call method "disconnect" on an undefined value at /usr/lib/perl5/PandoraFMS/DB.pm line 202.

2019-05-24 17:28:10 pandora [V1] Pandora FMS Server 'pandora' unhandled error.
2019-05-24 17:28:15 pandora [V1] [E] 'pandora': DBI connect('pandora:127.0.0.1:3306','pandora',...) failed: Too many connections at /usr/lib/perl5/PandoraFMS/DB.pm line 128 thread 4321.

2019-05-24 17:28:15 pandora [V1] Pandora FMS Server 'pandora' unhandled error.
2019-05-24 17:28:15 pandora [V1] Pandora FMS Server restarting () in 60 seconds.
2019-05-24 17:29:21 pandora [V1] [E] 'pandora': DBI connect('pandora:127.0.0.1:3306','pandora',...) failed: Too many connections at /usr/lib/perl5/PandoraFMS/DB.pm line 128.

2019-05-24 17:29:21 pandora [V1] Pandora FMS Server 'pandora' unhandled error.

I should also note that I have checked connection to MySQL DB as pandora user and it is successful

So it turns out there were 2 more minor release *.sql files
26.sql & 27.sql
which hadn't been applied automatically with the RPM during then initial 'yum update' but appeared after I ran a 'yum reinstall pandorafms-server'

I have applied those and now everything appears to be back to normal

Note the MR value in the console still appeared as 25 - I had to manually update tconfig table to reflect change