First Look – 11.1.2.3

March 22, 2013 4 comments

I had the opportunity today to get my hands on the upcoming release.   It’s looking very good.   My guess on release date this year is April 22nd.

The quick take away’s from in installations point of view are:

  • You may configure all databases at once.  This means a much quicker installation.
  • The services have been renamed for the most part (see below).
  • Less Microsoft specifics when we talk about FDM EE (no ASP.NET requirement)
firstlook
Company:     Blue Stone International, http://www.bluestoneinternational.com

ODTUG “Down Under”

February 13, 2013 Leave a comment

If you have a travel budget or are in the Asia Pacific area, then mark March 21st and 22nd off on your calendar.

My good friend Cameron Lackpour is presenting at the BI/EPM Seriously Practical conference in Melbourne, Australia.   Richard Philipson from New Zealand who I also consider a friend will be there as well.  They both tend to have compelling and entertaining presentations–so pack your bags and check it out!   For those of you in the area this is a not to be missed event.

I would love to visit Australia again — with my recent job move I have too many things going on to contemplate and the budget may not be there just yet.

australia
Company:     Blue Stone International, http://www.bluestoneinternational.com
Categories: Just make it work

The building of Zeus: my new test server – Part 2

January 2, 2013 Leave a comment

Happy New Year!

I wish everyone a great 2013, today I give you a walk through of my new test server build on YouTube.   I discuss the individual pieces of a server and build it in real-time in a 90 minute video.

After the build was completed I installed Windows Server 2012 as well as Oracle Enterprise Linux 6 Update 3.   I then installed Essbase 11.1.2.2 on both systems.  Although Essbase is not technically supported on Server 2012 it was a fairly painless process — NOTE: I did attempt to put a full EPM Suite on and there was some unhappiness with the WebLogic portions so I went ahead and only put Essbase on using my other test machine for the Web portion.

Enjoy!

Company:     Blue Stone International, http://www.bluestoneinternational.com
Categories: Just make it work

A new test server – Part 1

December 24, 2012 Leave a comment

I have just finished ordering the parts for my new test server at home.  It consists of: an Intel Server Chassis supporting dual six core Xeon processors, 128 GB of Ram, and four Corsair Force GS 180 GB solid state drives.

Presuming shipping goes as expected and it arrives by 12/27 I will begin a build before the weekend which I will capture and upload to YouTube.

I’m excited to do this build and hope it is indeed compatible with the LSI 9271-8iCC controller which has been giving me headaches in my ASUS server.

The old server was aggregating a test Essbase database to 86 page files in less than 30 minutes using solid state disks as the data store; the new server and LSI card should beat that handily.

Company:     Blue Stone International, http://www.bluestoneinternational.com
Categories: Just make it work

A glimpse into the world of Hyperion Infrastructure

September 24, 2012 Leave a comment

The fun thing (or not so fun sometimes) about installing the Hyperion suite of products is the occasional quirk you run across.  Today’s post is about one of those.   This one less annoying than some and more than others.

In a new 11.1.2.2 environment one of my team was having difficulty getting Essbase Administration Services to deploy.

Google, forum searches, and My Oracle Support searches were not helpful.  I knew it was complicated enough I was not going to call Oracle Support and work through the typical process.  The thing about infrastructure compared to the functional side is we have to solve things in a matter of hours.  A few days delay and our schedule and work pipeline are potentially all out of whack.


The Problem

Essbase Administration Services which was on a separate server from the Weblogic Administration Server would not deploy properly.

The below error showed up in the EAS sysout log:

The error was Failed to create App/Comp mbeans for AppDeploymentMBean RAFRAMEWORK#11.1.2.0 Error – weblogic.management.DeploymentException: No META-INF/application.xml was found in the EAR RAFRAMEWORK#11.1.2.0

We immediately went to the Web server which had Foundation and Reporting and Analysis Services (this wasn’t our typical infrastructure however something we had to work with — not that this in itself would cause this problem).  Starting the RA Framework Web service also gave a similar error as above which narrowed the scope of the problem.


The Solution

I decided a partial re-install was necessary.  First we backed out 3 patches related to Reporting and Analysis framework.  Removal of one patch made light of a problem with the raframework.ear file which was staged in the installableApps folder.

On inspection it was clear the raframework.ear file was corrupt.  The file header looked proper however the file size was 116 bytes (obviously not how big it should be).

We continued removal of each patch and then did a re-installation of the Reporting and Analysis components.  Application of the patches then gave us a raframework.ear file which was in the acceptable range (just shy of 5 MB).


Company:     Blue Stone International, http://www.bluestoneinternational.com
Categories: Just make it work

Hyperion System Monitoring

August 5, 2012 Leave a comment

In my KSCOPE12 presentation,  Planning for and Managing Hyperion Infrastructure, I give a 100,000 foot view of monitoring.

In this article I bring monitoring down to a 20,000 foot view.

There are many products on the market to choose from for monitoring your Hyperion system(s).

In a nut shell you need a solution which has the below capabilities and characteristics:

  • Little or no false alarms
  • Ability to monitor: Database, Disk, Processor, Memory, and Network
  • Ability to extend base product capabilities with custom monitoring
  • Ability to test key parts of the system to prove it really is working

I narrow the field down to five that I believe have one or more of the following qualities: easy to implement, inexpensive, and/or purpose built for Hyperion.   You may note I have excluded solutions from: BMC, IBM, HP, and CA which have products not exhibiting the former qualities.

When implementing any new software you should go through an evaluation cycle to understand how one tool compares to another in terms of capabilities and price.


The Problem

You understand Perl scripting and want to deploy a quick solution to monitor which is free and has no real infrastructure needs and can be deployed in less than an hour.


The Solution

The below Perl code was a weekend project several months back.  It does have a feature (testing of Smart View logins)  you may wish to integrate with a more formal monitoring solution.

It is easy to implement and can run from your existing Hyperion deployment with no other software.  It relies on Perl and will work with the versions available on the 11.1.2 Hyperion line.

Modify the configuration file to suite your environment.   This means changing the server names to correspond to those which are applicable to your environment, adding or removing services, adding or removing log and keywords, setting your system outage times, and finally scheduling the script to run on an interval (usually every 5 minutes).

NOTE: The mail server configuration is hard-coded in the script so be sure to update that.

Sample config file:

#Current code has some windows specifics e.g. the \\ notation.
#UPDATE BELOW SAMPLE and change JAVA_APP_01 to your main java application server
#UPDATE BELOW SAMPLE and change ESS_APP_01 to be your Essbase
#TYPE,ID,TYPE_ATTRIB
#Down time cannot cross days.
down_time,ALL,SAT_2100_2330
down_time,ESB,ALL_0300_0430
credentials,user,password
email,OPS,notify1@myco.com
email,OPS,notify2@myco.com
#We can clean this up as we know which java.lang we really care about.
#You will probably ignore all java exceptions as there are a lot of "normal" ones
error_action,java.lang,notify
#ORA-01033: ORACLE initialization or shutdown in progress
#error_action,ORA-01033,notify
log,APSWEB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9aps-sysout.log
log,CALCWEB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9CALC-sysout.log
log,EASWEBB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9eas-sysout.log
log,SSWEB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9FoundationServices-sysout.log
log,FRWEB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9FRReports-sysout.log
log,PLNWEB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9Planning-sysout.log
log,RAFWEB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9RaFramework-sysout.log
log,RAFAGENT,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9RaFrameworkAgentOut.log
log,WAWEB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9WebAnalysis-sysout.log
log,APSWEB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9aps-sysout.log
log,CALCWEB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9CALC-sysout.log
log,EASWEBB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9eas-sysout.log
log,SSWEB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9FoundationServices-sysout.log
log,FRWEB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9FRReports-sysout.log
log,PLNWEB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9Planning-sysout.log
log,RAFWEB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9RaFramework-sysout.log
log,RAFAGENT,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9RaFrameworkAgentOut.log
log,WAWEB,\\JAVA_APP_01\c$\Oracle\Middleware\user_projects\epmsystem1\diagnostics\logs\services\HyS9WebAnalysis-sysout.log
service,APSWEB,HyS9aps
service,CALCWEB,HyS9CALC
service,EASWEB,HyS9eas
service,EPMADS,HyS9EPMADataSynchronizer
service,EPMAWEB,HyS9EPMAWebTier
service,SSWEB,HyS9FoundationServices
service,ESB,opmn_EPM_epmsystem1
service,FRWEB,HyS9FRReports
service,PLNWEB,HyS9Planning
service,RAFWEB,HyS9RaFramework
service,RAFAGENT,HyS9RaFrameworkAgent
service,WAWEB,HyS9WebAnalysis
service,RMIREG,Hyperion RMI Registry
machine,ESB,ESS_APP01
machine,RAFAGENT,JAVA_APP_01
machine,FRWEB,JAVA_APP_01
machine,PLNWEB,JAVA_APP_01
machine,EASWEB,JAVA_APP_01
machine,RMIREG,JAVA_APP_01
machine,APSWEB,JAVA_APP_01
machine,WAWEB,JAVA_APP_01
machine,SSWEB,JAVA_APP_01
machine,RAFWEB,JAVA_APP_01
machine,RAFAGENT,JAVA_APP_01
machine,FRWEB,JAVA_APP_01
machine,PLNWEB,JAVA_APP_01
machine,EASWEB,JAVA_APP_01
machine,RMIREG,JAVA_APP_01
machine,APSWEB,JAVA_APP_01
machine,WAWEB,JAVA_APP_01
machine,SSWEB,JAVA_APP_01
machine,RAFWEB,JAVA_APP_01
port,ESB,1423
port,EPMADIM,5251
port,EPMAJNI,5255
port,RAFAGENT,6860
port,FRWEB,8200
port,PLNWEB,8300
port,CALCWEB,8500
port,EASWEB,10080
port,RMIREG,11333
port,APSWEB,13080
port,WAWEB,16000
port,EPMADS,19101
port,EPMAWEB,19091
port,SSWEB,28080
port,RAFWEB,45000
appcheck,RAFAGENT,port
appcheck,ESB,port
appcheck,RAFWEB,loginwks
appcheck,FRWEB,port
appcheck,PLNWEB,port
appcheck,CALCWEB,port
appcheck,EASWEB,port
appcheck,RMIREG,port
appcheck,APSWEB,port
appcheck,WAWEB,port
appcheck,EPMADS,port
appcheck,EPMAWEB,port
appcheck,SSWEB,port

Perl script:

use strict;
use Switch;
use File::stat;
use IO::Socket;
use LWP::UserAgent;
use HTTP::Request::Common;
use HTTP::Cookies;
use URI::Escape;
use Net::SMTP;

my $user_id;
my $password;
my @Machines=();
my @OPSEmailNotify=();
my %LoggedErrors;
my %ApplicationCheck;
my %Downtime;
my %ErrorAction;
my %Logs;
my %Ports;
my %Service;

#DB Outage window Saturdays from 9:00 PM - 11:30

my $service_message="";
my $service_timestamp="";
my %day_hash = ('SUN',0,'MON',1,'TUE',2,'WED',3,'THU',4,'FRI',5,'SAT',6);

my($filepath,$junk) = split(/\./,$0);
#Name the configuration file with same name as script. e.g. system_mon.pl and system_mon.cfg or mon.pl and mon.cfg
my $config_file=$filepath.".cfg";
print "Reading $config_file\n";
open (CONFIG_FILE,$config_file) || die "cannot open file $config_file\n";

my @lines = <CONFIG_FILE>;
close(CONFIG_FILE);

my $index;
my $type;
my $id;
my $type_attrib;
my $count = @lines;
print "Found $count lines in ".$config_file."\n";
for ($index = 0;$index< $count;$index++) {
if (!($lines[$index] =~m/^\#/)) {
($type,$id,$type_attrib)=split(/,/,$lines[$index]);
chomp $type_attrib;

switch ($type) {
 case "error_action" {$ErrorAction{ $id } = $type_attrib;}
 case "down_time" {$Downtime{ $id } = $type_attrib;}
 case "log" {$Logs{ $id } = $type_attrib;}
 case "service" {$Service{ $id } = $type_attrib;}
 case "port" {$Ports{ $id } = $type_attrib;}
 case "appcheck" {$ApplicationCheck{ $id } = $type_attrib;}
 case "machine" {push(@Machines,"$id,$type_attrib");}
 case "email" {if ($id eq "OPS") {push(@OPSEmailNotify,"$type_attrib");}}
 case "credentials" { $user_id = $id; $password = $type_attrib; }
 else { print "unknown type $type, ignoring\n"};

 }
 }
}

my $ERROR_FH;
my $error_file=$filepath.".err";

if (-f $error_file) {
 open ($ERROR_FH,"<", $error_file) || die "cannot open file $error_file\n";
 while (<$ERROR_FH>) {
 chomp $_;
 my($ts,$app,$log)=split(/_/);
 $LoggedErrors{ $app.$ts } = $log;
 }
 close $ERROR_FH;
}

open ($ERROR_FH,">", $error_file) || die "cannot open file $error_file\n";

#Loop through down-time and perform checks if we are not in down_time window
if (downtime_check("ALL")) { print("Down time window, no system checks shall be ran.\n"); }
else {
 application_check($ERROR_FH);
 monitor_logs($ERROR_FH);
}

close $ERROR_FH;

sub application_check() {
my $FH = shift @_;
my $error_message="";
my $ts=localtime;
foreach (@Machines) {
my($service_id,$machine_name)=split(/,/);
if (downtime_check($service_id)==0) {
 switch ($ApplicationCheck{$service_id}) {
 case "port" { if (port_check($machine_name,$service_id)) {printf $FH "%s_%s_%s\n",$machine_name,$Ports{$service_id},$ts;
 if (!exists($LoggedErrors{$Ports{$service_id}.$machine_name})) { $error_message=$error_message."Machine Name: $machine_name Service:$Service{$service_id} Port:$Ports{$service_id} not available\n"}} }
 case "loginwks" {
 switch (logon_raf_smartview($machine_name,"IIS",$user_id,$password)) {
 case "1" { printf $FH "%s_%s_%s\n",$machine_name,"loginwks",$ts; if (!exists($LoggedErrors{"loginwks".$machine_name})) {$error_message=$error_message."logon_raf_smartview: $machine_name Invalid User or Password passed to login_raf_smartview!"; }}
 case "2" { printf $FH "%s_%s_%s\n",$machine_name,"loginwks",$ts; if (!exists($LoggedErrors{"loginwks".$machine_name})) {$error_message=$error_message."logon_raf_smartview: $machine_name Service:".$Service{'SSWEB'}." FAILED\n";}}
 case "3" { printf $FH "%s_%s_%s\n",$machine_name,"loginwks",$ts; if (!exists($LoggedErrors{"loginwks".$machine_name})) {$error_message=$error_message."logon_raf_smartview: $machine_name Service:".$Service{'RAFWEB'}." FAILED\n";}}
 case "4" { printf $FH "%s_%s_%s\n",$machine_name,"loginwks",$ts; if (!exists($LoggedErrors{"loginwks".$machine_name})) {$error_message=$error_message."logon_raf_smartview: $machine_name Service:".$Service{'RAFAGENT'}." FAILED\n";}}
 else {}
 }
 }
 else { print "No application check found for type $service_id\n"};
 }

}
}
if (length($error_message)>0) { email_alert("Hyperion Log Alert",$error_message,\@OPSEmailNotify);}
}

sub restart_service {
my $computer_name=shift @_;
my $service_name=shift @_;
system("sc stop $service_name");
sleep(30);
system("sc start $service_name");
}

sub port_check () {
my $machine_name=shift @_;
my $service_id=shift @_;
my $sock = new IO::Socket::INET (
 PeerAddr => $machine_name,
 PeerPort => $Ports{$service_id},
 Proto => 'tcp',
 Timeout => '2',
 );
if ($sock) { close($sock); return 0; }
else { return 1;}
}

sub monitor_logs {
my $FH = shift @_;
my $ts;
my $error_message="";

print "Monitor Logs\n";

while ( my ($app_id, $log_path) = each(%Logs) ) {
if (-f $log_path) {
 open (FILE, "< $log_path") or die("Cannot open input file $log_path\n");
 while () {
 if (substr($_, 0, 1) eq "<") { $service_message=$_; my $junk; ($ts,$junk)=split(/\>/);
 ($junk,$ts)=split(/\0) { email_alert("Hyperion Log Alert",$error_message,\@OPSEmailNotify);}
}

sub logon_raf_smartview() {
my $SERVER=shift;
my $WEBSERVER=shift;
my $USER=shift;
my $PASSWORD=shift;
my $CLIENT_VERSION="4.2.0.0.0";
my $SERVER_PORT;

if ($WEBSERVER !~ m/IIS/) { $SERVER_PORT=$SERVER.":19000"; }
else {$SERVER_PORT=$SERVER;}

my $userAgent = LWP::UserAgent->new(agent => 'HttpApp/1.0');

# Store Cookies
$userAgent->cookie_jar(
 HTTP::Cookies->new(
 file => 'mycookies.txt',
 autosave => 1
 )
 );

my $message = "<req_ConnectToProvider>".$CLIENT_VERSION."en_US";
my $response = $userAgent->request(POST 'http://'.$SERVER_PORT.'/workspace/SmartViewProviders',
Content_Type => 'text/xml',
Content => $message);

if (!$response->is_success || $response->as_string !~ m/Oracle Enterprise Performance Management System Workspace/) {
print("login_raf_smartview: Failed to receive workspace response from $SERVER_PORT, check Hyperion Foundation Services - Managed Server\n");
return 2;
}

my $message = "<req_GetProvisionedDataSources>";
my $response = $userAgent->request(POST 'http://'.$SERVER_PORT.'/workspace/SmartViewProviders',
Content_Type => 'text/xml',
Content => $message);

if (!$response->is_success || $response->as_string !~ m/User authentication needed/) {
print("login_raf_smartview: Failed to receive workspace authentication challenge from $SERVER_PORT, check Hyperion Foundation Services - Managed Server\n");
return 2;
}

my $message = "<req_GetProvisionedDataSources>".$USER."".$PASSWORD."";
my $response = $userAgent->request(POST 'http://'.$SERVER_PORT.'/workspace/SmartViewProviders',
Content_Type => 'text/xml',
Content => $message);

if ($response->is_success && $response->as_string =~ m/Invalid login/) {
print("login_raf_smartview: Invalid username or password passed to login_raf_smartview function in monitoring script\n");
return 1;
}

if (!$response->is_success || $response->as_string !~ m/\<sso\>/) {
print("login_raf_smartview: Failed to receive sso token from $SERVER_PORT, check Hyperion Foundation Services - Managed Server\n");
return 2;
}

my $sso_token = substr($response->as_string,index($response->as_string,"")+5,index($response->as_string,"")-index($response->as_string,"")-5);

$message="<req_GetProvisionedDataSources>".$sso_token."";
my $response = $userAgent->request(POST 'http://'.$SERVER_PORT.'/workspace/SmartViewProviders',
Content_Type => 'text/xml',
Content => $message);

if (!$response->is_success || $response->as_string !~ m/res_GetProvisionedDataSources/) {
print("login_raf_smartview: Failed to receive response to GetProvisionedDataSources request from $SERVER_PORT, check Hyperion Foundation Services - Managed Server\n");
return 2;
}

my $message = "rcp_version=1.4&sso_token=".uri_escape($sso_token)."&applicationtype=officeAddin&applicationversion=1.0.0&format=excel.2003&hycmnaddin18467=41&action=server";
my $response = $userAgent->request(POST 'http://'.$SERVER_PORT.'/raframework/browse/listXML',
Content_Type => 'application/x-www-form-urlencoded;charset=UTF-8',
Content => $message);

if (!$response->is_success && $response->as_string =~ m/Service Unavailable/) {
print("login_raf_smartview: Failed to conect to $SERVER_PORT. Check Hyperion Reporting and Analysis Framework Web Application\n");
return 3;
}

if ($response->is_success && $response->as_string =~ m/port 6800/) {
print("login_raf_smartview: Failed to conect. Server cannot connect to port 6800, check Hyperion Reporting Analysis Framework\n");
return 4;
}

print("login_raf_smartview: passed for $SERVER_PORT\n");
return 0;
}

sub downtime_check() {
my $service_id=shift @_;

my $system_downtime=0;
my ($seconds,$minute,$hour,$day,$month,$year,$wday,$yday,$isdst)=localtime(time);
my $hourmin=$hour*100 + $minute;

if (exists($Downtime{$service_id})) {
 my($dow,$start_time,$end_time)=split(/_/,$Downtime{$service_id});
 if ( (uc($dow) eq "ALL" || $day_hash{uc($dow)} == $wday)&& $hourmin>=$start_time && $hourmin<=$end_time) { return 1;} }
return 0; }

sub email_alert {
my $SUBJ=shift;
my $MESSAGE=shift;
my $NOTIFY_USER_ARRAY=shift;
my $MAIL_SERVER='smtpl.myco.com';
my $BATCH_USER='Hyperion_Mon@myco.com';
my $mailto;
my $smtp = Net::SMTP->new($MAIL_SERVER);
print $smtp->banner();
$smtp->mail($BATCH_USER);

print $smtp->code();
print $smtp->message();

$smtp->recipient(@$NOTIFY_USER_ARRAY);

print $smtp->code();
print $smtp->message();

$smtp->data();
foreach $mailto (@$NOTIFY_USER_ARRAY) {
print "Notifying $mailto \n";
$smtp->datasend("To: $mailto\n");
}
$smtp->datasend("Subject: $ENV{COMPUTERNAME} - $SUBJ\n\n");
$smtp->datasend("\n");
$smtp->datasend("$MESSAGE\n");
$smtp->dataend();

print $smtp->code();
print $smtp->message();

$smtp->quit;
}
Company:     Blue Stone International, http://www.bluestoneinternational.com
Categories: Just make it work

Time to move the blog

August 4, 2012 Leave a comment

Moving Time

I’ve decided to move the blog to a WordPress hosted blog.  The main decision driving this is it’s easier to manage and if something obviously breaks I can contact someone rather than being the person to contact.   Wanting to do too many things drives this.

What this means?  It means you will see the blog evolve and eventually become more static once I stop fiddling with things.  I have saved my old posts and will put up some of the most popular or ones I consider most important.

Regards,

John

Categories: General News
Follow

Get every new post delivered to your Inbox.