Installation and Error resolution (continued…)

This is the fourth post on installing Oracle eBusiness suite 11i on Ubuntu. Previous posts are:

Continuing from the last post, I will continue detailing errors met during the install, resolution steps and completing the install.

iv. Fourth Error: This dialog was generated with a reference to “running APPL_TOP for VIS instance” , when the overall installation was about 60% complete (Step 3 of 5).

Oracle Applications Rapid Install Wizard Error #4

On checking the log file, the following message was the last line:

Please refer to the remaining logs on middle tier at – /d03/oracle.11.5.10/visappl/admin/VIS_jiraiya/log/12231153.log.

This contained the following entry:

Executing: /d02/oracle.11.5.10/viscomn/temp/adrunias.sh APPS APPS
There was an error while running the command – /d02/oracle.11.5.10/viscomn/temp/adrunias.sh APPS APPS
/d02/oracle.11.5.10/viscomn/temp/adrunias.sh: 199: Syntax error: Bad substitution
RW-50010: Error: – script has returned an error: 2
RW-50004: Error code received when running external process. Check log file for details.
Running APPL_TOP Install Driver for VIS instance

Research into the “bad substitution” error, suggested that it was due to an inoperable script command, perhaps due to differences in the sh implementation on Ubuntu Linux from that used in developing/certifying Oracle EBS. In order to resolve, the following commands were issued:

$ cd /usr/bin
$ mv sh sh.orig
$ ln -fs bash sh

This set up the sh command as an alias of the bash (Bourne Again Shell), which in many cases, is more compatible with standard Unix sh than Linux sh. Retrying the process succeeded, indicating that the issue was now resolved.

v. Fifth error: At about 80% completion (step 4 of 5) for the install process, the progress bar stopped moving (and disk processing stopped), with the progress message “Starting CVM on Middle Tier”. Reviewing the log file indicated the following error:

/d02/oracle.11.5.10/visora/iAS/Apache/perl/bin/perl: error while loading shared libraries: libdb.so.3: cannot open shared object file: No such file or directory

Result : FAILED
===========================================================================
AC-50207: Fatal: Failed to execute one or more of the config tools during Context Value Management
Deactivating Context Value Management System.
System Exit Status: 1
===========================================================================

Restored the Context file in :
/d03/oracle.11.5.10/visappl/admin/VIS_jiraiya.xml

Aborting the running of Context Value Management
java.lang.Exception: Fatal Exception

This seemed to suggest that a shared library for perl execution was unavailable, leading to th failure of the CVM process. To resolve, the appropriate library file was located and a direct link to it made in the /usr/lib directory, using the following commands:

$ apt-get install libdb3
$ ln -s /usr/lib/libdb3.so.3.0.2 /usr/lib/libdb.so.3
$ sudo ln -s /usr/lib/libgdbm.so.3 /usr/lib/libgdbm.so.2

Re-running rapidwizard in restart mode then allowed the installation to continue to the Post-Install checks.

Post-Install Tasks and Issues

Install Oracle Applications - Post-Install Checks

The dialog indicated failure of checks for HTTP, JSP and PHP, with failure to access port 8000 on the server. Running nmap to determine the open ports provided details as follows:

$ sudo nmap localhost

Starting Nmap 4.20 ( http://insecure.org ) at 2007-12-27 23:15 EST
Interesting ports on localhost (127.0.0.1):
Not shown: 1692 closed ports
PORT STATE SERVICE
139/tcp open netbios-ssn
445/tcp open microsoft-ds
631/tcp open ipp
1521/tcp open oracle
7000/tcp open afs3-fileserver

Nmap finished: 1 IP address (1 host up) scanned in 0.095 seconds

This allowed me to verify that port 8000 was open on the server, but nothing was listening, suggesting that the services had not been started.

Reviewing the log file provided the following details:

Setting service Oracle Apache Server VIS_jiraiya to mode 2
Executing service control script:
/d02/oracle.11.5.10/viscomn/admin/scripts/VIS_jiraiya/adapcctl.sh start
Timeout specified in context file: 100 second(s)

script returned:
****************************************************

adapcctl.sh version 115.43

Starting Apache Web Server Listener (dedicated HTTP) …
Starting Apache Web Server Listener (dedicated PLSQL) …

adapcctl.sh: exiting with status 3

This made it apparent that the Apache server was not starting correctly. On reviewing the adapcctl.sh script, it was determined that the command line for the apache listener was the following:

/d02/oracle.11.5.10/visora/iAS/Apache/Apache/bin/apachectl start

Running this stand-alone, provided the following error message:

Syntax error on line 310 of /d02/oracle.11.5.10/visora/iAS/Apache/Apache/conf/httpd.conf:
Cannot load /d02/oracle.11.5.10/visora/iAS/Apache/Apache/libexec/mod_auth_dbm.so into server: /d02/oracle.11.5.10/visora/iAS/Apache/Apache/libexec/mod_auth_dbm.so: undefined symbol: dbm_fetch

Syntax error on line 254 of /d02/oracle.11.5.10/visora/iAS/Apache/Apache/conf/httpd_pls.conf:
Cannot load /d02/oracle.11.5.10/visora/iAS/Apache/Apache/libexec/mod_rewrite.so into server: /d02/oracle.11.5.10/visora/iAS/Apache/Apache/libexec/mod_rewrite.so: undefined symbol: dbm_fetch

Reviewing the associated httpd.conf and httpd_pls.conf Apache configuration files (along with some Google searching) indicated that the simplest way to ensure that the httpd process starts is to move the line that loads the mod_auth_dbm.so module to the end of the Loadmodule commands.

LoadModule dbm_auth_module libexec/mod_auth_dbm.so

I also moved the line that loads the mod_rewrite.so module to the end of the module load list. Saving the updated files, and retrying the adapcctl.sh script (to start the web processes) was now successful.

On further review of the log file, the summary report indicated failure of the application tier listener startup process:

[Service Control Execution Report]
The report format is:
<Service> <Script> <Status>

Oracle Apache Server VIS_jiraiya adapcctl.sh Started
OracleTNSListener80APPS_VIS_jiraiya adalnctl.sh Failed
OracleConcMgrVIS_jiraiya adcmctl.sh Started
OracleFormsServer-Forms60VIS_jiraiya adfrmctl.sh Started
OracleReportServer-Rep60_VIS adrepctl.sh Started
Oracle Metrics Client VIS_jiraiya adfmcctl.sh Started
Oracle Metrics Server VIS_jiraiya adfmsctl.sh Started
Oracle Fulfillment Server VIS_jiraiya jtffmctl.sh Started
Oracle Discoverer services VIS_jiraiya addisctl.sh Failed
Oracle Restricted Apache Server VIS_jiraiya adaprstctl.sh Disabled
Oracle Apache Server VIS_jiraiya for PL/SQL adapcctl.sh Disabled
Oracle TCF SocketServer VIS_jiraiya adtcfctl.sh Disabled
Oracle ICSM VIS_jiraiya ieoicsm.sh Disabled
Oracle iProcurement Bulk Loader VIS_jiraiya icxblkctl.sh Disabled

The details in the log for the listener startup were as follows:

/d02/oracle.11.5.10/viscomn/admin/scripts/VIS_jiraiya/adalnctl.sh start
Timeout specified in context file: 100 second(s)

script returned:
****************************************************

adalnctl.sh version

Checking for FNDFS executable.
Starting listener process APPS_VIS.

adalnctl.sh: exiting with status 1


On reviewing the /d02/oracle.11.5.10/viscomn/admin/log/VIS_jiraiya/adalnctl.txt log file,the following results from the listener control startup was captured:

LSNRCTL for Linux: Version 9.2.0.6.0 – Production on 13-JAN-2008 12:25:38

Copyright (c) 1991, 2002, Oracle Corporation. All rights reserved.

Connecting to (ADDRESS=(PROTOCOL=TCP)(Host=jiraiya)(Port=1626))
TNS-12541: TNS:no listener
TNS-12560: TNS:protocol adapter error
TNS-00511: No listener
Linux Error: 111: Connection refused
Starting listener process APPS_VIS.

LSNRCTL for Linux: Version 9.2.0.6.0 – Production on 13-JAN-2008 12:25:38

Copyright (c) 1991, 2002, Oracle Corporation. All rights reserved.

Starting /d02/oracle.11.5.10/visora/8.0.6/bin/tnslsnr: please wait…

TNS-12545: Connect failed because target host or object does not exist
TNS-12560: TNS:protocol adapter error
TNS-00515: Connect failed because target host or object does not exist
Linux Error: 2: No such file or directory

adalnctl.sh: exiting with status 1

On investigation of the above indicated directory (/d02/oracle.11.5.10/visora/8.0.6/bin/), it appeared that the tnslsnr file did not exist in the directory. Copying it from another listener product directory remedied the above issue:

$cp /d01/oracle.11.5.10/visdb/9.2.0/bin/tnslsnr /d02/oracle.11.5.10/visora/8.0.6/bin/

The final step in verifying that the Oracle EBS instance worked correctly, was to start all the database tier processes, followed by the application tier processes. From the command line, I ran the following commands:

Database service:

/d01/oracle.11.5.10/visdb/9.2.0/appsutil/scripts/VIS_jiraiya/addbctl.sh start

Listener service:

/d01/oracle.11.5.10/visdb/9.2.0/appsutil/scripts/VIS_jiraiya/addlnctl.sh start

Application and forms services:

/d02/oracle.11.5.10/viscomn/admin/scripts/VIS_jiraiya/adstrtal.sh APPS/APPS

See the tables and the end of this post for a concordance that identifies the location for the various management scripts.

Sign in

The main address used to locate the eBusiness suite in my instance used the defaults, however it is specific to the choices made during the rapidwiz install:

Oracle Applications Rapid Install Portal

Following the “Apps Logon links” goes to the main page for signing into Oracle eBusiness suite:

Logon Options for Oracle Applications 11i

The “E-Business Home Page” link then goes directly to the sign in page for Oracle Applications:

Oracle Applications Login

Signing in to the Ebusiness suite environment required the default SYSADMIN user (default password is SYSADMIN). Remember to change passwords for all seeded users in your instance.

The main eBusiness suite screen was then displayed:

Oracle Applications Home Page

Jinitiator setup

Jinitiator is the Java-based plugin which is used to run Oracle Forms from within the browser environment. In most Windows installations, it is configured to automatically download and install , once the user chooses a Core Apps function. The screenshots below outline the steps for installing the Jinitiator client.

Jinitiator Install Warning for IE

Jinitiator Setup

It is not possible to utilise the automated Jinitiator setup when running Firefox in a Ubuntu environment, so it will be manually installed. On the client computer, change to the home directory. Then enter the following commands to create a link to the JRE plugin in the firefox plugins directory.

$ cd
$cd /.mozilla/plugins
$ ln -s /usr/local/jre1.6.0_03/plugin/i386/ns7/libjavaplugin_oji.so ./libjavaplugin_oji.so

Update the pluginreg.dat file (backing it up first), replacing the entry that looks like this:

16:application/x-java-applet;jpi-version=1.6.0_03:Java::$

with an updated entry that has jpi-version set to the same as the Oracle Forms applet version. In the default installation, this would be:

16:application/x-java-applet;jpi-version=1.4.2_04:Java::$

Restart Firefox and verify that the Oracle Apps Forms runtime starts, by signing in as SYSADMIN under System Administrator Responsibility, then clicking on the User ->Define link.

Management Scripts

Following is an extract from the EBS Scripts information page, which outlines the locations and names of the various startup, shutdown and management scripts for the EBS instance.

RDBMS ORACLE_HOME Control scripts
(located under <RDBMS ORACLE_HOME>/appsutil/scripts/VIS_jiraiya)

Control Script

Functionality

addbctl.sh Control database server
addlnctl.sh Control Oracle Net listener for the database server


RDBMS ORACLE_HOME Install scripts

(located under <RDBMS ORACLE_HOME>/appsutil/install/VIS_jiraiya)

Install Script

Functionality

adsvdlsn.sh Start Oracle Net listener during installation
adcrdb.sh Start database and create database control files
addbprf.sh Set profile option values
adsvdcnv.sh Perform character set conversion and licensing tasks
adsvdb.sh Start database during installation


COMMON_TOP Control scripts

(located under <COMMON_TOP>/admin/scripts/VIS_jiraiya)

Control Script

Functionality

Node

adalnctl.sh Control Oracle Net8 listener for Applications services All application tier server nodes
adstrtal.sh Start all Applications server processes All application tier server nodes
adstpall.sh Stop all Applications server processes All application tier server nodes
adfrmctl.sh Control Forms server Forms server node
adfmcctl.sh Control Forms Metrics Client Forms server node
adfmsctl.sh Control Forms Metrics Server HTTP server node
adtcfctl.sh Control TCF SocketServer Concurrent processing server node
adcmctl.sh Control Concurrent managers Concurrent processing server node
adrepctl.sh Control Reports server Concurrent processing server node
adapcctl.sh Control Apache processes HTTP server node
jtffmctl.sh Control Oracle fulfillment server HTTP server node