Cisco Prime. Проблема с запуском процесса ncs?

Question

[GdRta]

Всем привет,

Ребята, прошу совета, как побороть проблему с запуском Cisco Prime 2.1, не стартует процес NCS.
Prime является приложением на базе RHEL 5.4.

cat /etc/redhat-release 
Red Hat Enterprise Linux Server release 5.4 (Tikanga)

uname -ar 
Linux prime-01 2.6.18-238.1.1.el5 #1 SMP Tue Jan 4 13:32:19 EST 2011 x86_64 x86_64 x86_64 GNU/Linux

При попытке старта, процесса ncs, вываливает такую ошибку:

prime-01/admin# ncs start verbose 

Starting Network Control System... 

Reporting Server Heap size = 4096m 
XMP Server Heap size = 6144m 
Starting Health Monitor 

Failure during Network Control System startup.  Check launchout.log for details. 

ade # cat launchout.log 
Starting Health Monitor as a primary 
Checking for Port 8082 availability... OK 
truststore used is /opt/CSCOlumos/conf/truststore 
truststore used is /opt/CSCOlumos/conf/truststore 
CERT MATCHED : 
Updating web server configuration file ... 
Starting Health Montior Web Server... 
Health Monitor Web Server Started. 
Starting Health Monitor Server... 
Health Monitor Server Started. 
Database server started. 
HMMain: StartNCS method with kill stale 
WCSAdmin::startServices 

Processing Service Name: Ftp 
Starting Remoting Service: Ftp Server 

Processing Service Name: Database 
Database is already running. 

Processing Service Name: Tftp 
Starting Remoting Service: Tftp Server 

Processing Service Name: Matlab 
Starting Remoting Service: Matlab Server 

Processing Service Name: NMS Server 
Process dependency service: Matlab 
Starting Remoting Service: Matlab Server 
Process dependency service: Ftp 
Port 20555 is in use. ServerSocket binding gave exception java.net.BindException: Address already in use 
Port 20555 needed by the server is being used by some other application. 
Please free the port and restart the Server. 
COMMAND   PID USER   FD   TYPE DEVICE SIZE NODE NAME 
java    13811 root  691u  IPv6 138481       TCP localhost.localdomain:39756->localhost.localdomain:20555 (ESTABLISHED) 
java    14350 root  675u  IPv6 138478       TCP *:20555 (LISTEN) 
java    14350 root  677u  IPv6 138484       TCP localhost.localdomain:20555->localhost.localdomain:39756 (ESTABLISHED) 
root     14350 14339 53 06:14 pts/1    00:00:09 /opt/CSCOlumos/jre32/bin/java -Djava.system.class.loader=com.cisco.xmp.classLoader.XMPSystemClassLoader -Dcom.cisco.xmp.XMPHome=/opt/CSCOlumos -Dinstall.dir=/opt/CSCOlumos -server -Xms32m -Xmx256m -XX:MaxPermSize=128m -Djava.awt.headless=true -Daes.dir=/opt/CSCOlumos -Dmibs.root=/opt/CSCOlumos/resources/wirless/mibs -cp /opt/CSCOlumos/classloader-conf:/opt/CSCOlumos/./lib/xmp/XMPClassLoader-8.0.24.jar com.cisco.remoting.packaging.RemotingServiceMain Matlab 
root     14443 14420  0 06:14 pts/1    00:00:00 bash -c ps -aef | grep -E \'"$(lsof -i:20555 | awk '{ print $2 }' | grep -v "PID" | tr "\n" "|")"\' 
root     14445 14443  0 06:14 pts/1    00:00:00 bash -c ps -aef | grep -E \'"$(lsof -i:20555 | awk '{ print $2 }' | grep -v "PID" | tr "\n" "|")"\' 
root     14446 14445  0 06:14 pts/1    00:00:00 bash -c ps -aef | grep -E \'"$(lsof -i:20555 | awk '{ print $2 }' | grep -v "PID" | tr "\n" "|")"\' 
Starting Remoting Service: Ftp Server 
Process dependency service: Tftp 
Port 20558 is in use. ServerSocket binding gave exception java.net.BindException: Address already in use 
Port 20558 needed by the server is being used by some other application. 
Please free the port and restart the Server. 
COMMAND   PID USER   FD   TYPE DEVICE SIZE NODE NAME 
java    13811 root  681u  IPv6 138519       TCP localhost.localdomain:19746->localhost.localdomain:20558 (ESTABLISHED) 
java    14210 root  678u  IPv6 138220       TCP *:20558 (LISTEN) 
java    14210 root  681u  IPv6 138509       TCP localhost.localdomain:20558->localhost.localdomain:19746 (ESTABLISHED) 
root     14210 14199 20 06:13 pts/1    00:00:12 /opt/CSCOlumos/jre32/bin/java -Djava.system.class.loader=com.cisco.xmp.classLoader.XMPSystemClassLoader -Dcom.cisco.xmp.XMPHome=/opt/CSCOlumos -Dinstall.dir=/opt/CSCOlumos -server -Xms32m -Xmx256m -XX:MaxPermSize=128m -Djava.awt.headless=true -Daes.dir=/opt/CSCOlumos -Dmibs.root=/opt/CSCOlumos/resources/wirless/mibs -cp /opt/CSCOlumos/classloader-conf:/opt/CSCOlumos/./lib/xmp/XMPClassLoader-8.0.24.jar com.cisco.remoting.packaging.RemotingServiceMain Ftp 
root     14501 14478  0 06:14 pts/1    00:00:00 bash -c ps -aef | grep -E \'"$(lsof -i:20558 | awk '{ print $2 }' | grep -v "PID" | tr "\n" "|")"\' 
root     14503 14501  0 06:14 pts/1    00:00:00 bash -c ps -aef | grep -E \'"$(lsof -i:20558 | awk '{ print $2 }' | grep -v "PID" | tr "\n" "|")"\' 
root     14504 14503  0 06:14 pts/1    00:00:00 bash -c ps -aef | grep -E \'"$(lsof -i:20558 | awk '{ print $2 }' | grep -v "PID" | tr "\n" "|")"\' 
DEPENDENCY CHECK: Database 
Starting NMS Server 
Checking for running servers. 
  Checking if DECAP is running. 
  00:00 DECAP is not running. 
00:00 Check complete. No servers running. 
Starting Remoting Service: Tftp Server 
Port 20559 is in use. ServerSocket binding gave exception java.net.BindException: Address already in use 
Port 20559 needed by the server is being used by some other application. 
Please free the port and restart the Server. 
COMMAND   PID USER   FD   TYPE DEVICE SIZE NODE NAME 
java    13811 root  678u  IPv6 138566       TCP localhost.localdomain:59490->localhost.localdomain:20559 (ESTABLISHED) 
java    14287 root  676u  IPv6 138359       TCP *:20559 (LISTEN) 
java    14287 root  678u  IPv6 138516       TCP localhost.localdomain:20559->localhost.localdomain:59490 (ESTABLISHED) 
root     14287 14275 21 06:14 pts/1    00:00:09 /opt/CSCOlumos/jre32/bin/java -Djava.system.class.loader=com.cisco.xmp.classLoader.XMPSystemClassLoader -Dcom.cisco.xmp.XMPHome=/opt/CSCOlumos -Dinstall.dir=/opt/CSCOlumos -server -Xms32m -Xmx256m -XX:MaxPermSize=128m -Djava.awt.headless=true -Daes.dir=/opt/CSCOlumos -Dmibs.root=/opt/CSCOlumos/resources/wirless/mibs -cp /opt/CSCOlumos/classloader-conf:/opt/CSCOlumos/./lib/xmp/XMPClassLoader-8.0.24.jar com.cisco.remoting.packaging.RemotingServiceMain Tftp 
root     14779 14736  0 06:14 pts/1    00:00:00 bash -c ps -aef | grep -E \'"$(lsof -i:20559 | awk '{ print $2 }' | grep -v "PID" | tr "\n" "|")"\' 
root     14781 14779  0 06:14 pts/1    00:00:00 bash -c ps -aef | grep -E \'"$(lsof -i:20559 | awk '{ print $2 }' | grep -v "PID" | tr "\n" "|")"\' 
root     14782 14781  0 06:14 pts/1    00:00:00 bash -c ps -aef | grep -E \'"$(lsof -i:20559 | awk '{ print $2 }' | grep -v "PID" | tr "\n" "|")"\' 
  00:12 DECAP setup complete. 
Starting Server ... 
Done waiting DB initialization 
Starting SAM daemon... 
Done. 
Starting DA daemon... 
Starting DA syslog daemon...

Так же, не много из предистории проблемы запуска:
Когда обнаружили проблему с запуском ncs, раздел /opt был смонитрован в read-only и в логах выкидывал ошибку

EXT3-fs error (device dm-4): ext3_lookup: unlinked inode 18939928 in dir #46400461

При попытке старта NCS, жаловался что не может записать файлы в директорию /opt, что логично, т.к. смонтирована она была в rad-only.
Я загрузился в rescue mode и выполнил:
fsck /dev/mapper/smosvg-optvol

Были исправлены идентификаторы inode, все прошло успешно.
После данного шага, служба NCS стартует с выше изложенной ошибкой.
Прошу навести меня на верное решение проблемы с запуском.

Answer 1

[belunix]

В момент запуска порт, указанный в логах не занят никаким процессом?

Comments

[GdRta]

Нет, порт 20555 ни где не светился. К сожалению, участники решения данного вопроса удалили свои коментарии, где я выкладывал выводы команд netstat, ps и т.д.