after seeting hdbuserstore, HDB is not comming up,Index Server stopped

Hello All,

After system copy from one sid to another sid ,hana database is up and running fine.

Due to R3trans issue ,as source SAPSID schema comes to target SID after system copy  ,in a process to resolve R3trans issue i have set below command

sappcr = source schema

hdbuserstore SET DEFAULT sderums1111:32115 sappcr <password>

i have brought down system and then its not comming up ,error in indexserver trace file as

[30979]{-1}[-1/-1] 2014-04-15 14:33:56.444009 e Row_Engine      msglog.cc(00092) : unexpected error during startSessionService: (errno 1026) cannot bind a communication port: cannot bind to the local port (32115) for listening: errcode:14 (at ptime/session/eapi/jdbc/DriverManager_session.cc:634 )

[30979]{-1}[-1/-1] 2014-04-15 14:33:56.444102 e PersistenceLayer ptime_factory.cc(00531) : Fail to start session: cannot bind a communication port: cannot bind to the local port (32115) for listening: errcode:14ptime/session/comm/cm_tcp.cc:199

[30979]{-1}[-1/-1] 2014-04-15 14:33:56.444174 e assign          TREXIndexServer.cpp(00854) : assign failed with ltt exception. stopping service... :

exception  1: no.71001026  (ptime/session/comm/cm_tcp.cc:199)

    cannot bind to the local port (32115) for listening: errcode:14

=============================================

R3 trans log

=~=~=~=~=~=~=~=~=~=~=~= PuTTY log 2014.04.15 18:26:08 =~=~=~=~=~=~=~=~=~=~=~=

m

[Ksderums6317:kcradm 82> more trans.log

4 ETW000 R3trans version 6.24 (release 738 - 19.03.13 - 20:13:03 ).

4 ETW000 unicode enabled version

4 ETW000 ===============================================

4 ETW000

4 ETW000 date&time   : 15.04.2014 - 13:13:04

4 ETW000 control file: <no ctrlfile>

4 ETW000 R3trans was called as follows: R3trans -x

4 ETW000  trace at level 2 opened for a given file pointer

4 ETW000  [     dev trc,00000]  Tue Apr 15 13:13:04 2014                                                  56  0.000056

4 ETW000  [     dev trc,00000]  db_con_init called                                                        16  0.000072

4 ETW000  [     dev trc,00000]  set_use_ext_con_info(): usage of ssfs switched off (rsdb/ssfs_connect=0)

4 ETW000                                                                                                  17  0.000089

4 ETW000  [     dev trc,00000]  determine_block_commit: no con_hdl found as blocked for con_name = R/3

4 ETW000                                                                                                  12  0.000101

4 ETW000  [     dev trc,00000]  create_con (con_name=R/3)                                                  9  0.000110

4 ETW000  [     dev trc,00000]  Loading DB library '/usr/sap/KCR/SYS/exe/run/dbhdbslib.so' ...            25  0.000135

4 ETW000  [     dev trc,00000]  DlLoadLib() success: dlopen("/usr/sap/KCR/SYS/exe/run/dbhdbslib.so"), hdl 0

4 ETW000                                                                                                2609  0.002744

4 ETW000  [     dev trc,00000]  Library '/usr/sap/KCR/SYS/exe/run/dbhdbslib.so' loaded                    12  0.002756

4 ETW000  [     dev trc,00000]  function DbSlExpFuns loaded from library /usr/sap/KCR/SYS/exe/run/dbhdbslib.so

4 ETW000                                                                                                  17  0.002773

4 ETW000  [     dev trc,00000]  Version of '/usr/sap/KCR/SYS/exe/run/dbhdbslib.so' is "738.03", patchlevel (0.3)

4 ETW000                                                                                                  56  0.002829

4 ETW000  [     dev trc,00000]  function dsql_db_init loaded from library /usr/sap/KCR/SYS/exe/run/dbhdbslib.so

4 ETW000                                                                                                  13  0.002842

4 ETW000  [     dev trc,00000]  function dbdd_exp_funs loaded from library /usr/sap/KCR/SYS/exe/run/dbhdbslib.so

4 ETW000                                                                                                  25  0.002867

4 ETW000  [     dev trc,00000]  } DbSlHDBControl(rc=0)                                                    23  0.002890

4 ETW000  [     dev trc,00000]  { DbSlHDBControl(con_hdl=-1,command=39,arg_p=(nil))                       11  0.002901

4 ETW000  [     dev trc,00000]  } DbSlHDBControl(rc=0)                                                     9  0.002910

4 ETW000  [     dev trc,00000]  { DbSlHDBControl(con_hdl=-1,command=10,arg_p=7fffab536cb0)                11  0.002921

4 ETW000  [     dev trc,00000]  } DbSlHDBControl(rc=0)                                                     8  0.002929

4 ETW000  [     dev trc,00000]  New connection 0 created                                                   8  0.002937

4 ETW000  [     dev trc,00000]  0: name = R/3, con_id = -000000001, state = DISCONNECTED, tx = NO , bc = NO , hc = NO , perm = YES, reco = NO , frco = NO , timeout = 000, con_max = 255, con_opt = 2

55, occ = NO , prog = 

4 ETW000                                                                                                  20  0.002957

4 ETW000  [     dev trc,00000]  { DbSlHDBControl(con_hdl=-1,command=10,arg_p=2d7fae0)                     11  0.002968

4 ETW000  [     dev trc,00000]  } DbSlHDBControl(rc=0)                                                    10  0.002978

4 ETW000  [     dev trc,00000]  db_con_connect (con_name=R/3)                                             11  0.002989

4 ETW000  [     dev trc,00000]  determine_block_commit: no con_hdl found as blocked for con_name = R/3

4 ETW000                                                                                                  10  0.002999

4 ETW000  [     dev trc,00000]  find_con_by_name found the following connection:                          15  0.003014

4 ETW000  [     dev trc,00000]  0: name = R/3, con_id = 000000000, state = DISCONNECTED, tx = NO , bc = NO , hc = NO , perm = YES, reco = NO , frco = NO , timeout = 000, con_max = 255, con_opt = 25

5, occ = NO , prog = 

4 ETW000                                                                                                  16  0.003030

4 ETW000  [     dev trc,00000]  { DbSlHDBConnect(con_info_p=(nil))                                        27  0.003057

4 ETW000  [     dev trc,00000]  DBHDBSLIB : version 738.03, patch 0.003 (Make PL 0.10)                    13  0.003070

4 ETW000  [     dev trc,00000]  HDB shared library (dbhdbslib) patchlevels (last 10)                      10  0.003080

4 ETW000  [     dev trc,00000]    (0.003) Bulk insert with lob data for VM container corrected (note 1600066)

4 ETW000                                                                                                  15  0.003095

4 ETW000  [     dev trc,00000]    (0.002) Signal 11 after out of memory (note 1781592)                    11  0.003106

4 ETW000  [     dev trc,00000]                                                                             6  0.003112

[7m--More--(38%) [27m

4 ETW000  [     dev trc,00000]   -> init()                                                                12  0.003124

[7m--More--(39%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=8) : 2eedc00 (24 bytes allocated)                     56  0.003180

[7m--More--(40%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=20) : 2f02c80 (60 bytes allocated)                    17  0.003197

[7m--More--(40%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=10) : 2f04ff0 (86 bytes allocated)                    17  0.003214

[7m--More--(41%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=14) : 2f05230 (116 bytes allocated)                   11  0.003225

[7m--More--(42%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=16) : 2f05470 (148 bytes allocated)                   11  0.003236

[7m--More--(43%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=16) : 2f056b0 (180 bytes allocated)                   13  0.003249

[7m--More--(44%) [27m

4 ETW000  [     dev trc,00000]    STATEMENT_CACHE_SIZE = 1000                                             17  0.003266

[7m--More--(45%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=152000) : 7f497547b010 (152196 bytes allocated)       19  0.003285

[7m--More--(45%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=2216000) : 7f49709c1010 (2368212 bytes allocated)

[7m--More--(46%) [27m

4 ETW000                                                                                                  22  0.003307

[7m--More--(47%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=304000) : 7f4970976010 (2672228 bytes allocated)

[7m--More--(48%) [27m

4 ETW000                                                                                                  19  0.003326

[7m--More--(49%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=16144) : 2f06160 (2688388 bytes allocated)            14  0.003340

[7m--More--(49%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=32048) : 2f0a2a0 (2720452 bytes allocated)            18  0.003358

[7m--More--(50%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=16) : 2f058f0 (2720484 bytes allocated)             1239  0.004597

[7m--More--(51%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=16) : 2f03320 (2720516 bytes allocated)               15  0.004612

[7m--More--(52%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=16) : 2f02960 (2720548 bytes allocated)               11  0.004623

[7m--More--(53%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=16) : 2f030d0 (2720580 bytes allocated)               11  0.004634

[7m--More--(54%) [27m

4 ETW000  [     dev trc,00000]   -> init()                                                                10  0.004644

[7m--More--(54%) [27m

4 ETW000  [     dev trc,00000]   -> loadClientRuntime()                                                   11  0.004655

[7m--More--(55%) [27m

4 ETW000  [     dev trc,00000]  Loading SQLDBC client runtime ...                                         12  0.004667

[7m--More--(56%) [27m

4 ETW000  [     dev trc,00000]  SQLDBC Module  : /usr/sap/KCR/hdbclient/libSQLDBCHDB.so                  319  0.004986

[7m--More--(57%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=8) : 2f154b0 (2720604 bytes allocated)                17  0.005003

[7m--More--(58%) [27m

4 ETW000  [     dev trc,00000]  SQLDBC Runtime : libSQLDBCHDB 1.00.68 Build 0384084-1510                 123  0.005126

[7m--More--(59%) [27m

4 ETW000  [     dev trc,00000]  SQLDBC client runtime is 1.00.68.0384084                                  25  0.005151

[7m--More--(59%) [27m

4 ETW000  [     dev trc,00000]   -> getNewConnection()                                                    12  0.005163

[7m--More--(60%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=104) : 2f15bc0 (2720724 bytes allocated)              11  0.005174

[7m--More--(61%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=9968) : 2f16600 (2730708 bytes allocated)             14  0.005188

[7m--More--(62%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_malloc(size=72) : 2f15ab0 (2730796 bytes allocated)               41  0.005229

[7m--More--(63%) [27m

4 ETW000  [     dev trc,00000]   <- getNewConnection(con_hdl=0)                                           13  0.005242

[7m--More--(64%) [27m

4 ETW000  [     dev trc,00000]   -> checkEnvironment(con_hdl=0)                                           17  0.005259

[7m--More--(64%) [27m

4 ETW000  [     dev trc,00000]   -> connect(con_info_p=(nil))                                             16  0.005275

[7m--More--(65%) [27m

4 ETW000  [     dev trc,00000]  Try to connect via secure store (DEFAULT) on connection 0 ...             40  0.005315

[7m--More--(66%) [27m

4 ETW000  [    dbhdbsql,00000]  *** ERROR => Connect to database failed, rc=1, rcSQL=10 (invalid username or password: )

[7m--More--(67%) [27m

4 ETW000                                                                                                4012  0.009327

[7m--More--(68%) [27m

4 ETW000  [     dev trc,00000]   -> SetSdbDbslCA(errcode=10)                                              13  0.009340

[7m--More--(69%) [27m

4 ETW000  [     dev trc,00000]   -> freeConnection(con_hdl=0)                                             17  0.009357

[7m--More--(70%) [27m

4 ETW000  [     dev trc,00000]     close all opened locators of connection 0                              15  0.009372

[7m--More--(70%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2f15ab0, size=72 (2730708 bytes allocated))                11  0.009383

[7m--More--(71%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2f16600, size=9968 (2720724 bytes allocated))              28  0.009411

[7m--More--(72%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2f15bc0, size=104 (2720604 bytes allocated))               12  0.009423

[7m--More--(73%) [27m

4 ETW000  [     dev trc,00000]  } DbSlHDBConnect(rc=99)                                                   10  0.009433

[7m--More--(74%) [27m

4 ETW000  [    dblink  ,00000]  ***LOG BY2=>sql error 10     performing CON                               34  0.009467

[7m--More--(75%) [27m

4 ETW000  [    dblink  ,00000]  ***LOG BY0=>invalid username or password:                                 12  0.009479

[7m--More--(75%) [27m

4 ETW000  [     dev trc,00000]  { DbSlHDBControl(con_hdl=0,command=41,arg_p=d6e8f8)                       19  0.009498

[7m--More--(76%) [27m

4 ETW000  [     dev trc,00000]  } DbSlHDBControl(rc=0)                                                    11  0.009509

[7m--More--(77%) [27m

4 ETW000  [     dev trc,00000]  { DbSlHDBControl(con_hdl=0,command=14,arg_p=7fffab52d520)                 10  0.009519

[7m--More--(78%) [27m

4 ETW000  [     dev trc,00000]  } DbSlHDBControl(rc=0)                                                    10  0.009529

[7m--More--(79%) [27m

4 ETW000  [     dev trc,00000]  { DbSlHDBControl(con_hdl=0,command=50,arg_p=7fffab52d538)                 12  0.009541

[7m--More--(80%) [27m

4 ETW000  [     dev trc,00000]  } DbSlHDBControl(rc=0)                                                    12  0.009553

[7m--More--(80%) [27m

4 ETW000  [     dev trc,00000]  { DbSlHDBControl(con_hdl=0,command=13,arg_p=7fffab52d490)                 10  0.009563

[7m--More--(81%) [27m

4 ETW000  [     dev trc,00000]  } DbSlHDBControl(rc=0)                                                    10  0.009573

[7m--More--(82%) [27m

4 ETW000  [     dev trc,00000]  { DbSlHDBControl(con_hdl=0,command=52,arg_p=7fffab52d4e0)                 10  0.009583

[7m--More--(83%) [27m

4 ETW000  [     dev trc,00000]  } DbSlHDBControl(rc=0)                                                    10  0.009593

[7m--More--(84%) [27m

2EETW169 no connect possible: "DBMS = HDB                              ---  SERVER = '' PORT = ''"

[7m--More--(84%) [27m

4 ETW000  [     dev trc,00000]  release memory of the SIBU buffers                                       106  0.009699

[7m--More--(85%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2f058f0, size=16 (2720572 bytes allocated))                15  0.009714

[7m--More--(86%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2f03320, size=16 (2720540 bytes allocated))                19  0.009733

[7m--More--(87%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2f02960, size=16 (2720508 bytes allocated))                11  0.009744

[7m--More--(88%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2f030d0, size=16 (2720476 bytes allocated))                10  0.009754

[7m--More--(89%) [27m

4 ETW000  [     dev trc,00000]  release memory of the STATEMENT CACHE                                     30  0.009784

[7m--More--(89%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2f0a2a0, size=32048 (2688412 bytes allocated))             19  0.009803

[7m--More--(90%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2f06160, size=16144 (2672252 bytes allocated))             12  0.009815

[7m--More--(91%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=7f4970976010, size=304000 (2368236 bytes allocated))       11  0.009826

[7m--More--(92%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=7f49709c1010, size=2216000 (152220 bytes allocated))       36  0.009862

[7m--More--(93%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=7f497547b010, size=152000 (204 bytes allocated))          172  0.010034

[7m--More--(94%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2f154b0, size=8 (180 bytes allocated))                     39  0.010073

[7m--More--(94%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2eedc00, size=8 (156 bytes allocated))                     14  0.010087

[7m--More--(95%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2f056b0, size=16 (124 bytes allocated))                    10  0.010097

[7m--More--(96%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2f02c80, size=20 (88 bytes allocated))                     11  0.010108

[7m--More--(97%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2f04ff0, size=10 (62 bytes allocated))                     10  0.010118

[7m--More--(98%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2f05230, size=14 (32 bytes allocated))                     10  0.010128

[7m--More--(99%) [27m

4 ETW000  [     dev trc,00000]   -> sdb_free(p=2f05470, size=16 (0 bytes allocated))                      10  0.010138

Please help to resove the issue.

Regards

Ravi