[Linux-HA] Monitoring on Startup fails. OpenVZ Clustering
Francesco Ciocchetti
francesco.ciocchetti at kyneste.com
Thu Aug 16 09:19:01 MDT 2007
> so could you explain how you configured it?
>
> And more precisely these primitives:
> ***********
> <primitive class="heartbeat" id="drbddisk_1" provider="heartbeat"
> type="drbddisk">
> <operations>
> <op id="drbddisk_1_start" name="start" timeout="120s"/>
> <op id="drbddisk_1_stop" name="stop" timeout="60s"/>
> </operations>
> <instance_attributes id="drbddisk_1_inst_attr">
> <attributes>
> <nvpair id="drbddisk_1_attr_1" name="1" value="g1_cockpit"/>
> </attributes>
> </instance_attributes>
> <instance_attributes id="drbddisk_1">
> <attributes>
> <nvpair id="drbddisk_1-target_role" name="target_role"
> value="started"/>
> </attributes>
> </instance_attributes>
> </primitive>
>
actually this is the default resource agent you can find in your
/etc/ha.d/resource.d/drbddisk directory.
It relys on the fact that the DRBD is started by your normal init
sequence on your distro , so what it does is just to make primary the
resource specified as argument (in my case is called g1_cockpit) when it
start and make it secondary when it stops.
so in my case this is the first resource to be started by heartbeat in
each group i use, the DRBD device become primary on the node that is
owning the group.
> **************
> and
> **************
> <primitive class="heartbeat" id="drbdlinks_g1" type="drbdlinks">
> <instance_attributes id="drbdlinks_g1_attributes">
> <attributes>
> <nvpair id="drbdlinks_g1_attr_1" name="1"
> value="--config-file"/>
> <nvpair id="drbdlinks_g1_attr_2" name="2"
> value="/ha/g1_cockpit/etc/drbdlinks.g1_cockpit.conf"/>
> </attributes>
> </instance_attributes>
> </primitive>
> ********
>
> How are they linked to drbd? Is
> "/ha/g1_cockpit/etc/drbdlinks.g1_cockpit.conf" equal to "/etc/drbd.conf"?
>
>
No, this is a support program for DRBD called drbdlinks, it is used to
create SYM LINKS on the fly so that the application that come in the
group after the DRBD is made primary and the filesystem is mounted can
find their configuration file where they expect it as default.
For example in my case the drbdlinks program create a symlink
/etc/httpd/httpd.conf -> /ha/g1_cockpit/etc/httpd/httpd.conf (this is
defined in the drbdlinks conf file)
So you need
-1) /etc/drbd.conf on each node to identify and manage all your drbd
devices ans do that your /etc/init.d/drbd script can start the resources
on node startup
-2) a primitive for each group you configured in your heartbeat cib.xml
so that each drbd device is primary on the right node
-3) optionally a drbdlinks conf file for each group in cib.xml where you
need to create symlinks on the fly.
hope it helped :)
ciao
FC
> thanks in advance,
> Sébastien Lorandel
> On 8/14/07, Francesco Ciocchetti <francesco.ciocchetti at kyneste.com > wrote:
>
>> Hi all ML.
>>
>> i'm setting up a cluster with HB 2.1.2 version on a fresh Centos 5.0
>> server. At the moment i'm setting up a cluster made by only 1 node
>> (doh!) planning to add the second node as soon as possible.
>>
>> I'm experiencing a strange problem anyway. At the moment only 1 resource
>> group is configured and is composed by 5 resources:
>>
>> 1)Drbddisk
>> 2)Filesystem
>> 3)drbdlinks
>> 4)ManageVE
>> 5)Mailto
>>
>> the problem is that on heartbeat startup the cluster performs a monitor
>> action of all the resources while none of the resources has been started
>> yet. This lead to a FAILURE in ManageVE monitor action cause all the
>> needed file are on DRBD device that is not primary neither mounted at
>> the moment the action monitor is performed on all resources.
>>
>> As a test i tried to start DRBDDISK and FILESYSTEM and drbdlinks
>> manually , let the cluster check for ManageVE again and everything
>> worked fine ...
>>
>> i only configured another cluster in my life with a HB 2.0.8 version
>> with similar setup (with each group having as a first resource a DRBD
>> device and Filesystem) and never had a problem like this ... could it be
>> something from new 2.1.2 version? i checked release note but i found
>> nothing related.
>>
>> I even noticed a strange ERROR string where it say that "no
>> configuration file has been found, check below:" and then nothing is
>> there ...
>>
>> Attached are logs and cib.xml
>>
>> Thanks in advance
>> Francesco Ciocchetti
>>
>> --
>> ==============================================
>> Francesco Ciocchetti (francesco.ciocchetti at kyneste.com)
>>
>> Network & Security
>> Kyneste - Piattaforme ICT
>> "Società appartenente al Gruppo Bancario Capitalia e
>> sottoposta all'attività di direzione e coordinamento di Capitalia S.p.A."
>> Via Mario Bianchini 68, 00142 Roma
>> T.[+39] 06.98402.1 F. [+39] 06.98402.300
>> http://www.kyneste.com/
>> ==============================================
>>
>> Questo messaggio può contenere informazioni di carattere riservato e
>> confidenziale. Qualora non foste i destinatari, vogliate immediatamente
>> informarci con lo stesso mezzo ed eliminare il messaggio, con gli eventuali
>> allegati, senza trattenerne copia. Qualsivoglia utilizzo non autorizzato del
>> contenuto di questo messaggio costituisce violazione dell'obbligo di non
>> prendere cognizione della corrispondenza tra altri soggetti.
>>
>>
>> heartbeat[12862]: 2007/08/14_17:09:27 info: killing HBWRITE process 12866
>> with signal 15
>> heartbeat[12862]: 2007/08/14_17:09:27 info: killing HBREAD process 12867
>> with signal 15
>> heartbeat[12862]: 2007/08/14_17:09:27 info: killing HBWRITE process 12868
>> with signal 15
>> heartbeat[12862]: 2007/08/14_17:09:27 info: killing HBREAD process 12869
>> with signal 15
>> heartbeat[12862]: 2007/08/14_17:09:27 info: Core process 12865 exited. 5
>> remaining
>> heartbeat[12862]: 2007/08/14_17:09:27 info: Core process 12866 exited. 4
>> remaining
>> heartbeat[12862]: 2007/08/14_17:09:27 info: Core process 12867 exited. 3
>> remaining
>> heartbeat[12862]: 2007/08/14_17:09:27 info: Core process 12868 exited. 2
>> remaining
>> heartbeat[12862]: 2007/08/14_17:09:27 info: Core process 12869 exited. 1
>> remaining
>> heartbeat[12862]: 2007/08/14_17:09:27 info: cap-nm-05 Heartbeat shutdown
>> complete.
>> heartbeat[15021]: 2007/08/14_17:10:26 info: Version 2 support: yes
>> heartbeat[15021]: 2007/08/14_17:10:26 WARN: Logging daemon is disabled
>> --enabling logging daemon is recommended
>> heartbeat[15021]: 2007/08/14_17:10:26 info: **************************
>> heartbeat[15021]: 2007/08/14_17:10:26 info: Configuration validated.
>> Starting heartbeat 2.1.2
>> heartbeat[15022]: 2007/08/14_17:10:26 info: heartbeat: version 2.1.2
>> heartbeat[15022]: 2007/08/14_17:10:26 info: Heartbeat generation:
>> 1187099222
>> heartbeat[15022]: 2007/08/14_17:10:26 info: G_main_add_TriggerHandler:
>> Added signal manual handler
>> heartbeat[15022]: 2007/08/14_17:10:26 info: G_main_add_TriggerHandler:
>> Added signal manual handler
>> heartbeat[15022]: 2007/08/14_17:10:26 info: Removing
>> /var/run/heartbeat/rsctmp failed, recreating.
>> heartbeat[15022]: 2007/08/14_17:10:26 info: glib: ucast: write socket
>> priority set to IPTOS_LOWDELAY on eth0
>> heartbeat[15022]: 2007/08/14_17:10:26 info: glib: ucast: bound send socket
>> to device: eth0
>> heartbeat[15022]: 2007/08/14_17:10:26 info: glib: ucast: bound receive
>> socket to device: eth0
>> heartbeat[15022]: 2007/08/14_17:10:26 info: glib: ucast: started on port
>> 694 interface eth0 to 10.0.0.2
>> heartbeat[15022]: 2007/08/14_17:10:26 info: glib: ping heartbeat started.
>> heartbeat[15022]: 2007/08/14_17:10:26 info: G_main_add_SignalHandler:
>> Added signal handler for signal 17
>> heartbeat[15022]: 2007/08/14_17:10:26 info: Local status now set to: 'up'
>> heartbeat[15022]: 2007/08/14_17:10:28 info: Link 10.237.84.254:10.237.84.254
>> up.
>> heartbeat[15022]: 2007/08/14_17:10:28 info: Status update for node
>> 10.237.84.254: status ping
>> heartbeat[15022]: 2007/08/14_17:12:27 WARN: node cap-nm-06: is dead
>> heartbeat[15022]: 2007/08/14_17:12:27 info: Comm_now_up(): updating status
>> to active
>> heartbeat[15022]: 2007/08/14_17:12:27 info: Local status now set to:
>> 'active'
>> heartbeat[15022]: 2007/08/14_17:12:27 info: Starting child client
>> "/usr/lib/heartbeat/ccm" (90,90)
>> heartbeat[15022]: 2007/08/14_17:12:27 info: Starting child client
>> "/usr/lib/heartbeat/cib" (90,90)
>> heartbeat[15022]: 2007/08/14_17:12:27 info: Starting child client
>> "/usr/lib/heartbeat/lrmd -r" (0,0)
>> heartbeat[15022]: 2007/08/14_17:12:27 info: Starting child client
>> "/usr/lib/heartbeat/stonithd" (0,0)
>> heartbeat[15022]: 2007/08/14_17:12:27 info: Starting child client
>> "/usr/lib/heartbeat/attrd" (90,90)
>> heartbeat[15022]: 2007/08/14_17:12:27 info: Starting child client
>> "/usr/lib/heartbeat/crmd" (90,90)
>> heartbeat[15022]: 2007/08/14_17:12:27 info: Starting child client
>> "/usr/lib/heartbeat/mgmtd -v" (0,0)
>> heartbeat[15022]: 2007/08/14_17:12:27 info: Starting child client
>> "/usr/lib/heartbeat/cibmon -d" (90,90)
>> heartbeat[15022]: 2007/08/14_17:12:27 info: Starting child client
>> "/usr/lib/heartbeat/pingd -m 100 -d 5s -a pingd_score" (0,0)
>> heartbeat[15035]: 2007/08/14_17:12:27 info: Starting
>> "/usr/lib/heartbeat/ccm" as uid 90 gid 90 (pid 15035)
>> heartbeat[15036]: 2007/08/14_17:12:27 info: Starting
>> "/usr/lib/heartbeat/cib" as uid 90 gid 90 (pid 15036)
>> heartbeat[15037]: 2007/08/14_17:12:27 info: Starting
>> "/usr/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 15037)
>> cib[15036]: 2007/08/14_17:12:27 info: G_main_add_SignalHandler: Added
>> signal handler for signal 15
>> cib[15036]: 2007/08/14_17:12:27 info: G_main_add_TriggerHandler: Added
>> signal manual handler
>> cib[15036]: 2007/08/14_17:12:27 info: G_main_add_SignalHandler: Added
>> signal handler for signal 17
>> cib[15036]: 2007/08/14_17:12:27 info: main: Retrieval of a per-action CIB:
>> disabled
>> cib[15036]: 2007/08/14_17:12:27 info: readCibXmlFile: Reading cluster
>> configuration from: /var/lib/heartbeat/crm/cib.xml
>> cib[15036]: 2007/08/14_17:12:27 WARN: validate_cib_digest: No on-disk
>> digest present
>> cib[15036]: 2007/08/14_17:12:27 info: log_data_element: readCibXmlFile:
>> [on-disk] <cib admin_epoch="0" have_quorum="false" num_peers="0"
>> cib_feature_revision="1" ignore_dtd="false" generated="false" epoch="11"
>> num_updates="1" cib-last-written="Tue Aug 14 16:59:01 2007"
>> ccm_transition="1">
>> cib[15036]: 2007/08/14_17:12:27 info: log_data_element: readCibXmlFile:
>> [on-disk] <configuration>
>> cib[15036]: 2007/08/14_17:12:27 info: log_data_element: readCibXmlFile:
>> [on-disk] <crm_config>
>> cib[15036]: 2007/08/14_17:12:27 info: log_data_element: readCibXmlFile:
>> [on-disk] <cluster_property_set id="default">
>> cib[15036]: 2007/08/14_17:12:27 info: log_data_element: readCibXmlFile:
>> [on-disk] <attributes>
>> cib[15036]: 2007/08/14_17:12:27 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="symmetric_cluster" name="symmetric_cluster"
>> value="true"/>
>> heartbeat[15038]: 2007/08/14_17:12:27 info: Starting
>> "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 15038)
>> heartbeat[15039]: 2007/08/14_17:12:27 info: Starting
>> "/usr/lib/heartbeat/attrd" as uid 90 gid 90 (pid 15039)
>> heartbeat[15040]: 2007/08/14_17:12:27 info: Starting
>> "/usr/lib/heartbeat/crmd" as uid 90 gid 90 (pid 15040)
>> heartbeat[15041]: 2007/08/14_17:12:27 info: Starting
>> "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 15041)
>> heartbeat[15042]: 2007/08/14_17:12:27 info: Starting
>> "/usr/lib/heartbeat/cibmon -d" as uid 90 gid 90 (pid 15042)
>> heartbeat[15043]: 2007/08/14_17:12:27 info: Starting
>> "/usr/lib/heartbeat/pingd -m 100 -d 5s -a pingd_score" as uid 0 gid 0 (pid
>> 15043)
>> cib[15036]: 2007/08/14_17:12:27 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="no_quorum_policy" name="no_quorum_policy"
>> value="ignore"/>
>> lrmd[15037]: 2007/08/14_17:12:27 info: G_main_add_SignalHandler: Added
>> signal handler for signal 15
>> stonithd[15038]: 2007/08/14_17:12:27 info: G_main_add_SignalHandler: Added
>> signal handler for signal 10
>> attrd[15039]: 2007/08/14_17:12:27 info: G_main_add_SignalHandler: Added
>> signal handler for signal 15
>> crmd[15040]: 2007/08/14_17:12:27 info: main: CRM Hg Version: 9a995a8a7052
>> tip
>>
>> mgmtd[15041]: 2007/08/14_17:12:27 info: G_main_add_SignalHandler: Added
>> signal handler for signal 15
>> cibmon[15042]: 2007/08/14_17:12:27 info: G_main_add_SignalHandler: Added
>> signal handler for signal 15
>> cib[15036]: 2007/08/14_17:12:27 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="is_managed_default"
>> name="is_managed_default" value="true"/>
>> lrmd[15037]: 2007/08/14_17:12:27 info: G_main_add_SignalHandler: Added
>> signal handler for signal 17
>> stonithd[15038]: 2007/08/14_17:12:27 info: G_main_add_SignalHandler: Added
>> signal handler for signal 12
>> ccm[15035]: 2007/08/14_17:12:27 info: Hostname: cap-nm-05
>> attrd[15039]: 2007/08/14_17:12:27 info: register_with_ha: Hostname:
>> cap-nm-05
>> crmd[15040]: 2007/08/14_17:12:27 info: crmd_init: Starting crmd
>> mgmtd[15041]: 2007/08/14_17:12:27 debug: Enabling coredumps
>> cib[15036]: 2007/08/14_17:12:27 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="stonith_enabled" name="stonith_enabled"
>> value="false"/>
>> lrmd[15037]: 2007/08/14_17:12:27 info: G_main_add_SignalHandler: Added
>> signal handler for signal 10
>> stonithd[15038]: 2007/08/14_17:12:28 info: Signing in with heartbeat.
>> crmd[15040]: 2007/08/14_17:12:28 info: G_main_add_SignalHandler: Added
>> signal handler for signal 15
>> mgmtd[15041]: 2007/08/14_17:12:28 info: G_main_add_SignalHandler: Added
>> signal handler for signal 10
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="default_resource_stickiness"
>> name="default_resource_stickiness" value="500"/>
>> attrd[15039]: 2007/08/14_17:12:28 info: register_with_ha: UUID:
>> 1291474c-994d-4998-9366-58edf073190c
>> lrmd[15037]: 2007/08/14_17:12:28 info: G_main_add_SignalHandler: Added
>> signal handler for signal 12
>> crmd[15040]: 2007/08/14_17:12:28 info: G_main_add_TriggerHandler: Added
>> signal manual handler
>> mgmtd[15041]: 2007/08/14_17:12:28 info: G_main_add_SignalHandler: Added
>> signal handler for signal 12
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair name="default_resource_failure_stickiness"
>> id="default_resource_failure_stickiness" value="-INFINITY"/>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] </attributes>
>> crmd[15040]: 2007/08/14_17:12:28 info: G_main_add_SignalHandler: Added
>> signal handler for signal 17
>> stonithd[15038]: 2007/08/14_17:12:28 notice: /usr/lib/heartbeat/stonithd
>> start up successfully.
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] </cluster_property_set>
>> lrmd[15037]: 2007/08/14_17:12:28 info: Started.
>> stonithd[15038]: 2007/08/14_17:12:28 info: G_main_add_SignalHandler: Added
>> signal handler for signal 17
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <cluster_property_set id="cib-bootstrap-options">
>> mgmtd[15041]: 2007/08/14_17:12:28 info: init_crm
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <attributes>
>> mgmtd[15041]: 2007/08/14_17:12:28 info: login to cib: 0, ret:-10
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="cib-bootstrap-options-last-lrm-refresh"
>> name="last-lrm-refresh" value="1187101716"/>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] </attributes>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] </cluster_property_set>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] </crm_config>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <nodes>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <node uname="cap-nm-06" type="normal"
>> id="6f36a115-a70d-4c23-9875-882b707c7f8f"/>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <node id="1291474c-994d-4998-9366-58edf073190c"
>> uname="cap-nm-05" type="normal"/>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] </nodes>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <resources>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <group id="g1_Cockpit">
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <primitive class="heartbeat" id="drbddisk_1"
>> provider="heartbeat" type="drbddisk">
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <operations>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <op id="drbddisk_1_start" name="start"
>> timeout="120s"/>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <op id="drbddisk_1_stop" name="stop" timeout="60s"/>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] </operations>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <instance_attributes id="drbddisk_1_inst_attr">
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <attributes>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="drbddisk_1_attr_1" name="1"
>> value="g1_cockpit"/>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] </attributes>
>> cib[15036]: 2007/08/14_17:12:28 info: log_data_element: readCibXmlFile:
>> [on-disk] </instance_attributes>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <instance_attributes id="drbddisk_1">
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <attributes>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="drbddisk_1-target_role"
>> name="target_role" value="started"/>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] </attributes>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] </instance_attributes>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] </primitive>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <primitive class="ocf" id="Filesystem_1"
>> provider="heartbeat" type="Filesystem" is_managed="true">
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <operations>
>> crmd[15040]: 2007/08/14_17:12:29 WARN: do_cib_control: Couldn't complete
>> CIB registration 1 times... pause and retry
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <op id="Filesystem_1_start" name="start"
>> timeout="300s"/>
>> crmd[15040]: 2007/08/14_17:12:29 info: crmd_init: Starting crmd's mainloop
>>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <op id="Filesystem_1_stop" name="stop" timeout="60s"/>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] </operations>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <instance_attributes id="Filesystem_1_inst_attr">
>> mgmtd[15041]: 2007/08/14_17:12:29 info: login to cib: 1, ret:-10
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <attributes>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="Filesystem_1_attr_0" name="device"
>> value="/dev/drbd0"/>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="Filesystem_1_attr_1" name="directory"
>> value="/ha/g1_cockpit"/>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="Filesystem_1_attr_2" name="fstype"
>> value="ext3"/>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] </attributes>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] </instance_attributes>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] </primitive>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <primitive class="heartbeat" id="drbdlinks_g1"
>> type="drbdlinks">
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <instance_attributes id="drbdlinks_g1_attributes">
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <attributes>
>> crmd[15040]: 2007/08/14_17:12:29 info: crm_timer_popped: Wait Timer
>> (I_NULL) just popped!
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="drbdlinks_g1_attr_1" name="1"
>> value="--config-file"/>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="drbdlinks_g1_attr_2" name="2"
>> value="/ha/g1_cockpit/etc/drbdlinks.g1_cockpit.conf"/>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] </attributes>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] </instance_attributes>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] </primitive>
>> cib[15036]: 2007/08/14_17:12:29 info: log_data_element: readCibXmlFile:
>> [on-disk] <primitive class="ocf" provider="heartbeat"
>> type="ManageVE" id="VE101_Cokcpit">
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <operations>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <op id="VE101_start" name="start" timeout="300s"/>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <op id="VE101_stop" name="stop" timeout="180"/>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] </operations>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <instance_attributes id="VE101_attributes">
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <attributes>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="VE101_attr_veid" name="veid"
>> value="101"/>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] </attributes>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] </instance_attributes>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <instance_attributes id="VE101_Cokcpit">
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <attributes>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="VE101_Cokcpit-target_role"
>> name="target_role" value="started"/>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] </attributes>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] </instance_attributes>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] </primitive>
>> mgmtd[15041]: 2007/08/14_17:12:30 info: login to cib: 2, ret:-10
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <primitive class="ocf" id="MailtoG1_Cockpit"
>> provider="heartbeat" type="MailTo">
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <instance_attributes id="MailtoG1_Cockpit_attr">
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <attributes>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="MailtoG1_Cockpit_email" name="email"
>> value="noc at kyneste.net "/>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <nvpair id="MailtoG1_Cockpit_subject" name="subject"
>> value="Group_G1_Cockpit"/>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] </attributes>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] </instance_attributes>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] </primitive>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] </group>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] </resources>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <constraints>
>> crmd[15040]: 2007/08/14_17:12:30 WARN: do_cib_control: Couldn't complete
>> CIB registration 2 times... pause and retry
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <rsc_location id="run_group_1" rsc="g1_Cockpit">
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <rule id="pref_run_group_1" score="100">
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] <expression attribute="#uname"
>> id="prefered_location_group_1_cap-nm-05" operation="eq" value="cap-nm-05"/>
>> cib[15036]: 2007/08/14_17:12:30 info: log_data_element: readCibXmlFile:
>> [on-disk] </rule>
>> cib[15036]: 2007/08/14_17:12:31 info: log_data_element: readCibXmlFile:
>> [on-disk] <rule id="group_1:notconnected" score="-INFINITY"
>> boolean_op="or">
>> cib[15036]: 2007/08/14_17:12:31 info: log_data_element: readCibXmlFile:
>> [on-disk] <expression id="group_1:not_connected:expr"
>> attribute="pingd_score" operation="not_defined"/>
>> cib[15036]: 2007/08/14_17:12:31 info: log_data_element: readCibXmlFile:
>> [on-disk] <expression id="group_1:not_connected:negative"
>> attribute="pingd_score" operation="lte" value="0"/>
>> cib[15036]: 2007/08/14_17:12:31 info: log_data_element: readCibXmlFile:
>> [on-disk] </rule>
>> cib[15036]: 2007/08/14_17:12:31 info: log_data_element: readCibXmlFile:
>> [on-disk] </rsc_location>
>> cib[15036]: 2007/08/14_17:12:31 info: log_data_element: readCibXmlFile:
>> [on-disk] </constraints>
>> cib[15036]: 2007/08/14_17:12:31 info: log_data_element: readCibXmlFile:
>> [on-disk] </configuration>
>> cib[15036]: 2007/08/14_17:12:31 info: log_data_element: readCibXmlFile:
>> [on-disk] <status/>
>> cib[15036]: 2007/08/14_17:12:31 info: log_data_element: readCibXmlFile:
>> [on-disk] </cib>
>> cib[15036]: 2007/08/14_17:12:31 info: startCib: CIB Initialization
>> completed successfully
>> cib[15036]: 2007/08/14_17:12:31 info: cib_register_ha: Signing in with
>> Heartbeat
>> cib[15036]: 2007/08/14_17:12:31 info: cib_register_ha: FSA Hostname:
>> cap-nm-05
>> crmd[15040]: 2007/08/14_17:12:31 info: crm_timer_popped: Wait Timer
>> (I_NULL) just popped!
>> cib[15036]: 2007/08/14_17:12:31 WARN: cib_init: CCM Activation failed
>> cib[15036]: 2007/08/14_17:12:31 WARN: cib_init: CCM Connection failed 1
>> times (30 max)
>> ccm[15035]: 2007/08/14_17:12:31 debug: quorum plugin: majority
>> ccm[15035]: 2007/08/14_17:12:31 debug: cluster:linux-ha, member_count=1,
>> member_quorum_votes=100
>> ccm[15035]: 2007/08/14_17:12:31 debug: total_node_count=2,
>> total_quorum_votes=200
>> ccm[15035]: 2007/08/14_17:12:31 debug: quorum plugin: twonodes
>> ccm[15035]: 2007/08/14_17:12:31 debug: cluster:linux-ha, member_count=1,
>> member_quorum_votes=100
>> ccm[15035]: 2007/08/14_17:12:31 debug: total_node_count=2,
>> total_quorum_votes=200
>> ccm[15035]: 2007/08/14_17:12:31 info: Break tie for 2 nodes cluster
>> ccm[15035]: 2007/08/14_17:12:31 info: G_main_add_SignalHandler: Added
>> signal handler for signal 15
>> cib[15036]: 2007/08/14_17:12:32 info: cib_init: Starting cib mainloop
>> cib[15036]: 2007/08/14_17:12:32 info: mem_handle_event: Got an event
>> OC_EV_MS_NEW_MEMBERSHIP from ccm
>> cib[15036]: 2007/08/14_17:12:32 info: mem_handle_event: instance=1,
>> nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3
>> cib[15036]: 2007/08/14_17:12:32 info: cib_ccm_msg_callback: PEER:
>> cap-nm-05
>> cib[15044]: 2007/08/14_17:12:32 WARN: validate_cib_digest: No on-disk
>> digest present
>> crmd[15040]: 2007/08/14_17:12:32 info: do_cib_control: CIB connection
>> established
>> crmd[15040]: 2007/08/14_17:12:32 info: register_with_ha: Hostname:
>> cap-nm-05
>> cib[15036]: 2007/08/14_17:12:33 info: cib_client_status_callback: Status
>> update: Client cap-nm-05/cib now has status [join]
>> cib[15036]: 2007/08/14_17:12:33 info: cib_client_status_callback: Status
>> update: Client cap-nm-05/cib now has status [online]
>> cib[15036]: 2007/08/14_17:12:33 info: cib_null_callback: Setting
>> cib_refresh_notify callbacks for crmd: on
>> cib[15036]: 2007/08/14_17:12:33 info: cib_null_callback: Setting
>> cib_diff_notify callbacks for mgmtd: on
>> cibmon[15042]: 2007/08/14_17:12:33 info: main: Starting mainloop
>> cib[15036]: 2007/08/14_17:12:33 info: cib_null_callback: Setting
>> cib_diff_notify callbacks for cibmon: on
>> cib[15044]: 2007/08/14_17:12:33 info: write_cib_contents: Wrote version
>> 0.11.1 of the CIB to disk (digest: 70518640eb4c856fae75afb4e3a29924)
>> crmd[15040]: 2007/08/14_17:12:33 info: register_with_ha: UUID:
>> 1291474c-994d-4998-9366-58edf073190c
>> crmd[15040]: 2007/08/14_17:12:34 info: populate_cib_nodes: Requesting the
>> list of configured nodes
>> mgmtd[15041]: 2007/08/14_17:12:35 debug: main: run the loop...
>> mgmtd[15041]: 2007/08/14_17:12:35 info: Started.
>> crmd[15040]: 2007/08/14_17:12:35 WARN: get_uuid: Could not calculate UUID
>> for cap-nm-06
>> crmd[15040]: 2007/08/14_17:12:35 WARN: populate_cib_nodes: Node cap-nm-06:
>> no uuid found
>> crmd[15040]: 2007/08/14_17:12:36 notice: populate_cib_nodes: Node:
>> cap-nm-05 (uuid: 1291474c-994d-4998-9366-58edf073190c)
>> crmd[15040]: 2007/08/14_17:12:36 info: do_ha_control: Connected to
>> Heartbeat
>> crmd[15040]: 2007/08/14_17:12:36 info: do_ccm_control: CCM connection
>> established... waiting for first callback
>> crmd[15040]: 2007/08/14_17:12:36 info: do_started: Delaying start, CCM
>> (0000000000100000) not connected
>> crmd[15040]: 2007/08/14_17:12:36 notice: crmd_client_status_callback:
>> Status update: Client cap-nm-05/crmd now has status [online]
>> crmd[15040]: 2007/08/14_17:12:36 notice: crmd_client_status_callback:
>> Status update: Client cap-nm-05/crmd now has status [online]
>> cibmon[15042]: 2007/08/14_17:12:36 info: cibmon_diff: [cib_diff_notify]
>> cib_update confirmed
>> cibmon[15042]: 2007/08/14_17:12:36 info: log_cib_diff: cib_update:
>> Local-only Change: 0.11.1
>> cibmon[15042]: 2007/08/14_17:12:36 info: log_data_element: cib_update: +
>> <cib>
>> cibmon[15042]: 2007/08/14_17:12:36 info: log_data_element: cib_update: +
>> <status>
>> cibmon[15042]: 2007/08/14_17:12:36 info: log_data_element: cib_update:
>> + <node_state id="1291474c-994d-4998-9366-58edf073190c"
>> uname="cap-nm-05" crmd="online"
>> crm-debug-origin="crmd_client_status_callback" shutdown="0"/>
>> cibmon[15042]: 2007/08/14_17:12:36 info: log_data_element: cib_update: +
>> </status>
>> cibmon[15042]: 2007/08/14_17:12:36 info: log_data_element: cib_update: +
>> </cib>
>> crmd[15040]: 2007/08/14_17:12:36 info: mem_handle_event: Got an event
>> OC_EV_MS_NEW_MEMBERSHIP from ccm
>> crmd[15040]: 2007/08/14_17:12:36 info: mem_handle_event: instance=1,
>> nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3
>> crmd[15040]: 2007/08/14_17:12:36 info: crmd_ccm_msg_callback: Quorum
>> (re)attained after event=NEW MEMBERSHIP (id=1)
>> crmd[15040]: 2007/08/14_17:12:36 info: ccm_event_detail: NEW MEMBERSHIP:
>> trans=1, nodes=1, new=1, lost=0 n_idx=0, new_idx=0, old_idx=3
>> crmd[15040]: 2007/08/14_17:12:36 info: ccm_event_detail: CURRENT:
>> cap-nm-05 [nodeid=0, born=1]
>> crmd[15040]: 2007/08/14_17:12:37 info: ccm_event_detail: NEW:
>> cap-nm-05 [nodeid=0, born=1]
>> cibmon[15042]: 2007/08/14_17:12:37 info: cibmon_diff: [cib_diff_notify]
>> cib_update confirmed
>> crmd[15040]: 2007/08/14_17:12:37 info: do_started: Delaying start, Config
>> not read (0000000000000040)
>> cibmon[15042]: 2007/08/14_17:12:37 info: log_cib_diff: cib_update:
>> Local-only Change: 0.11.1
>> crmd[15040]: 2007/08/14_17:12:37 notice: cluster_option: Using default
>> value '10s' for cluster option 'dc_deadtime'
>> cibmon[15042]: 2007/08/14_17:12:37 info: log_data_element: cib_update: +
>> <cib>
>> crmd[15040]: 2007/08/14_17:12:37 notice: cluster_option: Using default
>> value '0' for cluster option 'cluster_recheck_interval'
>> cibmon[15042]: 2007/08/14_17:12:37 info: log_data_element: cib_update: +
>> <status>
>> crmd[15040]: 2007/08/14_17:12:37 notice: cluster_option: Using default
>> value '2min' for cluster option 'election_timeout'
>> cibmon[15042]: 2007/08/14_17:12:37 info: log_data_element: cib_update:
>> + <node_state in_ccm="true" id="1291474c-994d-4998-9366-58edf073190c"/>
>> crmd[15040]: 2007/08/14_17:12:37 notice: cluster_option: Using default
>> value '20min' for cluster option 'shutdown_escalation'
>> cibmon[15042]: 2007/08/14_17:12:37 info: log_data_element: cib_update: +
>> </status>
>> crmd[15040]: 2007/08/14_17:12:37 notice: cluster_option: Using default
>> value '3min' for cluster option 'crmd-integration-timeout'
>> cibmon[15042]: 2007/08/14_17:12:37 info: log_data_element: cib_update: +
>> </cib>
>> crmd[15040]: 2007/08/14_17:12:37 notice: cluster_option: Using default
>> value '10min' for cluster option 'crmd-finalization-timeout'
>> crmd[15040]: 2007/08/14_17:12:37 info: do_started: The local CRM is
>> operational
>> crmd[15040]: 2007/08/14_17:12:37 info: do_state_transition: State
>> transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL
>> origin=do_started ]
>> crmd[15040]: 2007/08/14_17:12:37 info: update_dc: Set DC to <null>
>> (<null>)
>> attrd[15039]: 2007/08/14_17:12:38 info: main: Starting mainloop...
>> pingd[15043]: 2007/08/14_17:12:43 info: do_node_walk: Requesting the list
>> of configured nodes
>> pingd[15043]: 2007/08/14_17:12:43 info: send_update: 1 active ping nodes
>> attrd[15039]: 2007/08/14_17:12:43 info: find_hash_entry: Creating hash
>> entry for pingd_score
>> pingd[15043]: 2007/08/14_17:12:43 info: main: Starting pingd
>> attrd[15039]: 2007/08/14_17:12:48 info: attrd_trigger_update: Sending
>> flush op to all hosts for: pingd_score
>> attrd[15039]: 2007/08/14_17:12:48 info: attrd_ha_callback: flush message
>> from cap-nm-05
>> attrd[15039]: 2007/08/14_17:12:48 info: attrd_perform_update: Sent update
>> 3: pingd_score=100
>> crmd[15040]: 2007/08/14_17:14:38 info: crm_timer_popped: Election Trigger
>> (I_DC_TIMEOUT) just popped!
>> crmd[15040]: 2007/08/14_17:14:38 WARN: do_log: [[FSA]] Input I_DC_TIMEOUT
>> from crm_timer_popped() received in state (S_PENDING)
>> crmd[15040]: 2007/08/14_17:14:38 info: do_state_transition: State
>> transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED
>> origin=crm_timer_popped ]
>> crmd[15040]: 2007/08/14_17:14:38 info: update_dc: Set DC to <null>
>> (<null>)
>> crmd[15040]: 2007/08/14_17:14:38 info: do_election_count_vote: Updated
>> voted hash for cap-nm-05 to vote
>> crmd[15040]: 2007/08/14_17:14:38 info: do_election_count_vote: Election
>> ignore: our vote (cap-nm-05)
>> crmd[15040]: 2007/08/14_17:14:38 info: do_state_transition: State
>> transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC
>> cause=C_FSA_INTERNAL origin=do_election_check ]
>> crmd[15040]: 2007/08/14_17:14:38 info: start_subsystem: Starting
>> sub-system "tengine"
>> crmd[15040]: 2007/08/14_17:14:38 info: start_subsystem: Starting
>> sub-system "pengine"
>> crmd[15040]: 2007/08/14_17:14:38 info: do_dc_takeover: Taking over DC
>> status for this partition
>> crmd[15040]: 2007/08/14_17:14:38 info: update_dc: Set DC to <null>
>> (<null>)
>> crmd[15040]: 2007/08/14_17:14:38 info: join_make_offer: Making join offers
>> based on membership 1
>> crmd[15040]: 2007/08/14_17:14:38 info: do_dc_join_offer_all: join-1:
>> Waiting on 1 outstanding join acks
>> tengine[15048]: 2007/08/14_17:14:38 info: G_main_add_SignalHandler: Added
>> signal handler for signal 15
>> tengine[15048]: 2007/08/14_17:14:38 info: G_main_add_TriggerHandler: Added
>> signal manual handler
>> pengine[15049]: 2007/08/14_17:14:38 info: G_main_add_SignalHandler: Added
>> signal handler for signal 15
>> cib[15036]: 2007/08/14_17:14:38 info: cib_process_readwrite: We are now in
>> R/W mode
>> pengine[15049]: 2007/08/14_17:14:39 info: pe_init: Starting pengine
>> crmd[15040]: 2007/08/14_17:14:39 info: update_dc: Set DC to cap-nm-05 (
>> 1.0.9)
>> cibmon[15042]: 2007/08/14_17:14:39 info: cibmon_diff: [cib_diff_notify]
>> cib_update confirmed
>> cib[15036]: 2007/08/14_17:14:39 info: cib_null_callback: Setting
>> cib_diff_notify callbacks for tengine: on
>> tengine[15048]: 2007/08/14_17:14:39 info: te_init: Registering TE UUID:
>> 8f0f5a89-954b-4420-96a9-25b77327ea9c
>> cibmon[15042]: 2007/08/14_17:14:39 info: log_cib_diff: cib_update: Diff:
>> --- 0.11.1
>> tengine[15048]: 2007/08/14_17:14:39 info: set_graph_functions: Setting
>> custom graph functions
>> cibmon[15042]: 2007/08/14_17:14:39 info: log_cib_diff: cib_update: Diff:
>> +++ 0.11.2
>> tengine[15048]: 2007/08/14_17:14:39 info: unpack_graph: Unpacked
>> transition -1: 0 actions in 0 synapses
>> cibmon[15042]: 2007/08/14_17:14:39 info: log_data_element: cib_update: -
>> <cib num_updates="1"/>
>> tengine[15048]: 2007/08/14_17:14:39 info: te_init: Starting tengine
>> cibmon[15042]: 2007/08/14_17:14:39 info: log_data_element: cib_update: +
>> <cib num_updates="2"/>
>> crmd[15040]: 2007/08/14_17:14:39 info: do_state_transition: State
>> transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED
>> cause=C_FSA_INTERNAL origin=check_join_state ]
>> crmd[15040]: 2007/08/14_17:14:39 info: do_state_transition: All 1 cluster
>> nodes responded to the join offer.
>> crmd[15040]: 2007/08/14_17:14:39 info: update_attrd: Connecting to
>> attrd...
>> cib[15036]: 2007/08/14_17:14:39 info: sync_our_cib: Syncing CIB to all
>> peers
>> attrd[15039]: 2007/08/14_17:14:39 info: attrd_local_callback: Sending full
>> refresh
>> attrd[15039]: 2007/08/14_17:14:39 info: attrd_trigger_update: Sending
>> flush op to all hosts for: pingd_score
>> cibmon[15042]: 2007/08/14_17:14:39 info: cibmon_diff: [cib_diff_notify]
>> cib_update confirmed
>> cibmon[15042]: 2007/08/14_17:14:39 info: log_cib_diff: cib_update: Diff:
>> --- 0.11.2
>> cibmon[15042]: 2007/08/14_17:14:39 info: log_cib_diff: cib_update: Diff:
>> +++ 0.11.3
>> cibmon[15042]: 2007/08/14_17:14:39 info: log_data_element: cib_update: -
>> <cib generated="false" num_updates="2"/>
>> cibmon[15042]: 2007/08/14_17:14:39 info: log_data_element: cib_update: +
>> <cib generated="true" num_updates="3"
>> dc_uuid="1291474c-994d-4998-9366-58edf073190c"/>
>> cibmon[15042]: 2007/08/14_17:14:39 info: cibmon_diff: [cib_diff_notify]
>> cib_update confirmed
>> cibmon[15042]: 2007/08/14_17:14:39 info: log_cib_diff: cib_update: Diff:
>> --- 0.11.3
>> cibmon[15042]: 2007/08/14_17:14:39 info: log_cib_diff: cib_update: Diff:
>> +++ 0.11.4
>> cibmon[15042]: 2007/08/14_17:14:39 info: log_data_element: cib_update: -
>> <cib num_updates="3"/>
>> cibmon[15042]: 2007/08/14_17:14:39 info: log_data_element: cib_update: +
>> <cib num_updates="4"/>
>> attrd[15039]: 2007/08/14_17:14:40 info: attrd_ha_callback: flush message
>> from cap-nm-05
>> crmd[15040]: 2007/08/14_17:14:40 info: update_dc: Set DC to cap-nm-05 (
>> 1.0.9)
>> attrd[15039]: 2007/08/14_17:14:40 info: attrd_perform_update: Sent update
>> 5: pingd_score=100
>> cibmon[15042]: 2007/08/14_17:14:40 info: cibmon_diff: [cib_diff_notify]
>> cib_modify confirmed
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_cib_diff: cib_modify: Diff:
>> --- 0.11.4
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_cib_diff: cib_modify: Diff:
>> +++ 0.11.5
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_modify: -
>> <cib num_updates="4"/>
>> tengine[15048]: 2007/08/14_17:14:40 info: extract_event: Aborting on
>> transient_attributes changes for 1291474c-994d-4998-9366-58edf073190c
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_modify: +
>> <cib num_updates="5">
>> tengine[15048]: 2007/08/14_17:14:40 info: update_abort_priority: Abort
>> priority upgraded to 1000000
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_modify: +
>> <status>
>> tengine[15048]: 2007/08/14_17:14:40 info: update_abort_priority: 'DC
>> Takeover' abort superceeded
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_modify:
>> + <node_state id="1291474c-994d-4998-9366-58edf073190c">
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_modify:
>> + <transient_attributes id="1291474c-994d-4998-9366-58edf073190c">
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_modify:
>> + <instance_attributes
>> id="status-1291474c-994d-4998-9366-58edf073190c">
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_modify:
>> + <attributes>
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_modify:
>> + <nvpair
>> id="status-1291474c-994d-4998-9366-58edf073190c-pingd_score"
>> name="pingd_score" value="100"/>
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_modify:
>> + </attributes>
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_modify:
>> + </instance_attributes>
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_modify:
>> + </transient_attributes>
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_modify:
>> + </node_state>
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_modify: +
>> </status>
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_modify: +
>> </cib>
>> crmd[15040]: 2007/08/14_17:14:40 info: do_dc_join_ack: join-1: Updating
>> node state to member for cap-nm-05
>> cibmon[15042]: 2007/08/14_17:14:40 info: cibmon_diff: [cib_diff_notify]
>> cib_update confirmed
>> crmd[15040]: 2007/08/14_17:14:40 info: do_state_transition: State
>> transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED
>> cause=C_FSA_INTERNAL origin=check_join_state ]
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_cib_diff: cib_update: Diff:
>> --- 0.11.5
>> crmd[15040]: 2007/08/14_17:14:40 info: do_state_transition: All 1 cluster
>> nodes are eligible to run resources.
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_cib_diff: cib_update: Diff:
>> +++ 0.11.6
>> pengine[15049]: 2007/08/14_17:14:40 WARN: cluster_option: Using deprecated
>> name 'no_quorum_policy' for cluster option 'no-quorum-policy'
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_update: -
>> <cib num_updates="5"/>
>> pengine[15049]: 2007/08/14_17:14:40 WARN: cluster_option: Using deprecated
>> name 'symmetric_cluster' for cluster option 'symmetric-cluster'
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_update: +
>> <cib num_updates="6">
>> pengine[15049]: 2007/08/14_17:14:40 WARN: cluster_option: Using deprecated
>> name 'stonith_enabled' for cluster option 'stonith-enabled'
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_update: +
>> <status>
>> pengine[15049]: 2007/08/14_17:14:40 notice: cluster_option: Using default
>> value 'reboot' for cluster option 'stonith-action'
>> cibmon[15042]: 2007/08/14_17:14:40 info: log_data_element: cib_update:
>> + <node_state ha="active" join="member" expected="member"
>> id="1291474c-994d-4998-9366-58edf073190c">
>> pengine[15049]: 2007/08/14_17:14:41 WARN: cluster_option: Using deprecated
>> name 'default_resource_stickiness' for cluster option
>> 'default-resource-stickiness'
>> cibmon[15042]: 2007/08/14_17:14:41 info: log_data_element: cib_update:
>> + <lrm id="1291474c-994d-4998-9366-58edf073190c">
>> pengine[15049]: 2007/08/14_17:14:41 WARN: cluster_option: Using deprecated
>> name 'default_resource_failure_stickiness' for cluster option
>> 'default-resource-failure-stickiness'
>> cibmon[15042]: 2007/08/14_17:14:41 info: log_data_element: cib_update:
>> + <lrm_resources/>
>> pengine[15049]: 2007/08/14_17:14:41 WARN: cluster_option: Using deprecated
>> name 'is_managed_default' for cluster option 'is-managed-default'
>> cibmon[15042]: 2007/08/14_17:14:41 info: log_data_element: cib_update:
>> + </lrm>
>> pengine[15049]: 2007/08/14_17:14:41 notice: cluster_option: Using default
>> value '60s' for cluster option 'cluster-delay'
>> cibmon[15042]: 2007/08/14_17:14:41 info: log_data_element: cib_update:
>> + </node_state>
>> pengine[15049]: 2007/08/14_17:14:41 notice: cluster_option: Using default
>> value '20s' for cluster option 'default-action-timeout'
>> cibmon[15042]: 2007/08/14_17:14:41 info: log_data_element: cib_update: +
>> </status>
>> pengine[15049]: 2007/08/14_17:14:41 notice: cluster_option: Using default
>> value 'true' for cluster option 'stop-orphan-resources'
>> cibmon[15042]: 2007/08/14_17:14:41 info: log_data_element: cib_update: +
>> </cib>
>> pengine[15049]: 2007/08/14_17:14:41 notice: cluster_option: Using default
>> value 'true' for cluster option 'stop-orphan-actions'
>> pengine[15049]: 2007/08/14_17:14:41 notice: cluster_option: Using default
>> value 'false' for cluster option 'remove-after-stop'
>> pengine[15049]: 2007/08/14_17:14:41 notice: cluster_option: Using default
>> value '-1' for cluster option 'pe-error-series-max'
>> pengine[15049]: 2007/08/14_17:14:41 notice: cluster_option: Using default
>> value '-1' for cluster option 'pe-warn-series-max'
>> pengine[15049]: 2007/08/14_17:14:41 notice: cluster_option: Using default
>> value '-1' for cluster option 'pe-input-series-max'
>> pengine[15049]: 2007/08/14_17:14:41 notice: cluster_option: Using default
>> value 'true' for cluster option 'startup-fencing'
>> pengine[15049]: 2007/08/14_17:14:41 notice: unpack_config: On loss of CCM
>> Quorum: Ignore
>> pengine[15049]: 2007/08/14_17:14:41 info: determine_online_status: Node
>> cap-nm-05 is online
>> pengine[15049]: 2007/08/14_17:14:41 info: group_print: Resource Group:
>> g1_Cockpit
>> pengine[15049]: 2007/08/14_17:14:41 info: native_print:
>> drbddisk_1 (heartbeat:drbddisk): Stopped
>> pengine[15049]: 2007/08/14_17:14:41 info: native_print:
>> Filesystem_1 (heartbeat::ocf:Filesystem): Stopped
>> pengine[15049]: 2007/08/14_17:14:41 info: native_print:
>> drbdlinks_g1 (heartbeat:drbdlinks): Stopped
>> pengine[15049]: 2007/08/14_17:14:41 info: native_print:
>> VE101_Cokcpit (heartbeat::ocf:ManageVE): Stopped
>> pengine[15049]: 2007/08/14_17:14:41 info: native_print:
>> MailtoG1_Cockpit (heartbeat::ocf:MailTo): Stopped
>> pengine[15049]: 2007/08/14_17:14:41 notice:
>> StartRsc: cap-nm-05 Start drbddisk_1
>> pengine[15049]: 2007/08/14_17:14:41 notice:
>> StartRsc: cap-nm-05 Start Filesystem_1
>> pengine[15049]: 2007/08/14_17:14:41 notice:
>> StartRsc: cap-nm-05 Start drbdlinks_g1
>> pengine[15049]: 2007/08/14_17:14:41 notice:
>> StartRsc: cap-nm-05 Start VE101_Cokcpit
>> pengine[15049]: 2007/08/14_17:14:42 notice:
>> StartRsc: cap-nm-05 Start MailtoG1_Cockpit
>> pengine[15049]: 2007/08/14_17:14:42 info: process_pe_message: Transition
>> 0: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-10.bz2
>> crmd[15040]: 2007/08/14_17:14:42 info: do_state_transition: State
>> transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS
>> cause=C_IPC_MESSAGE origin=route_message ]
>> pengine[15049]: 2007/08/14_17:14:42 info: process_pe_message:
>> Configuration WARNINGs found during PE processing. Please run "crm_verify
>> -L" to identify issues.
>> tengine[15048]: 2007/08/14_17:14:42 info: unpack_graph: Unpacked
>> transition 0: 14 actions in 14 synapses
>> tengine[15048]: 2007/08/14_17:14:42 info: send_rsc_command: Initiating
>> action 3: drbddisk_1_monitor_0 on cap-nm-05
>> tengine[15048]: 2007/08/14_17:14:42 info: send_rsc_command: Initiating
>> action 4: Filesystem_1_monitor_0 on cap-nm-05
>> crmd[15040]: 2007/08/14_17:14:42 info: do_lrm_rsc_op: Performing
>> op=drbddisk_1_monitor_0 key=3:0:8f0f5a89-954b-4420-96a9-25b77327ea9c)
>> tengine[15048]: 2007/08/14_17:14:42 info: send_rsc_command: Initiating
>> action 5: drbdlinks_g1_monitor_0 on cap-nm-05
>> crmd[15040]: 2007/08/14_17:14:42 info: do_lrm_rsc_op: Performing
>> op=Filesystem_1_monitor_0 key=4:0:8f0f5a89-954b-4420-96a9-25b77327ea9c)
>> tengine[15048]: 2007/08/14_17:14:42 info: send_rsc_command: Initiating
>> action 6: VE101_Cokcpit_monitor_0 on cap-nm-05
>> tengine[15048]: 2007/08/14_17:14:42 info: send_rsc_command: Initiating
>> action 7: MailtoG1_Cockpit_monitor_0 on cap-nm-05
>> lrmd[15037]: 2007/08/14_17:14:42 notice: lrmd_rsc_new(): No lrm_rprovider
>> field in message
>> crmd[15040]: 2007/08/14_17:14:42 info: do_lrm_rsc_op: Performing
>> op=drbdlinks_g1_monitor_0 key=5:0:8f0f5a89-954b-4420-96a9-25b77327ea9c)
>> crmd[15040]: 2007/08/14_17:14:42 info: do_lrm_rsc_op: Performing
>> op=VE101_Cokcpit_monitor_0 key=6:0:8f0f5a89-954b-4420-96a9-25b77327ea9c)
>> lrmd[15037]: 2007/08/14_17:14:42 debug: RA output [ERROR: Loading
>> configuration file failed. See below for details:
>> ERROR: Unable] didn't match any pattern
>> lrmd[15037]: 2007/08/14_17:14:42 WARN: G_SIG_dispatch: Dispatch function
>> for SIGCHLD took too long to execute: 50 ms (> 30 ms) (GSource: 0x91ad090)
>> crmd[15040]: 2007/08/14_17:14:42 info: do_lrm_rsc_op: Performing
>> op=MailtoG1_Cockpit_monitor_0 key=7:0:8f0f5a89-954b-4420-96a9-25b77327ea9c)
>> ManageVE[15087]: 2007/08/14_17:14:42 ERROR: vzctl status 101
>> returned: 101 does not exist.
>> crmd[15040]: 2007/08/14_17:14:42 info: process_lrm_event: LRM operation
>> drbddisk_1_monitor_0 (call=2, rc=7) complete
>> crmd[15040]: 2007/08/14_17:14:42 info: process_lrm_event: LRM operation
>> Filesystem_1_monitor_0 (call=3, rc=7) complete
>> cibmon[15042]: 2007/08/14_17:14:42 info: cibmon_diff: [cib_diff_notify]
>> cib_update confirmed
>> tengine[15048]: 2007/08/14_17:14:42 info: match_graph_event: Action
>> drbddisk_1_monitor_0 (3) confirmed on cap-nm-05
>> crmd[15040]: 2007/08/14_17:14:42 info: process_lrm_event: LRM operation
>> drbdlinks_g1_monitor_0 (call=4, rc=7) complete
>> cibmon[15042]: 2007/08/14_17:14:42 info: log_cib_diff: cib_update: Diff:
>> --- 0.11.6
>> tengine[15048]: 2007/08/14_17:14:42 info: match_graph_event: Action
>> Filesystem_1_monitor_0 (4) confirmed on cap-nm-05
>> crmd[15040]: 2007/08/14_17:14:42 ERROR: process_lrm_event: LRM operation
>> VE101_Cokcpit_monitor_0 (call=5, rc=5) Error not installed
>> tengine[15048]: 2007/08/14_17:14:42 info: match_graph_event: Action
>> drbdlinks_g1_monitor_0 (5) confirmed on cap-nm-05
>> cibmon[15042]: 2007/08/14_17:14:42 info: log_cib_diff: cib_update: Diff:
>> +++ 0.11.7
>> crmd[15040]: 2007/08/14_17:14:42 info: process_lrm_event: LRM operation
>> MailtoG1_Cockpit_monitor_0 (call=6, rc=7) complete
>> tengine[15048]: 2007/08/14_17:14:42 WARN: status_from_rc: Action monitor
>> on cap-nm-05 failed (target: 7 vs. rc: 5): Error
>> cibmon[15042]: 2007/08/14_17:14:42 info: log_data_element: cib_update: -
>> <cib num_updates="6"/>
>> tengine[15048]: 2007/08/14_17:14:43 info: update_abort_priority: Abort
>> priority upgraded to 1
>> cibmon[15042]: 2007/08/14_17:14:43 info: log_data_element: cib_update: +
>> <cib num_updates="7">
>> tengine[15048]: 2007/08/14_17:14:43 info: update_abort_priority: Abort
>> action 0 superceeded by 2
>> cibmon[15042]: 2007/08/14_17:14:43 info: log_data_element: cib_update: +
>> <status>
>> tengine[15048]: 2007/08/14_17:14:43 info: match_graph_event: Action
>> VE101_Cokcpit_monitor_0 (6) confirmed on cap-nm-05
>> cibmon[15042]: 2007/08/14_17:14:43 info: log_data_element: cib_update:
>> + <node_state id="1291474c-994d-4998-9366-58edf073190c">
>> tengine[15048]: 2007/08/14_17:14:43 info: match_graph_event: Action
>> MailtoG1_Cockpit_monitor_0 (7) confirmed on cap-nm-05
>> cibmon[15042]: 2007/08/14_17:14:43 info: log_data_element: cib_update:
>> + <lrm id="1291474c-994d-4998-9366-58edf073190c">
>> tengine[15048]: 2007/08/14_17:14:43 info: run_graph:
>> ====================================================
>> cibmon[15042]: 2007/08/14_17:14:43 info: log_data_element: cib_update:
>> + <lrm_resources>
>> tengine[15048]: 2007/08/14_17:14:43 notice: run_graph: Transition 0:
>> (Complete=5, Pending=0, Fired=0, Skipped=8, Incomplete=1)
>> cibmon[15042]: 2007/08/14_17:14:43 info: log_data_element: cib_update:
>> + <lrm_resource id="drbddisk_1" type="drbddisk" class="heartbeat"
>> provider="heartbeat">
>> crmd[15040]: 2007/08/14_17:14:43 info: do_state_transition: State
>> transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC
>> cause=C_IPC_MESSAGE origin=route_message ]
>> cibmon[15042]: 2007/08/14_17:14:43 info: log_data_element: cib_update:
>> + <lrm_rsc_op id="drbddisk_1_monitor_0" operation="monitor"
>> crm-debug-origin="do_update_resource"
>> transition_key="3:0:8f0f5a89-954b-4420-96a9-25b77327ea9c"
>> transition_magic="0:7;3:0:8f0f5a89-954b-4420-96a9-25b77327ea9c" call_id="2"
>> crm_feature_set=" 1.0.9" rc_code="7" op_status="0" interval="0"
>> op_digest="d197bc6c05caacd42ef9f2b2d93e9d28"/>
>> crmd[15040]: 2007/08/14_17:14:43 info: do_state_transition: All 1 cluster
>> nodes are eligible to run resources.
>> cibmon[15042]: 2007/08/14_17:14:43 info: log_data_element: cib_update:
>> + </lrm_resource>
>> pengine[15049]: 2007/08/14_17:14:43 WARN: cluster_option: Using deprecated
>> name 'no_quorum_policy' for cluster option 'no-quorum-policy'
>> cibmon[15042]: 2007/08/14_17:14:43 info: log_data_element: cib_update:
>> + </lrm_resources>
>> pengine[15049]: 2007/08/14_17:14:43 WARN: cluster_option: Using deprecated
>> name 'symmetric_cluster' for cluster option 'symmetric-cluster'
>> cibmon[15042]: 2007/08/14_17:14:43 info: log_data_element: cib_update:
>> + </lrm>
>> pengine[15049]: 2007/08/14_17:14:43 WARN: cluster_option: Using deprecated
>> name 'stonith_enabled' for cluster option 'stonith-enabled'
>> cibmon[15042]: 2007/08/14_17:14:43 info: log_data_element: cib_update:
>> + </node_state>
>> pengine[15049]: 2007/08/14_17:14:43 notice: cluster_option: Using default
>> value 'reboot' for cluster option 'stonith-action'
>> cibmon[15042]: 2007/08/14_17:14:43 info: log_data_element: cib_update: +
>> </status>
>> pengine[15049]: 2007/08/14_17:14:43 WARN: cluster_option: Using deprecated
>> name 'default_resource_stickiness' for cluster option
>> 'default-resource-stickiness'
>> cibmon[15042]: 2007/08/14_17:14:43 info: log_data_element: cib_update: +
>> </cib>
>> pengine[15049]: 2007/08/14_17:14:43 WARN: cluster_option: Using deprecated
>> name 'default_resource_failure_stickiness' for cluster option
>> 'default-resource-failure-stickiness'
>> cibmon[15042]: 2007/08/14_17:14:43 info: cibmon_diff: [cib_diff_notify]
>> cib_update confirmed
>> pengine[15049]: 2007/08/14_17:14:43 WARN: cluster_option: Using deprecated
>> name 'is_managed_default' for cluster option 'is-managed-default'
>> cibmon[15042]: 2007/08/14_17:14:43 info: log_cib_diff: cib_update: Diff:
>> --- 0.11.7
>> pengine[15049]: 2007/08/14_17:14:43 notice: cluster_option: Using default
>> value '60s' for cluster option 'cluster-delay'
>> cibmon[15042]: 2007/08/14_17:14:43 info: log_cib_diff: cib_update: Diff:
>> +++ 0.11.8
>> pengine[15049]: 2007/08/14_17:14:44 notice: cluster_option: Using default
>> value '20s' for cluster option 'default-action-timeout'
>> cibmon[15042]: 2007/08/14_17:14:44 info: log_data_element: cib_update: -
>> <cib num_updates="7"/>
>> pengine[15049]: 2007/08/14_17:14:44 notice: cluster_option: Using default
>> value 'true' for cluster option 'stop-orphan-resources'
>> cibmon[15042]: 2007/08/14_17:14:44 info: log_data_element: cib_update: +
>> <cib num_updates="8">
>> pengine[15049]: 2007/08/14_17:14:44 notice: cluster_option: Using default
>> value 'true' for cluster option 'stop-orphan-actions'
>> cibmon[15042]: 2007/08/14_17:14:44 info: log_data_element: cib_update: +
>> <status>
>> pengine[15049]: 2007/08/14_17:14:44 notice: cluster_option: Using default
>> value 'false' for cluster option 'remove-after-stop'
>> cibmon[15042]: 2007/08/14_17:14:44 info: log_data_element: cib_update:
>> + <node_state id="1291474c-994d-4998-9366-58edf073190c">
>> pengine[15049]: 2007/08/14_17:14:44 notice: cluster_option: Using default
>> value '-1' for cluster option 'pe-error-series-max'
>> cibmon[15042]: 2007/08/14_17:14:44 info: log_data_element: cib_update:
>> + <lrm id="1291474c-994d-4998-9366-58edf073190c">
>> pengine[15049]: 2007/08/14_17:14:44 notice: cluster_option: Using default
>> value '-1' for cluster option 'pe-warn-series-max'
>> cibmon[15042]: 2007/08/14_17:14:44 info: log_data_element: cib_update:
>> + <lrm_resources>
>> pengine[15049]: 2007/08/14_17:14:44 notice: cluster_option: Using default
>> value '-1' for cluster option 'pe-input-series-max'
>> cibmon[15042]: 2007/08/14_17:14:44 info: log_data_element: cib_update:
>> + <lrm_resource id="Filesystem_1" type="Filesystem" class="ocf"
>> provider="heartbeat">
>> pengine[15049]: 2007/08/14_17:14:44 notice: cluster_option: Using default
>> value 'true' for cluster option 'startup-fencing'
>> cibmon[15042]: 2007/08/14_17:14:44 info: log_data_element: cib_update:
>> + <lrm_rsc_op id="Filesystem_1_monitor_0" operation="monitor"
>> crm-debug-origin="do_update_resource"
>> transition_key="4:0:8f0f5a89-954b-4420-96a9-25b77327ea9c"
>> transition_magic="0:7;4:0:8f0f5a89-954b-4420-96a9-25b77327ea9c" call_id="3"
>> crm_feature_set=" 1.0.9" rc_code="7" op_status="0" interval="0"
>> op_digest="0ae911cec6eab8f6a1fb514267bc0637"/>
>> pengine[15049]: 2007/08/14_17:14:44 notice: unpack_config: On loss of CCM
>> Quorum: Ignore
>> cibmon[15042]: 2007/08/14_17:14:44 info: log_data_element: cib_update:
>> + </lrm_resource>
>> pengine[15049]: 2007/08/14_17:14:44 info: determine_online_status: Node
>> cap-nm-05 is online
>> cibmon[15042]: 2007/08/14_17:14:44 info: log_data_element: cib_update:
>> + </lrm_resources>
>> pengine[15049]: 2007/08/14_17:14:44 info: group_print: Resource Group:
>> g1_Cockpit
>> cibmon[15042]: 2007/08/14_17:14:44 info: log_data_element: cib_update:
>> + </lrm>
>> pengine[15049]: 2007/08/14_17:14:44 info: native_print:
>> drbddisk_1 (heartbeat:drbddisk): Stopped
>> cibmon[15042]: 2007/08/14_17:14:44 info: log_data_element: cib_update:
>> + </node_state>
>> pengine[15049]: 2007/08/14_17:14:44 info: native_print:
>> Filesystem_1 (heartbeat::ocf:Filesystem): Stopped
>> cibmon[15042]: 2007/08/14_17:14:44 info: log_data_element: cib_update: +
>> </status>
>> pengine[15049]: 2007/08/14_17:14:44 info: native_print:
>> drbdlinks_g1 (heartbeat:drbdlinks): Stopped
>> cibmon[15042]: 2007/08/14_17:14:44 info: log_data_element: cib_update: +
>> </cib>
>> pengine[15049]: 2007/08/14_17:14:44 info: native_print:
>> VE101_Cokcpit (heartbeat::ocf:ManageVE): Stopped
>> cibmon[15042]: 2007/08/14_17:14:44 info: cibmon_diff: [cib_diff_notify]
>> cib_update confirmed
>> pengine[15049]: 2007/08/14_17:14:44 info: native_print:
>> MailtoG1_Cockpit (heartbeat::ocf:MailTo): Stopped
>> cibmon[15042]: 2007/08/14_17:14:45 info: log_cib_diff: cib_update: Diff:
>> --- 0.11.8
>> pengine[15049]: 2007/08/14_17:14:45 WARN: native_color: Resource
>> drbddisk_1 cannot run anywhere
>> cibmon[15042]: 2007/08/14_17:14:45 info: log_cib_diff: cib_update: Diff:
>> +++ 0.11.9
>> pengine[15049]: 2007/08/14_17:14:45 WARN: native_color: Resource
>> Filesystem_1 cannot run anywhere
>> cibmon[15042]: 2007/08/14_17:14:45 info: log_data_element: cib_update: -
>> <cib num_updates="8"/>
>> pengine[15049]: 2007/08/14_17:14:45 WARN: native_color: Resource
>> drbdlinks_g1 cannot run anywhere
>> cibmon[15042]: 2007/08/14_17:14:45 info: log_data_element: cib_update: +
>> <cib num_updates="9">
>> pengine[15049]: 2007/08/14_17:14:45 WARN: native_color: Resource
>> VE101_Cokcpit cannot run anywhere
>> cibmon[15042]: 2007/08/14_17:14:45 info: log_data_element: cib_update: +
>> <status>
>> pengine[15049]: 2007/08/14_17:14:45 WARN: native_color: Resource
>> MailtoG1_Cockpit cannot run anywhere
>> cibmon[15042]: 2007/08/14_17:14:45 info: log_data_element: cib_update:
>> + <node_state id="1291474c-994d-4998-9366-58edf073190c">
>> crmd[15040]: 2007/08/14_17:14:45 info: do_state_transition: State
>> transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS
>> cause=C_IPC_MESSAGE origin=route_message ]
>> pengine[15049]: 2007/08/14_17:14:45 WARN: process_pe_message: Transition
>> 1: WARNINGs found during PE processing. PEngine Input stored in:
>> /var/lib/heartbeat/pengine/pe- warn-144.bz2
>> cibmon[15042]: 2007/08/14_17:14:45 info: log_data_element: cib_update:
>> + <lrm id="1291474c-994d-4998-9366-58edf073190c">
>> tengine[15048]: 2007/08/14_17:14:45 info: unpack_graph: Unpacked
>> transition 1: 1 actions in 1 synapses
>> pengine[15049]: 2007/08/14_17:14:45 info: process_pe_message:
>> Configuration WARNINGs found during PE processing. Please run "crm_verify
>> -L" to identify issues.
>> cibmon[15042]: 2007/08/14_17:14:45 info: log_data_element: cib_update:
>> + <lrm_resources>
>> tengine[15048]: 2007/08/14_17:14:45 info: send_rsc_command: Initiating
>> action 2: probe_complete on cap-nm-05
>> cibmon[15042]: 2007/08/14_17:14:45 info: log_data_element: cib_update:
>> + <lrm_resource id="drbdlinks_g1" type="drbdlinks"
>> class="heartbeat">
>> tengine[15048]: 2007/08/14_17:14:45 info: run_graph: Transition 1:
>> (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0)
>> cibmon[15042]: 2007/08/14_17:14:45 info: log_data_element: cib_update:
>> + <lrm_rsc_op id="drbdlinks_g1_monitor_0" operation="monitor"
>> crm-debug-origin="do_update_resource"
>> transition_key="5:0:8f0f5a89-954b-4420-96a9-25b77327ea9c"
>> transition_magic="0:7;5:0:8f0f5a89-954b-4420-96a9-25b77327ea9c" call_id="4"
>> crm_feature_set=" 1.0.9" rc_code="7" op_status="0" interval="0"
>> op_digest="3bf8ca94649f590c0931dfeebf83e751"/>
>> tengine[15048]: 2007/08/14_17:14:45 info: notify_crmd: Transition 1
>> status: te_complete - <null>
>> cibmon[15042]: 2007/08/14_17:14:45 info: log_data_element: cib_update:
>> + </lrm_resource>
>> crmd[15040]: 2007/08/14_17:14:45 info: do_state_transition: State
>> transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS
>> cause=C_IPC_MESSAGE origin=route_message ]
>> tengine[15048]: 2007/08/14_17:14:45 info: extract_event: Aborting on
>> transient_attributes changes for 1291474c-994d-4998-9366-58edf073190c
>> cibmon[15042]: 2007/08/14_17:14:45 info: log_data_element: cib_update:
>> + </lrm_resources>
>> tengine[15048]: 2007/08/14_17:14:45 info: update_abort_priority: Abort
>> priority upgraded to 1000000
>> cibmon[15042]: 2007/08/14_17:14:45 info: log_data_element: cib_update:
>> + </lrm>
>> crmd[15040]: 2007/08/14_17:14:45 info: do_state_transition: State
>> transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE
>> origin=route_message ]
>> cibmon[15042]: 2007/08/14_17:14:45 info: log_data_element: cib_update:
>> + </node_state>
>> crmd[15040]: 2007/08/14_17:14:45 info: do_state_transition: All 1 cluster
>> nodes are eligible to run resources.
>> cibmon[15042]: 2007/08/14_17:14:46 info: log_data_element: cib_update: +
>> </status>
>> pengine[15049]: 2007/08/14_17:14:46 WARN: cluster_option: Using deprecated
>> name 'no_quorum_policy' for cluster option 'no-quorum-policy'
>> cibmon[15042]: 2007/08/14_17:14:46 info: log_data_element: cib_update: +
>> </cib>
>> pengine[15049]: 2007/08/14_17:14:46 WARN: cluster_option: Using deprecated
>> name 'symmetric_cluster' for cluster option 'symmetric-cluster'
>> cibmon[15042]: 2007/08/14_17:14:46 info: cibmon_diff: [cib_diff_notify]
>> cib_update confirmed
>> pengine[15049]: 2007/08/14_17:14:46 WARN: cluster_option: Using deprecated
>> name 'stonith_enabled' for cluster option 'stonith-enabled'
>> cibmon[15042]: 2007/08/14_17:14:46 info: log_cib_diff: cib_update: Diff:
>> --- 0.11.9
>> pengine[15049]: 2007/08/14_17:14:46 notice: cluster_option: Using default
>> value 'reboot' for cluster option 'stonith-action'
>> cibmon[15042]: 2007/08/14_17:14:46 info: log_cib_diff: cib_update: Diff:
>> +++ 0.11.10
>> pengine[15049]: 2007/08/14_17:14:46 WARN: cluster_option: Using deprecated
>> name 'default_resource_stickiness' for cluster option
>> 'default-resource-stickiness'
>> cibmon[15042]: 2007/08/14_17:14:46 info: log_data_element: cib_update: -
>> <cib num_updates="9"/>
>> pengine[15049]: 2007/08/14_17:14:46 WARN: cluster_option: Using deprecated
>> name 'default_resource_failure_stickiness' for cluster option
>> 'default-resource-failure-stickiness'
>> cibmon[15042]: 2007/08/14_17:14:46 info: log_data_element: cib_update: +
>> <cib num_updates="10">
>> pengine[15049]: 2007/08/14_17:14:46 WARN: cluster_option: Using deprecated
>> name 'is_managed_default' for cluster option 'is-managed-default'
>> cibmon[15042]: 2007/08/14_17:14:46 info: log_data_element: cib_update: +
>> <status>
>> pengine[15049]: 2007/08/14_17:14:46 notice: cluster_option: Using default
>> value '60s' for cluster option 'cluster-delay'
>> cibmon[15042]: 2007/08/14_17:14:46 info: log_data_element: cib_update:
>> + <node_state id="1291474c-994d-4998-9366-58edf073190c">
>> pengine[15049]: 2007/08/14_17:14:46 notice: cluster_option: Using default
>> value '20s' for cluster option 'default-action-timeout'
>> cibmon[15042]: 2007/08/14_17:14:46 info: log_data_element: cib_update:
>> + <lrm id="1291474c-994d-4998-9366-58edf073190c">
>> pengine[15049]: 2007/08/14_17:14:46 notice: cluster_option: Using default
>> value 'true' for cluster option 'stop-orphan-resources'
>> cibmon[15042]: 2007/08/14_17:14:46 info: log_data_element: cib_update:
>> + <lrm_resources>
>> pengine[15049]: 2007/08/14_17:14:46 notice: cluster_option: Using default
>> value 'true' for cluster option 'stop-orphan-actions'
>> cibmon[15042]: 2007/08/14_17:14:46 info: log_data_element: cib_update:
>> + <lrm_resource id="VE101_Cokcpit" type="ManageVE" class="ocf"
>> provider="heartbeat">
>> pengine[15049]: 2007/08/14_17:14:46 notice: cluster_option: Using default
>> value 'false' for cluster option 'remove-after-stop'
>> cibmon[15042]: 2007/08/14_17:14:46 info: log_data_element: cib_update:
>> + <lrm_rsc_op id="VE101_Cokcpit_monitor_0" operation="monitor"
>> crm-debug-origin="do_update_resource"
>> transition_key="6:0:8f0f5a89-954b-4420-96a9-25b77327ea9c"
>> transition_magic="4:5;6:0:8f0f5a89-954b-4420-96a9-25b77327ea9c" call_id="5"
>> crm_feature_set=" 1.0.9" rc_code="5" op_status="4" interval="0"
>> op_digest="a21e2103de1d9b9771d56c8890dff544"/>
>> pengine[15049]: 2007/08/14_17:14:46 notice: cluster_option: Using default
>> value '-1' for cluster option 'pe-error-series-max'
>> cibmon[15042]: 2007/08/14_17:14:46 info: log_data_element: cib_update:
>> + </lrm_resource>
>> pengine[15049]: 2007/08/14_17:14:46 notice: cluster_option: Using default
>> value '-1' for cluster option 'pe-warn-series-max'
>> cibmon[15042]: 2007/08/14_17:14:46 info: log_data_element: cib_update:
>> + </lrm_resources>
>> pengine[15049]: 2007/08/14_17:14:46 notice: cluster_option: Using default
>> value '-1' for cluster option 'pe-input-series-max'
>> cibmon[15042]: 2007/08/14_17:14:46 info: log_data_element: cib_update:
>> + </lrm>
>> pengine[15049]: 2007/08/14_17:14:46 notice: cluster_option: Using default
>> value 'true' for cluster option 'startup-fencing'
>> cibmon[15042]: 2007/08/14_17:14:47 info: log_data_element: cib_update:
>> + </node_state>
>> pengine[15049]: 2007/08/14_17:14:47 notice: unpack_config: On loss of CCM
>> Quorum: Ignore
>> cibmon[15042]: 2007/08/14_17:14:47 info: log_data_element: cib_update: +
>> </status>
>> pengine[15049]: 2007/08/14_17:14:47 info: determine_online_status: Node
>> cap-nm-05 is online
>> cibmon[15042]: 2007/08/14_17:14:47 info: log_data_element: cib_update: +
>> </cib>
>> pengine[15049]: 2007/08/14_17:14:47 info: group_print: Resource Group:
>> g1_Cockpit
>> cibmon[15042]: 2007/08/14_17:14:47 info: cibmon_diff: [cib_diff_notify]
>> cib_update confirmed
>> pengine[15049]: 2007/08/14_17:14:47 info: native_print:
>> drbddisk_1 (heartbeat:drbddisk): Stopped
>> cibmon[15042]: 2007/08/14_17:14:47 info: log_cib_diff: cib_update: Diff:
>> --- 0.11.10
>> pengine[15049]: 2007/08/14_17:14:47 info: native_print:
>> Filesystem_1 (heartbeat::ocf:Filesystem): Stopped
>> cibmon[15042]: 2007/08/14_17:14:47 info: log_cib_diff: cib_update: Diff:
>> +++ 0.11.11
>> pengine[15049]: 2007/08/14_17:14:47 info: native_print:
>> drbdlinks_g1 (heartbeat:drbdlinks): Stopped
>> cibmon[15042]: 2007/08/14_17:14:47 info: log_data_element: cib_update: -
>> <cib num_updates="10"/>
>> pengine[15049]: 2007/08/14_17:14:47 info: native_print:
>> VE101_Cokcpit (heartbeat::ocf:ManageVE): Stopped
>> cibmon[15042]: 2007/08/14_17:14:47 info: log_data_element: cib_update: +
>> <cib num_updates="11">
>> pengine[15049]: 2007/08/14_17:14:47 info: native_print:
>> MailtoG1_Cockpit (heartbeat::ocf:MailTo): Stopped
>> cibmon[15042]: 2007/08/14_17:14:47 info: log_data_element: cib_update: +
>> <status>
>> pengine[15049]: 2007/08/14_17:14:47 WARN: native_color: Resource
>> drbddisk_1 cannot run anywhere
>> cibmon[15042]: 2007/08/14_17:14:47 info: log_data_element: cib_update:
>> + <node_state id="1291474c-994d-4998-9366-58edf073190c">
>> pengine[15049]: 2007/08/14_17:14:47 WARN: native_color: Resource
>> Filesystem_1 cannot run anywhere
>> cibmon[15042]: 2007/08/14_17:14:47 info: log_data_element: cib_update:
>> + <lrm id="1291474c-994d-4998-9366-58edf073190c">
>> pengine[15049]: 2007/08/14_17:14:47 WARN: native_color: Resource
>> drbdlinks_g1 cannot run anywhere
>> cibmon[15042]: 2007/08/14_17:14:47 info: log_data_element: cib_update:
>> + <lrm_resources>
>> pengine[15049]: 2007/08/14_17:14:47 WARN: native_color: Resource
>> VE101_Cokcpit cannot run anywhere
>> cibmon[15042]: 2007/08/14_17:14:47 info: log_data_element: cib_update:
>> + <lrm_resource id="MailtoG1_Cockpit" type="MailTo" class="ocf"
>> provider="heartbeat">
>> pengine[15049]: 2007/08/14_17:14:47 WARN: native_color: Resource
>> MailtoG1_Cockpit cannot run anywhere
>> cibmon[15042]: 2007/08/14_17:14:47 info: log_data_element: cib_update:
>> + <lrm_rsc_op id="MailtoG1_Cockpit_monitor_0"
>> operation="monitor" crm-debug-origin="do_update_resource"
>> transition_key="7:0:8f0f5a89-954b-4420-96a9-25b77327ea9c"
>> transition_magic="0:7;7:0:8f0f5a89-954b-4420-96a9-25b77327ea9c" call_id="6"
>> crm_feature_set=" 1.0.9" rc_code="7" op_status="0" interval="0"
>> op_digest="f68d5496e9feba4ce357b17b8e94f0b7"/>
>> crmd[15040]: 2007/08/14_17:14:47 info: do_state_transition: State
>> transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS
>> cause=C_IPC_MESSAGE origin=route_message ]
>> pengine[15049]: 2007/08/14_17:14:47 WARN: process_pe_message: Transition
>> 2: WARNINGs found during PE processing. PEngine Input stored in:
>> /var/lib/heartbeat/pengine/pe-warn-145.bz2
>> cibmon[15042]: 2007/08/14_17:14:47 info: log_data_element: cib_update:
>> + </lrm_resource>
>> tengine[15048]: 2007/08/14_17:14:48 info: unpack_graph: Unpacked
>> transition 2: 0 actions in 0 synapses
>> pengine[15049]: 2007/08/14_17:14:48 info: process_pe_message:
>> Configuration WARNINGs found during PE processing. Please run "crm_verify
>> -L" to identify issues.
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_update:
>> + </lrm_resources>
>> tengine[15048]: 2007/08/14_17:14:48 info: run_graph: Transition 2:
>> (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0)
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_update:
>> + </lrm>
>> tengine[15048]: 2007/08/14_17:14:48 info: notify_crmd: Transition 2
>> status: te_complete - <null>
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_update:
>> + </node_state>
>> crmd[15040]: 2007/08/14_17:14:48 info: do_state_transition: State
>> transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS
>> cause=C_IPC_MESSAGE origin=route_message ]
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_update: +
>> </status>
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_update: +
>> </cib>
>> cibmon[15042]: 2007/08/14_17:14:48 info: cibmon_diff: [cib_diff_notify]
>> cib_modify confirmed
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_cib_diff: cib_modify: Diff:
>> --- 0.11.11
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_cib_diff: cib_modify: Diff:
>> +++ 0.11.12
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_modify: -
>> <cib num_updates="11"/>
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_modify: +
>> <cib num_updates="12">
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_modify: +
>> <status>
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_modify:
>> + <node_state id="1291474c-994d-4998-9366-58edf073190c">
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_modify:
>> + <transient_attributes id="1291474c-994d-4998-9366-58edf073190c">
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_modify:
>> + <instance_attributes
>> id="status-1291474c-994d-4998-9366-58edf073190c">
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_modify:
>> + <attributes>
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_modify:
>> + <nvpair
>> id="status-1291474c-994d-4998-9366-58edf073190c-probe_complete"
>> name="probe_complete" value="true"/>
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_modify:
>> + </attributes>
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_modify:
>> + </instance_attributes>
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_modify:
>> + </transient_attributes>
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_modify:
>> + </node_state>
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_modify: +
>> </status>
>> cibmon[15042]: 2007/08/14_17:14:48 info: log_data_element: cib_modify: +
>> </cib>
>>
>> _______________________________________________
>> Linux-HA mailing list
>> Linux-HA at lists.linux-ha.org
>> http://lists.linux-ha.org/mailman/listinfo/linux-ha
>> See also: http://linux-ha.org/ReportingProblems
>>
>>
>>
>
>
>
--
==============================================
Francesco Ciocchetti (francesco.ciocchetti at kyneste.com)
Network & Security
Kyneste - Piattaforme ICT
"Società appartenente al Gruppo Bancario Capitalia e
sottoposta all’attività di direzione e coordinamento di Capitalia S.p.A."
Via Mario Bianchini 68, 00142 Roma
T.[+39] 06.98402.1 F. [+39] 06.98402.300
http://www.kyneste.com/
==============================================
Questo messaggio può contenere informazioni di carattere riservato e confidenziale. Qualora non foste i destinatari, vogliate immediatamente informarci con lo stesso mezzo ed eliminare il messaggio, con gli eventuali allegati, senza trattenerne copia. Qualsivoglia utilizzo non autorizzato del contenuto di questo messaggio costituisce violazione dell'obbligo di non prendere cognizione della corrispondenza tra altri soggetti.
More information about the Linux-HA
mailing list