[Linux-HA] DC

Zachár Balázs zachar at direkt-kfki.hu
Mon Nov 13 07:22:46 MST 2006


I think the reason:
The order:

1. Start pingd clones on both nodes
2. start resource on A node (because the constraints)
3. the B-node's pingd value become 110
4. the resource on A node get an stop operation
5. the A-node's pingd value become 110
6. the resource on A node get a cancell avery another operation and get 
a start operation


I attached the DC log and the pengine warning message.

In the log I see pengine warnings and I watch the pengine logs... This 
is that state when the B node's pingd has value and the A node hasn't 
pingd attr. yet.


Regards,
Balázs

Andrew Beekhof írta:
> On 11/13/06, Zachár Balázs <zachar at direkt-kfki.hu> wrote:
>> In my case, maybe there is a reason to change the DC:
>>
>> In my cluster (active/passive 2 node) the B node is the default DC.
>> If I don't use rsc_location constraints the resources will start on the
>> B node (I think, It is because the B is the DC).
>
> nope - a node being or not being the DC has no effect on where 
> resources go.
>
>> So I use constraints to
>> start they on the A node.
>>
>> If I use clone pingd. There is a strange thing when I starting the
>> heartbeat:
>> The resources are starting in the A node, but there is a state when the
>> B node's pingd value positive (in my case 110) and the A node's value is
>> zero
>
> do you know why this is?
>
>> and then the cluster failover. After the A node's pingd value
>> become positive (110) the resources migrating back.
>> All of this action were during the start method.
>>
>> Now I use the ha.cf respawn directive to using pingd.
>>
>> It is normally?
>>
>> Thanks,
>> Balázs
>>
>>
>>
>> Andrew Beekhof írta:
>> > On 11/11/06, Zachár Balázs <zachar at direkt-kfki.hu> wrote:
>> >> Is there any significance which node is the DC?
>> >
>> > only internally.
>> >
>> >> Can I affect this?
>> >
>> > not really, but then again there's no real reason to need to
>> > _______________________________________________
>> > Linux-HA mailing list
>> > Linux-HA at lists.linux-ha.org
>> > http://lists.linux-ha.org/mailman/listinfo/linux-ha
>> > See also: http://linux-ha.org/ReportingProblems
>> >
>> >
>> >
>>
>>
>> _______________________________________________
>> Linux-HA mailing list
>> Linux-HA at lists.linux-ha.org
>> http://lists.linux-ha.org/mailman/listinfo/linux-ha
>> See also: http://linux-ha.org/ReportingProblems
>>
> _______________________________________________
> Linux-HA mailing list
> Linux-HA at lists.linux-ha.org
> http://lists.linux-ha.org/mailman/listinfo/linux-ha
> See also: http://linux-ha.org/ReportingProblems
>
>
>

-------------- next part --------------
Nov 13 14:43:16 cl-test-b logd: [23693]: info: logd started with default configuration.
Nov 13 14:43:16 cl-test-b logd: [23693]: WARN: Core dumps could be lost if multiple dumps occur
Nov 13 14:43:16 cl-test-b logd: [23693]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
Nov 13 14:43:16 cl-test-b logd: [23693]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Nov 13 14:43:16 cl-test-b logd: [23694]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Nov 13 14:43:16 cl-test-b heartbeat: [23714]: info: Enabling logging daemon
Nov 13 14:43:16 cl-test-b heartbeat: [23714]: info: logfile and debug file are those specified in logd config file (default /etc/logd.cf)
Nov 13 14:43:16 cl-test-b heartbeat: [23714]: WARN: Core dumps could be lost if multiple dumps occur
Nov 13 14:43:16 cl-test-b heartbeat: [23714]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
Nov 13 14:43:16 cl-test-b heartbeat: [23714]: info: **************************
Nov 13 14:43:16 cl-test-b heartbeat: [23714]: info: Configuration validated. Starting heartbeat 2.0.7
Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: heartbeat: version 2.0.7
Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: Heartbeat generation: 36
Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: G_main_add_TriggerHandler: Added signal manual handler
Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: G_main_add_TriggerHandler: Added signal manual handler
Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: Removing /var/run/heartbeat/rsctmp failed, recreating.
Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth1
Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: glib: UDP Broadcast heartbeat closed on port 694 interface eth1 - Status: 1
Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: glib: ping heartbeat started.
Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: Local status now set to: 'up'
Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Link cl-test-a:eth1 up.
Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Link 10.128.43.1:10.128.43.1 up.
Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Status update for node 10.128.43.1: status ping
Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Status update for node cl-test-a: status up
Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Link cl-test-b:eth1 up.
Nov 13 14:43:17 cl-test-b heartbeat: [23715]: debug: get_delnodelist: delnodelist=
Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Comm_now_up(): updating status to active
Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Local status now set to: 'active'
Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Starting child client "/usr/lib64/heartbeat/ccm" (1001,100)
Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Starting child client "/usr/lib64/heartbeat/cib" (1001,100)
Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Starting child client "/usr/lib64/heartbeat/lrmd" (0,0)
Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Starting child client "/usr/lib64/heartbeat/stonithd" (0,0)
Nov 13 14:43:17 cl-test-b heartbeat: [23725]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 1001  gid 100 (pid 23725)
Nov 13 14:43:17 cl-test-b heartbeat: [23726]: info: Starting "/usr/lib64/heartbeat/cib" as uid 1001  gid 100 (pid 23726)
Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Starting child client "/usr/lib64/heartbeat/attrd" (1001,100)
Nov 13 14:43:17 cl-test-b heartbeat: [23727]: info: Starting "/usr/lib64/heartbeat/lrmd" as uid 0  gid 0 (pid 23727)
Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Starting child client "/usr/lib64/heartbeat/crmd" (1001,100)
Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Starting child client "/usr/lib64/heartbeat/mgmtd -v" (0,0)
Nov 13 14:43:17 cl-test-b heartbeat: [23728]: info: Starting "/usr/lib64/heartbeat/stonithd" as uid 0  gid 0 (pid 23728)
Nov 13 14:43:17 cl-test-b heartbeat: [23729]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 1001  gid 100 (pid 23729)
Nov 13 14:43:17 cl-test-b heartbeat: [23731]: info: Starting "/usr/lib64/heartbeat/mgmtd -v" as uid 0  gid 0 (pid 23731)
Nov 13 14:43:17 cl-test-b heartbeat: [23730]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 1001  gid 100 (pid 23730)
Nov 13 14:43:17 cl-test-b cib: [23726]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Nov 13 14:43:17 cl-test-b cib: [23726]: info: G_main_add_TriggerHandler: Added signal manual handler
Nov 13 14:43:17 cl-test-b cib: [23726]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Nov 13 14:43:17 cl-test-b cib: [23726]: info: main:main.c Retrieval of a per-action CIB: disabled
Nov 13 14:43:17 cl-test-b lrmd: [23727]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Nov 13 14:43:17 cl-test-b cib: [23726]: info: cib_register_ha:main.c Signing in with Heartbeat
Nov 13 14:43:17 cl-test-b ccm: [23725]: info: Hostname: cl-test-b
Nov 13 14:43:17 cl-test-b cib: [23726]: info: cib_register_ha:main.c FSA Hostname: cl-test-b
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile:io.c Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml
Nov 13 14:43:17 cl-test-b stonithd: [23728]: WARN: Core dumps could be lost if multiple dumps occur
Nov 13 14:43:17 cl-test-b stonithd: [23728]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
Nov 13 14:43:17 cl-test-b stonithd: [23728]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Nov 13 14:43:17 cl-test-b stonithd: [23728]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Nov 13 14:43:17 cl-test-b lrmd: [23727]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Nov 13 14:43:17 cl-test-b attrd: [23729]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Nov 13 14:43:17 cl-test-b ccm: [23725]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Nov 13 14:43:17 cl-test-b attrd: [23729]: info: register_with_ha:attrd.c Hostname: cl-test-b
Nov 13 14:43:17 cl-test-b lrmd: [23727]: WARN: Core dumps could be lost if multiple dumps occur
Nov 13 14:43:17 cl-test-b lrmd: [23727]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
Nov 13 14:43:17 cl-test-b lrmd: [23727]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Nov 13 14:43:17 cl-test-b lrmd: [23727]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Nov 13 14:43:17 cl-test-b lrmd: [23727]: info: Started.
Nov 13 14:43:17 cl-test-b stonithd: [23728]: info: Signing in with heartbeat.
Nov 13 14:43:17 cl-test-b mgmtd: [23731]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Nov 13 14:43:17 cl-test-b mgmtd: [23731]: debug: Enabling coredumps
Nov 13 14:43:17 cl-test-b mgmtd: [23731]: WARN: Core dumps could be lost if multiple dumps occur
Nov 13 14:43:17 cl-test-b mgmtd: [23731]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
Nov 13 14:43:17 cl-test-b mgmtd: [23731]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Nov 13 14:43:17 cl-test-b mgmtd: [23731]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Nov 13 14:43:17 cl-test-b stonithd: [23728]: notice: /usr/lib64/heartbeat/stonithd start up successfully.
Nov 13 14:43:17 cl-test-b stonithd: [23728]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Nov 13 14:43:17 cl-test-b attrd: [23729]: info: register_with_ha:attrd.c UUID: 4f1f4cbc-5fe9-4828-bca2-6d92a5254b08
Nov 13 14:43:17 cl-test-b attrd: [23729]: WARN: cib_native_signon:cib_native.c Connection to CIB failed: connection failed
Nov 13 14:43:17 cl-test-b mgmtd: [23731]: info: init_crm
Nov 13 14:43:17 cl-test-b mgmtd: [23731]: info: login to cib: 0, ret:-10
Nov 13 14:43:17 cl-test-b crmd: [23730]: WARN: Core dumps could be lost if multiple dumps occur
Nov 13 14:43:17 cl-test-b crmd: [23730]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
Nov 13 14:43:17 cl-test-b crmd: [23730]: info: init_start:main.c Starting crmd
Nov 13 14:43:17 cl-test-b crmd: [23730]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Nov 13 14:43:17 cl-test-b crmd: [23730]: info: G_main_add_TriggerHandler: Added signal manual handler
Nov 13 14:43:17 cl-test-b crmd: [23730]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Nov 13 14:43:17 cl-test-b crmd: [23730]: WARN: cib_native_signon:cib_native.c Connection to CIB failed: connection failed
Nov 13 14:43:17 cl-test-b cib: [23726]: WARN: validate_cib_digest:io.c No on-disk digest present
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <cib admin_epoch="0" epoch="0" num_updates="0" have_quorum="false">
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]   <configuration>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]     <crm_config>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]       <cluster_property_set id="cib-bootstrap-options">
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]         <attributes>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-symmetric_cluster" name="symmetric_cluster" value="true"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-no_quorum_policy" name="no_quorum_policy" value="stop"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-default_resource_stickiness" name="default_resource_stickiness" value="40"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-default_resource_failure_stickiness" name="default_resource_failure_stickiness" value="0"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-stonith_enabled" name="stonith_enabled" value="false"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-stonith_action" name="stonith_action" value="reboot"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-stop_orphan_resources" name="stop_orphan_resources" value="true"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-stop_orphan_actions" name="stop_orphan_actions" value="true"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-remove_after_stop" name="remove_after_stop" value="false"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-short_resource_names" name="short_resource_names" value="true"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-transition_idle_timeout" name="transition_idle_timeout"value="5min"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-default_action_timeout" name="default_action_timeout" value="10s"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-is_managed_default" name="is_managed_default" value="true"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]         </attributes>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]       </cluster_property_set>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]     </crm_config>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]     <nodes/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]     <resources>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]       <clone id="pingd">
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]         <instance_attributes id="pingd_instance_attrs">
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <attributes>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]             <nvpair id="pingd-clone_max" name="clone_max" value="2"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]             <nvpair id="pingd-clone_node_max" name="clone_node_max" value="1"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           </attributes>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]         </instance_attributes>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]         <primitive class="ocf" type="pingd" provider="heartbeat" id="pingd-child">
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <instance_attributes id="pingd-child_instance_attrs">
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]             <attributes>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]               <nvpair id="pingd-dampen" name="dampen" value="5s"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]               <nvpair id="pingd-multiplier" name="multiplier" value="110"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]               <nvpair id="pingd-pidfile" name="pidfile" value="/var/run/pingd.pid"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]               <nvpair id="pingd-user" name="user" value="root"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]             </attributes>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           </instance_attributes>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <operations>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]             <op name="monitor" id="pingd-monitor" interval="20s" timeout="40s"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]             <op id="pingd-start" name="start" prereq="nothing"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           </operations>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]         </primitive>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]       </clone>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]       <group id="group_1">
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]         <primitive class="ocf" id="IPaddr_10_128_43_133" provider="heartbeat" type="IPaddr">
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <operations>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]             <op id="IPaddr_10_128_43_133_mon" interval="5s" name="monitor" timeout="5s"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           </operations>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <instance_attributes id="IPaddr_10_128_43_133_inst_attr">
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]             <attributes>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]               <nvpair id="IPaddr_10_128_43_133_attr_0" name="ip" value="10.128.43.133"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]             </attributes>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           </instance_attributes>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]         </primitive>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]       </group>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]     </resources>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]     <constraints>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]       <rsc_location id="rsc_location_group_1" rsc="group_1">
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]         <rule id="cl-test-a_location_group_1" score="100">
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <expression attribute="#uname" id="cl-test-a_location_group_1_expr" operation="eq" value="cl-test-a"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]         </rule>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]         <rule id="cl-test-b_location_group_1" score="99">
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <expression attribute="#uname" id="cl-test-b_location_group_1_expr" operation="eq" value="cl-test-b"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]         </rule>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]         <rule id="my_resource:connected:rule" score_attribute="pingd" boolean_op="and">
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <expression id="my_resource:connected:expr:defined" attribute="pingd" operation="defined"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]           <expression id="my_resource:connected:expr:positive" attribute="pingd" operation="gt" value="100"/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]         </rule>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]       </rsc_location>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]     </constraints>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]   </configuration>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk]   <status/>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </cib>
Nov 13 14:43:17 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 101700 bytes (was 0)
Nov 13 14:43:17 cl-test-b cib: [23726]: info: startCib:main.c CIB Initialization completed successfully
Nov 13 14:43:17 cl-test-b cib: [23726]: info: init_start:main.c Starting cib mainloop
Nov 13 14:43:17 cl-test-b cib: [23733]: WARN: validate_cib_digest:io.c No on-disk digest present
Nov 13 14:43:17 cl-test-b cib: [23733]: info: write_cib_contents:io.c Wrote version 0.0.0 of the CIB to disk (digest: 3034143137cb3433f672f51554097553)
Nov 13 14:43:18 cl-test-b heartbeat: [23715]: info: Status update for node cl-test-a: status active
Nov 13 14:43:18 cl-test-b cib: [23726]: info: cib_client_status_callback:callbacks.c Status update: Client cl-test-b/cib now has status [join]
Nov 13 14:43:18 cl-test-b cib: [23726]: info: cib_client_status_callback:callbacks.c Status update: Client cl-test-a/cib now has status [join]
Nov 13 14:43:18 cl-test-b cib: [23726]: info: cib_client_status_callback:callbacks.c Status update: Client cl-test-b/cib now has status [online]
Nov 13 14:43:18 cl-test-b cib: [23726]: info: cib_null_callback:callbacks.c Setting cib_diff_notify callbacks for mgmtd: on
Nov 13 14:43:18 cl-test-b crmd: [23730]: info: do_cib_control:cib.c CIB connection established
Nov 13 14:43:18 cl-test-b cib: [23726]: info: cib_client_status_callback:callbacks.c Status update: Client cl-test-a/cib now has status [online]
Nov 13 14:43:18 cl-test-b crmd: [23730]: info: register_with_ha:control.c Hostname: cl-test-b
Nov 13 14:43:18 cl-test-b cib: [23726]: info: cib_null_callback:callbacks.c Setting cib_refresh_notify callbacks for crmd: on
Nov 13 14:43:18 cl-test-b crmd: [23730]: info: register_with_ha:control.c UUID: 4f1f4cbc-5fe9-4828-bca2-6d92a5254b08
Nov 13 14:43:19 cl-test-b mgmtd: [23731]: debug: main: run the loop...
Nov 13 14:43:19 cl-test-b mgmtd: [23731]: info: Started.
Nov 13 14:43:19 cl-test-b ccm: [23725]: debug: quorum plugin: majority
Nov 13 14:43:19 cl-test-b cib: [23726]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Nov 13 14:43:19 cl-test-b ccm: [23725]: debug: cluster:linux-ha, member_count=1, member_quorum_votes=100
Nov 13 14:43:19 cl-test-b cib: [23726]: info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3
Nov 13 14:43:19 cl-test-b ccm: [23725]: debug: total_node_count=2, total_quorum_votes=200
Nov 13 14:43:19 cl-test-b cib: [23726]: info: cib_ccm_msg_callback:callbacks.c PEER: cl-test-b
Nov 13 14:43:19 cl-test-b ccm: [23725]: debug: quorum plugin: twonodes
Nov 13 14:43:19 cl-test-b ccm: [23725]: debug: cluster:linux-ha, member_count=1, member_quorum_votes=100
Nov 13 14:43:19 cl-test-b ccm: [23725]: debug: total_node_count=2, total_quorum_votes=200
Nov 13 14:43:19 cl-test-b ccm: [23725]: info: Break tie for 2 nodes cluster
Nov 13 14:43:19 cl-test-b crmd: [23730]: info: populate_cib_nodes:control.c Requesting the list of configured nodes
Nov 13 14:43:19 cl-test-b heartbeat: [23715]: WARN: 1 lost packet(s) for [cl-test-a] [14:16]
Nov 13 14:43:19 cl-test-b heartbeat: [23715]: info: No pkts missing from cl-test-a!
Nov 13 14:43:20 cl-test-b ccm: [23725]: debug: quorum plugin: majority
Nov 13 14:43:20 cl-test-b ccm: [23725]: debug: cluster:linux-ha, member_count=2, member_quorum_votes=200
Nov 13 14:43:20 cl-test-b ccm: [23725]: debug: total_node_count=2, total_quorum_votes=200
Nov 13 14:43:20 cl-test-b cib: [23726]: info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm
Nov 13 14:43:20 cl-test-b cib: [23726]: info: mem_handle_event: no mbr_track info
Nov 13 14:43:20 cl-test-b cib: [23726]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Nov 13 14:43:20 cl-test-b cib: [23726]: info: mem_handle_event: instance=2, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4
Nov 13 14:43:20 cl-test-b cib: [23726]: info: cib_ccm_msg_callback:callbacks.c PEER: cl-test-b
Nov 13 14:43:20 cl-test-b cib: [23726]: info: cib_ccm_msg_callback:callbacks.c PEER: cl-test-a
Nov 13 14:43:20 cl-test-b heartbeat: [23715]: WARN: 1 lost packet(s) for [cl-test-a] [20:22]
Nov 13 14:43:20 cl-test-b heartbeat: [23715]: info: No pkts missing from cl-test-a!
Nov 13 14:43:20 cl-test-b crmd: [23730]: notice: populate_cib_nodes:control.c Node: cl-test-b (uuid: 4f1f4cbc-5fe9-4828-bca2-6d92a5254b08)
Nov 13 14:43:21 cl-test-b crmd: [23730]: notice: populate_cib_nodes:control.c Node: cl-test-a (uuid: 8f29b378-e694-4c8f-b4ad-9385db258ab7)
Nov 13 14:43:21 cl-test-b crmd: [23730]: info: do_ha_control:control.c Connected to Heartbeat
Nov 13 14:43:21 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 106092 bytes (was 101940)
Nov 13 14:43:21 cl-test-b crmd: [23730]: info: do_ccm_control:ccm.c CCM connection established... waiting for first callback
Nov 13 14:43:21 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Local-only Change (client:23730, call: 3): 0.0.0 (ok)
Nov 13 14:43:21 cl-test-b crmd: [23730]: info: do_started:control.c Delaying start, CCM (0000000000100000) not connected
Nov 13 14:43:21 cl-test-b crmd: [23730]: info: init_start:main.c Starting crmd's mainloop
Nov 13 14:43:21 cl-test-b crmd: [23730]: notice: crmd_client_status_callback:callbacks.c Status update: Client cl-test-b/crmd now has status [online]
Nov 13 14:43:21 cl-test-b crmd: [23730]: info: crmd_client_status_callback:callbacks.c Uncaching UUID for cl-test-b
Nov 13 14:43:21 cl-test-b cib: [23734]: info: write_cib_contents:io.c Wrote version 0.0.0 of the CIB to disk (digest: 9f094e00ce559fcf23f1025c1f4238b6)
Nov 13 14:43:22 cl-test-b crmd: [23730]: notice: crmd_client_status_callback:callbacks.c Status update: Client cl-test-a/crmd now has status [online]
Nov 13 14:43:22 cl-test-b crmd: [23730]: info: crmd_client_status_callback:callbacks.c Uncaching UUID for cl-test-a
Nov 13 14:43:22 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 108408 bytes (was 106092)
Nov 13 14:43:22 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Local-only Change (client:23730, call: 5): 0.0.0 (ok)
Nov 13 14:43:22 cl-test-b cib: [23735]: info: write_cib_contents:io.c Wrote version 0.0.0 of the CIB to disk (digest: 481fa21844415e2fcb557c361f499a46)
Nov 13 14:43:22 cl-test-b crmd: [23730]: notice: crmd_client_status_callback:callbacks.c Status update: Client cl-test-b/crmd now has status [online]
Nov 13 14:43:22 cl-test-b crmd: [23730]: info: crmd_client_status_callback:callbacks.c Uncaching UUID for cl-test-b
Nov 13 14:43:22 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 110724 bytes (was 108408)
Nov 13 14:43:22 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Local-only Change (client:23730, call: 6): 0.0.0 (ok)
Nov 13 14:43:22 cl-test-b cib: [23736]: info: write_cib_contents:io.c Wrote version 0.0.0 of the CIB to disk (digest: 481fa21844415e2fcb557c361f499a46)
Nov 13 14:43:23 cl-test-b crmd: [23730]: notice: crmd_client_status_callback:callbacks.c Status update: Client cl-test-a/crmd now has status [online]
Nov 13 14:43:23 cl-test-b crmd: [23730]: info: crmd_client_status_callback:callbacks.c Uncaching UUID for cl-test-a
Nov 13 14:43:23 cl-test-b cib: [23737]: info: write_cib_contents:io.c Wrote version 0.0.0 of the CIB to disk (digest: cd15aa1c40d215c9bda7ea3c127273c1)
Nov 13 14:43:23 cl-test-b crmd: [23730]: info: do_started:control.c Delaying start, CCM (0000000000100000) not connected
Nov 13 14:43:23 cl-test-b crmd: [23730]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Nov 13 14:43:23 cl-test-b crmd: [23730]: info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Nov 13 14:43:23 cl-test-b crmd: [23730]: info: crmd_ccm_msg_callback:callbacks.c Quorum (re)attained after event=NEW MEMBERSHIP (id=2)
Nov 13 14:43:23 cl-test-b crmd: [23730]: info: ccm_event_detail:ccm.c NEW MEMBERSHIP: trans=2, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4
Nov 13 14:43:23 cl-test-b crmd: [23730]: info: ccm_event_detail:ccm.c   CURRENT: cl-test-b [nodeid=1, born=1]
Nov 13 14:43:23 cl-test-b crmd: [23730]: info: ccm_event_detail:ccm.c   CURRENT: cl-test-a [nodeid=0, born=2]
Nov 13 14:43:23 cl-test-b crmd: [23730]: info: ccm_event_detail:ccm.c   NEW:     cl-test-b [nodeid=1, born=1]
Nov 13 14:43:23 cl-test-b crmd: [23730]: info: ccm_event_detail:ccm.c   NEW:     cl-test-a [nodeid=0, born=2]
Nov 13 14:43:23 cl-test-b crmd: [23730]: info: do_started:control.c The local CRM is operational
Nov 13 14:43:23 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ]
Nov 13 14:43:23 cl-test-b crmd: [23730]: info: update_dc:utils.c Set DC to <null> (<null>)
Nov 13 14:43:23 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 110964 bytes (was 110724)
Nov 13 14:43:23 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Local-only Change (client:23730, call: 9): 0.0.0 (ok)
Nov 13 14:43:23 cl-test-b cib: [23738]: info: write_cib_contents:io.c Wrote version 0.0.0 of the CIB to disk (digest: cd15aa1c40d215c9bda7ea3c127273c1)
Nov 13 14:43:27 cl-test-b attrd: [23729]: info: main:attrd.c Starting mainloop...
Nov 13 14:43:39 cl-test-b crmd: [23730]: info: crm_timer_popped:utils.c Election Trigger (I_DC_TIMEOUT) just popped!
Nov 13 14:43:39 cl-test-b crmd: [23730]: WARN: do_log:misc.c [[FSA]] Input I_DC_TIMEOUT from crm_timer_popped() received in state (S_PENDING)
Nov 13 14:43:39 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ]
Nov 13 14:43:39 cl-test-b crmd: [23730]: info: update_dc:utils.c Set DC to <null> (<null>)
Nov 13 14:43:39 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Election check: vote from cl-test-a
Nov 13 14:43:39 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Election won over cl-test-a
Nov 13 14:43:39 cl-test-b crmd: [23730]: info: do_election_check:election.c Still waiting on 2 non-votes (2 total)
Nov 13 14:43:39 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Updated voted hash for cl-test-b to vote
Nov 13 14:43:39 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Election ignore: our vote (cl-test-b)
Nov 13 14:43:39 cl-test-b crmd: [23730]: info: do_election_check:election.c Still waiting on 1 non-votes (2 total)
Nov 13 14:43:40 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Updated voted hash for cl-test-a to no-vote
Nov 13 14:43:40 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Election ignore: no-vote from cl-test-a
Nov 13 14:43:40 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNALorigin=do_election_check ]
Nov 13 14:43:40 cl-test-b crmd: [23730]: info: start_subsystem:subsystems.c Starting sub-system "tengine"
Nov 13 14:43:40 cl-test-b cib: [23726]: info: cib_null_callback:callbacks.c Setting cib_diff_notify callbacks for tengine: on
Nov 13 14:43:40 cl-test-b crmd: [23730]: info: start_subsystem:subsystems.c Starting sub-system "pengine"
Nov 13 14:43:40 cl-test-b tengine: [23739]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Nov 13 14:43:40 cl-test-b cib: [23726]: info: cib_process_readwrite:messages.c We are now in R/W mode
Nov 13 14:43:40 cl-test-b crmd: [23730]: info: do_dc_takeover:election.c Taking over DC status for this partition
Nov 13 14:43:40 cl-test-b tengine: [23739]: info: G_main_add_TriggerHandler: Added signal manual handler
Nov 13 14:43:40 cl-test-b cib: [23726]: info: revision_check:messages.c Updating CIB revision to 1.3
Nov 13 14:43:40 cl-test-b crmd: [23730]: info: update_dc:utils.c Set DC to <null> (<null>)
Nov 13 14:43:40 cl-test-b tengine: [23739]: info: init_start:main.c Registering TE UUID: d29d0e3f-f12c-4f75-9754-5a7278db944c
Nov 13 14:43:40 cl-test-b crmd: [23730]: info: do_dc_join_offer_all:join_dc.c join-1: Waiting on 2 outstanding join acks
Nov 13 14:43:40 cl-test-b tengine: [23739]: info: set_graph_functions:utils.c Setting custom graph functions
Nov 13 14:43:40 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Updated voted hash for cl-test-b to vote
Nov 13 14:43:40 cl-test-b tengine: [23739]: info: unpack_graph:unpack.c Unpacked transition -1: 0 actions in 0 synapses
Nov 13 14:43:40 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Election ignore: our vote (cl-test-b)
Nov 13 14:43:40 cl-test-b tengine: [23739]: info: init_start:main.c Starting tengine
Nov 13 14:43:40 cl-test-b pengine: [23740]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Nov 13 14:43:40 cl-test-b pengine: [23740]: info: init_start:main.c Starting pengine
Nov 13 14:43:40 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:13): 0.0.0 -> 0.0.1 (ok)
Nov 13 14:43:40 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.0.0 -> 0.0.1
Nov 13 14:43:40 cl-test-b cib: [23741]: info: write_cib_contents:io.c Wrote version 0.0.1 of the CIB to disk (digest: 6eb7c6fe575ada1f364741f1f7c637f6)
Nov 13 14:43:40 cl-test-b crmd: [23730]: info: update_dc:utils.c Set DC to cl-test-b (1.0.6)
Nov 13 14:43:41 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Updated voted hash for cl-test-a to no-vote
Nov 13 14:43:41 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Election ignore: no-vote from cl-test-a
Nov 13 14:43:41 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Nov 13 14:43:41 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c All 2 cluster nodes responded to the join offer.
Nov 13 14:43:41 cl-test-b crmd: [23730]: info: update_attrd:join_dc.c Connecting to attrd...
Nov 13 14:43:41 cl-test-b cib: [23726]: info: sync_our_cib:messages.c Syncing CIB to all peers
Nov 13 14:43:41 cl-test-b attrd: [23729]: info: attrd_local_callback:attrd.c Sending full refresh
Nov 13 14:43:41 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 111236 bytes (was 111084)
Nov 13 14:43:41 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:16): 0.0.1 -> 0.0.2 (ok)
Nov 13 14:43:41 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.0.1 -> 0.0.2
Nov 13 14:43:41 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:17): 0.0.2 -> 0.1.3 (ok)
Nov 13 14:43:41 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_bump): 0.0.2 -> 0.1.3
Nov 13 14:43:41 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:18): 0.1.3 -> 0.1.4 (ok)
Nov 13 14:43:41 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.3 -> 0.1.4
Nov 13 14:43:41 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:19): 0.1.4 -> 0.1.5 (ok)
Nov 13 14:43:41 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.4 -> 0.1.5
Nov 13 14:43:41 cl-test-b cib: [23742]: info: write_cib_contents:io.c Wrote version 0.1.5 of the CIB to disk (digest: f467f69b413c810d964e608c6aa6a952)
Nov 13 14:43:42 cl-test-b crmd: [23730]: info: update_dc:utils.c Set DC to cl-test-b (1.0.6)
Nov 13 14:43:42 cl-test-b crmd: [23730]: info: do_dc_join_ack:join_dc.c join-1: Updating node state to member for cl-test-b)
Nov 13 14:43:42 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 115116 bytes (was 111236)
Nov 13 14:43:42 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:20): 0.1.5 -> 0.1.6 (ok)
Nov 13 14:43:42 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.5 -> 0.1.6
Nov 13 14:43:42 cl-test-b cib: [23743]: info: write_cib_contents:io.c Wrote version 0.1.6 of the CIB to disk (digest: 25e1a0890d62f532fca492f3ef101493)
Nov 13 14:43:43 cl-test-b crmd: [23730]: info: do_dc_join_ack:join_dc.c join-1: Updating node state to member for cl-test-a)
Nov 13 14:43:43 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 118996 bytes (was 115116)
Nov 13 14:43:43 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:21): 0.1.6 -> 0.1.7 (ok)
Nov 13 14:43:43 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
Nov 13 14:43:43 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c All 2 cluster nodes are eligable to run resources.
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort priority upgraded to 1000000
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.6 -> 0.1.7
Nov 13 14:43:43 cl-test-b cib: [23744]: info: write_cib_contents:io.c Wrote version 0.1.7 of the CIB to disk (digest: bd2d96fb20e3d048ab8cc537089ae71a)
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: process_pe_message: [generation] <cib admin_epoch="0" epoch="1" num_updates="7" have_quorum="true" generated="true" num_peers="2" ccm_transition="2" cib_feature_revision="1.3" dc_uuid="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08"/>
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default stickiness: 40
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default failure stickiness: 0
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH of failed nodes is disabled
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH will reboot nodes
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Cluster is symmetric - resources can run anywhere by default
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c On loss of CCM Quorum: Stop ALL resources
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resources are stopped
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resource actions are stopped
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Stopped resources are removed from the status section: false
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c By default resources are managed
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-b is online
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-a is online
Nov 13 14:43:43 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-b did not have a value for pingd
Nov 13 14:43:43 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
Nov 13 14:43:43 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-b did not have a value for pingd
Nov 13 14:43:43 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: Clone Set: pingd
Nov 13 14:43:43 cl-test-b pengine: [23740]: info:     pingd-child:0     (heartbeat::ocf:pingd): Stopped
Nov 13 14:43:43 cl-test-b pengine: [23740]: info:     pingd-child:1     (heartbeat::ocf:pingd): Stopped
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: Resource Group: group_1
Nov 13 14:43:43 cl-test-b pengine: [23740]: info:     IPaddr_10_128_43_133      (heartbeat::ocf:IPaddr):        Stopped
Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: native_create_probe:native.c cl-test-b: Created probe for pingd-child:0
Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: native_create_probe:native.c cl-test-b: Created probe for pingd-child:1
Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: native_create_probe:native.c cl-test-b: Created probe for IPaddr_10_128_43_133
Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: native_create_probe:native.c cl-test-a: Created probe for pingd-child:0
Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: native_create_probe:native.c cl-test-a: Created probe for pingd-child:1
Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: native_create_probe:native.c cl-test-a: Created probe for IPaddr_10_128_43_133
Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: StartRsc:native.c  cl-test-b        Start pingd-child:0
Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-b           pingd-child:0_monitor_20000
Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: StartRsc:native.c  cl-test-a        Start pingd-child:1
Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-a           pingd-child:1_monitor_20000
Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: StartRsc:native.c  cl-test-a        Start IPaddr_10_128_43_133
Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-a           IPaddr_10_128_43_133_monitor_5000
Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: stage8:allocate.c Created transition graph 0.
Nov 13 14:43:43 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c No value specified for cluster preference: pe-warn-series-max
Nov 13 14:43:43 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c Transition 0: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-61.bz2
Nov 13 14:43:43 cl-test-b pengine: [23740]: info: process_pe_message:pengine.c Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Nov 13 14:43:43 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: unpack_graph:unpack.c Unpacked transition 0: 19 actions in 19 synapses
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 3: pingd-child:0_monitor_0 on cl-test-b
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 7: pingd-child:0_monitor_0 on cl-test-a
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 4: pingd-child:1_monitor_0 on cl-test-b
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 8: pingd-child:1_monitor_0 on cl-test-a
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 5: IPaddr_10_128_43_133_monitor_0 on cl-test-b
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 9: IPaddr_10_128_43_133_monitor_0 on cl-test-a
Nov 13 14:43:43 cl-test-b crmd: [23730]: info: do_lrm_rsc_op:lrm.c Performing op monitor on pingd-child:0 (interval=0ms, key=0:d29d0e3f-f12c-4f75-9754-5a7278db944c)
Nov 13 14:43:43 cl-test-b crmd: [23730]: info: do_lrm_rsc_op:lrm.c Performing op monitor on pingd-child:1 (interval=0ms, key=0:d29d0e3f-f12c-4f75-9754-5a7278db944c)
Nov 13 14:43:43 cl-test-b crmd: [23730]: info: do_lrm_rsc_op:lrm.c Performing op monitor on IPaddr_10_128_43_133 (interval=0ms, key=0:d29d0e3f-f12c-4f75-9754-5a7278db944c)
Nov 13 14:43:43 cl-test-b crmd: [23730]: info: process_lrm_event:lrm.c LRM operation (2) monitor_0 on pingd-child:0 Error: (7) not running
Nov 13 14:43:43 cl-test-b crmd: [23730]: info: process_lrm_event:lrm.c LRM operation (3) monitor_0 on pingd-child:1 Error: (7) not running
Nov 13 14:43:43 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 124260 bytes (was 118996)
Nov 13 14:43:43 cl-test-b crmd: [23730]: info: process_lrm_event:lrm.c LRM operation (4) monitor_0 on IPaddr_10_128_43_133 Error: (7) not running
Nov 13 14:43:43 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:23): 0.1.7 -> 0.1.8 (ok)
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.7 -> 0.1.8
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:0_monitor_0 (3) confirmed
Nov 13 14:43:43 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 129524 bytes (was 124260)
Nov 13 14:43:43 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:24): 0.1.8 -> 0.1.9 (ok)
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.8 -> 0.1.9
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:1_monitor_0 (4) confirmed
Nov 13 14:43:43 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 134788 bytes (was 129524)
Nov 13 14:43:43 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:25): 0.1.9 -> 0.1.10 (ok)
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.9 -> 0.1.10
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action IPaddr_10_128_43_133_monitor_0 (5) confirmed
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 2: probe_complete on cl-test-b
Nov 13 14:43:43 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 142220 bytes (was 134788)
Nov 13 14:43:43 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:26): 0.1.10 -> 0.1.11 (ok)
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.10 -> 0.1.11
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: extract_event:events.c Aborting on transient_attributes changes
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort priority upgraded to 1000000
Nov 13 14:43:43 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort action 0 superceeded by 2
Nov 13 14:43:43 cl-test-b cib: [23760]: info: write_cib_contents:io.c Wrote version 0.1.10 of the CIB to disk (digest: 1114450a090210db4e8cfb07c564a4ce)
Nov 13 14:43:43 cl-test-b cib: [23761]: info: write_cib_contents:io.c Wrote version 0.1.11 of the CIB to disk (digest: 7bd5200de58361a79400125756357bba)
Nov 13 14:43:44 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 147484 bytes (was 142220)
Nov 13 14:43:44 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:16): 0.1.11 -> 0.1.12 (ok)
Nov 13 14:43:44 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.11 -> 0.1.12
Nov 13 14:43:44 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:0_monitor_0 (7) confirmed
Nov 13 14:43:44 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 152748 bytes (was 147484)
Nov 13 14:43:44 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:17): 0.1.12 -> 0.1.13 (ok)
Nov 13 14:43:44 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.12 -> 0.1.13
Nov 13 14:43:44 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:1_monitor_0 (8) confirmed
Nov 13 14:43:45 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 158012 bytes (was 152748)
Nov 13 14:43:45 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:18): 0.1.13 -> 0.1.14 (ok)
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.13 -> 0.1.14
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action IPaddr_10_128_43_133_monitor_0 (9) confirmed
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 6: probe_complete on cl-test-a
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: run_graph:graph.c ====================================================
Nov 13 14:43:45 cl-test-b tengine: [23739]: notice: run_graph:graph.c Transition 0: (Complete=8, Pending=0, Fired=0, Skipped=10, Incomplete=1)
Nov 13 14:43:45 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ]
Nov 13 14:43:45 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c All 2 cluster nodes are eligable to run resources.
Nov 13 14:43:45 cl-test-b cib: [23762]: info: write_cib_contents:io.c Wrote version 0.1.14 of the CIB to disk (digest: f09828e03cf54dc72036331a37092a0c)
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: process_pe_message: [generation] <cib admin_epoch="0" epoch="1" num_updates="14" have_quorum="true" generated="true" num_peers="2" ccm_transition="2" cib_feature_revision="1.3" dc_uuid="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08"/>
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default stickiness: 40
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default failure stickiness: 0
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH of failed nodes is disabled
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH will reboot nodes
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Cluster is symmetric - resources can run anywhere by default
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c On loss of CCM Quorum: Stop ALL resources
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resources are stopped
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resource actions are stopped
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Stopped resources are removed from the status section: false
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c By default resources are managed
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-b is online
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-a is online
Nov 13 14:43:45 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-b did not have a value for pingd
Nov 13 14:43:45 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
Nov 13 14:43:45 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-b did not have a value for pingd
Nov 13 14:43:45 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: Clone Set: pingd
Nov 13 14:43:45 cl-test-b pengine: [23740]: info:     pingd-child:0     (heartbeat::ocf:pingd): Stopped
Nov 13 14:43:45 cl-test-b pengine: [23740]: info:     pingd-child:1     (heartbeat::ocf:pingd): Stopped
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: Resource Group: group_1
Nov 13 14:43:45 cl-test-b pengine: [23740]: info:     IPaddr_10_128_43_133      (heartbeat::ocf:IPaddr):        Stopped
Nov 13 14:43:45 cl-test-b pengine: [23740]: notice: StartRsc:native.c  cl-test-b        Start pingd-child:0
Nov 13 14:43:45 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-b           pingd-child:0_monitor_20000
Nov 13 14:43:45 cl-test-b pengine: [23740]: notice: StartRsc:native.c  cl-test-a        Start pingd-child:1
Nov 13 14:43:45 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-a           pingd-child:1_monitor_20000
Nov 13 14:43:45 cl-test-b pengine: [23740]: notice: StartRsc:native.c  cl-test-a        Start IPaddr_10_128_43_133
Nov 13 14:43:45 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-a           IPaddr_10_128_43_133_monitor_5000
Nov 13 14:43:45 cl-test-b pengine: [23740]: notice: stage8:allocate.c Created transition graph 1.
Nov 13 14:43:45 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c No value specified for cluster preference: pe-warn-series-max
Nov 13 14:43:45 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c Transition 1: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-62.bz2
Nov 13 14:43:45 cl-test-b pengine: [23740]: info: process_pe_message:pengine.c Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Nov 13 14:43:45 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: unpack_graph:unpack.c Unpacked transition 1: 11 actions in 11 synapses
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: te_pseudo_action:actions.c Pseudo action 8 confirmed
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: te_pseudo_action:actions.c Pseudo action 14 confirmed
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 12: IPaddr_10_128_43_133_start_0 on cl-test-a
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 3: probe_complete on cl-test-a
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 4: pingd-child:0_start_0 on cl-test-b
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 6: pingd-child:1_start_0 on cl-test-a
Nov 13 14:43:45 cl-test-b crmd: [23730]: info: do_lrm_rsc_op:lrm.c Performing op start on pingd-child:0 (interval=0ms, key=1:d29d0e3f-f12c-4f75-9754-5a7278db944c)
Nov 13 14:43:45 cl-test-b su: (to root) root on none
Nov 13 14:43:45 cl-test-b crmd: [23730]: info: process_lrm_event:lrm.c LRM operation (5) start_0 on pingd-child:0 complete
Nov 13 14:43:45 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 161112 bytes (was 158012)
Nov 13 14:43:45 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:28): 0.1.14 -> 0.1.15 (ok)
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.14 -> 0.1.15
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:0_start_0 (4) confirmed
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 5: pingd-child:0_monitor_20000 on cl-test-b
Nov 13 14:43:45 cl-test-b crmd: [23730]: info: do_lrm_rsc_op:lrm.c Performing op monitor on pingd-child:0 (interval=20000ms, key=1:d29d0e3f-f12c-4f75-9754-5a7278db944c)
Nov 13 14:43:45 cl-test-b cib: [23786]: info: write_cib_contents:io.c Wrote version 0.1.15 of the CIB to disk (digest: 71642c874c0f360ff28f145763ac732e)
Nov 13 14:43:45 cl-test-b crmd: [23730]: info: process_lrm_event:lrm.c LRM operation (6) monitor_20000 on pingd-child:0 complete
Nov 13 14:43:45 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 164212 bytes (was 161112)
Nov 13 14:43:45 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:29): 0.1.15 -> 0.1.16 (ok)
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.15 -> 0.1.16
Nov 13 14:43:45 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:0_monitor_20000 (5) confirmed
Nov 13 14:43:45 cl-test-b cib: [23791]: info: write_cib_contents:io.c Wrote version 0.1.16 of the CIB to disk (digest: cde454d96335acb782ebee88ccaa07cf)
Nov 13 14:43:46 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 171644 bytes (was 164212)
Nov 13 14:43:46 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:19): 0.1.16 -> 0.1.17 (ok)
Nov 13 14:43:46 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.16 -> 0.1.17
Nov 13 14:43:46 cl-test-b tengine: [23739]: info: extract_event:events.c Aborting on transient_attributes changes
Nov 13 14:43:46 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort priority upgraded to 1000000
Nov 13 14:43:46 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort action 0 superceeded by 2
Nov 13 14:43:46 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:20): 0.1.17 -> 0.1.18 (ok)
Nov 13 14:43:46 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.17 -> 0.1.18
Nov 13 14:43:46 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 174744 bytes (was 171644)
Nov 13 14:43:46 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:21): 0.1.18 -> 0.1.19 (ok)
Nov 13 14:43:46 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.18 -> 0.1.19
Nov 13 14:43:46 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action IPaddr_10_128_43_133_start_0 (12) confirmed
Nov 13 14:43:46 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 177844 bytes (was 174744)
Nov 13 14:43:46 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:22): 0.1.19 -> 0.1.20 (ok)
Nov 13 14:43:46 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.19 -> 0.1.20
Nov 13 14:43:46 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ]
Nov 13 14:43:46 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:1_start_0 (6) confirmed
Nov 13 14:43:46 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c All 2 cluster nodes are eligable to run resources.
Nov 13 14:43:46 cl-test-b tengine: [23739]: info: te_pseudo_action:actions.c Pseudo action 9 confirmed
Nov 13 14:43:46 cl-test-b tengine: [23739]: info: run_graph:graph.c ====================================================
Nov 13 14:43:46 cl-test-b tengine: [23739]: notice: run_graph:graph.c Transition 1: (Complete=8, Pending=0, Fired=0, Skipped=3, Incomplete=0)
Nov 13 14:43:46 cl-test-b cib: [23792]: info: write_cib_contents:io.c Wrote version 0.1.20 of the CIB to disk (digest: 437424767bf2a91647c968e6f6c783c6)
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: process_pe_message: [generation] <cib admin_epoch="0" epoch="1" num_updates="20" have_quorum="true" generated="true" num_peers="2" ccm_transition="2" cib_feature_revision="1.3" dc_uuid="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08"/>
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default stickiness: 40
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default failure stickiness: 0
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH of failed nodes is disabled
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH will reboot nodes
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Cluster is symmetric - resources can run anywhere by default
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c On loss of CCM Quorum: Stop ALL resources
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resources are stopped
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resource actions are stopped
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Stopped resources are removed from the status section: false
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c By default resources are managed
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-b is online
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-a is online
Nov 13 14:43:46 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-b did not have a value for pingd
Nov 13 14:43:46 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
Nov 13 14:43:46 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-b did not have a value for pingd
Nov 13 14:43:46 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: Clone Set: pingd
Nov 13 14:43:46 cl-test-b pengine: [23740]: info:     pingd-child:0     (heartbeat::ocf:pingd): Started cl-test-b
Nov 13 14:43:46 cl-test-b pengine: [23740]: info:     pingd-child:1     (heartbeat::ocf:pingd): Started cl-test-a
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: Resource Group: group_1
Nov 13 14:43:46 cl-test-b pengine: [23740]: info:     IPaddr_10_128_43_133      (heartbeat::ocf:IPaddr):        Started cl-test-a
Nov 13 14:43:46 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Leave resource pingd-child:0  (cl-test-b)
Nov 13 14:43:46 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Leave resource pingd-child:1  (cl-test-a)
Nov 13 14:43:46 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-a           pingd-child:1_monitor_20000
Nov 13 14:43:46 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Leave resource IPaddr_10_128_43_133   (cl-test-a)
Nov 13 14:43:46 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-a           IPaddr_10_128_43_133_monitor_5000
Nov 13 14:43:46 cl-test-b pengine: [23740]: notice: stage8:allocate.c Created transition graph 2.
Nov 13 14:43:46 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c No value specified for cluster preference: pe-warn-series-max
Nov 13 14:43:46 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
Nov 13 14:43:46 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c Transition 2: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-63.bz2
Nov 13 14:43:46 cl-test-b tengine: [23739]: info: unpack_graph:unpack.c Unpacked transition 2: 2 actions in 2 synapses
Nov 13 14:43:46 cl-test-b pengine: [23740]: info: process_pe_message:pengine.c Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Nov 13 14:43:46 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 9: pingd-child:1_monitor_20000 on cl-test-a
Nov 13 14:43:46 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 16: IPaddr_10_128_43_133_monitor_5000 on cl-test-a
Nov 13 14:43:47 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 180944 bytes (was 177844)
Nov 13 14:43:47 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:23): 0.1.20 -> 0.1.21 (ok)
Nov 13 14:43:47 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.20 -> 0.1.21
Nov 13 14:43:47 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:1_monitor_20000 (9) confirmed
Nov 13 14:43:48 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 184076 bytes (was 180944)
Nov 13 14:43:48 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:24): 0.1.21 -> 0.1.22 (ok)
Nov 13 14:43:48 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.21 -> 0.1.22
Nov 13 14:43:48 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action IPaddr_10_128_43_133_monitor_5000 (16) confirmed
Nov 13 14:43:48 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGEorigin=route_message ]
Nov 13 14:43:48 cl-test-b tengine: [23739]: info: run_graph:graph.c Transition 2: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=0)
Nov 13 14:43:48 cl-test-b tengine: [23739]: info: notify_crmd:actions.c Transition 2 status: te_complete - (null)
Nov 13 14:43:48 cl-test-b cib: [23793]: info: write_cib_contents:io.c Wrote version 0.1.22 of the CIB to disk (digest: 395a72d325e9ccd2b46088ca9d241b9f)
Nov 13 14:43:50 cl-test-b pingd: [23785]: info: do_node_walk:pingd.c Requesting the list of configured nodes
Nov 13 14:43:51 cl-test-b heartbeat: [23715]: WARN: 1 lost packet(s) for [cl-test-a] [56:58]
Nov 13 14:43:51 cl-test-b heartbeat: [23715]: info: No pkts missing from cl-test-a!
Nov 13 14:43:52 cl-test-b pingd: [23785]: info: send_update:pingd.c 1 active ping nodes
Nov 13 14:43:52 cl-test-b pingd: [23785]: info: main:pingd.c Starting pingd
Nov 13 14:43:52 cl-test-b attrd: [23729]: info: find_hash_entry:attrd.c Creating hash entry for pingd
Nov 13 14:43:57 cl-test-b attrd: [23729]: info: attrd_timer_callback:attrd.c Sending flush op to all hosts for: pingd
Nov 13 14:43:57 cl-test-b attrd: [23729]: info: attrd_ha_callback:attrd.c flush message from cl-test-a
Nov 13 14:43:57 cl-test-b attrd: [23729]: info: attrd_ha_callback:attrd.c Sent update 2: pingd=110
Nov 13 14:43:57 cl-test-b attrd: [23729]: info: attrd_ha_callback:attrd.c flush message from cl-test-b
Nov 13 14:43:57 cl-test-b attrd: [23729]: info: attrd_ha_callback:attrd.c Sent update 3: pingd=110
Nov 13 14:43:57 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 186152 bytes (was 184076)
Nov 13 14:43:57 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23729, call:2): 0.1.22 -> 0.1.23 (ok)
Nov 13 14:43:57 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.22 -> 0.1.23
Nov 13 14:43:57 cl-test-b tengine: [23739]: info: extract_event:events.c Aborting on transient_attributes changes
Nov 13 14:43:57 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort priority upgraded to 1000000
Nov 13 14:43:57 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ]
Nov 13 14:43:57 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c All 2 cluster nodes are eligable to run resources.
Nov 13 14:43:57 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23729, call:3): 0.1.23 -> 0.1.24 (ok)
Nov 13 14:43:57 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.23 -> 0.1.24
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: process_pe_message: [generation] <cib admin_epoch="0" epoch="1" num_updates="23" have_quorum="true" generated="true" num_peers="2" ccm_transition="2" cib_feature_revision="1.3" dc_uuid="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08"/>
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default stickiness: 40
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default failure stickiness: 0
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH of failed nodes is disabled
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH will reboot nodes
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Cluster is symmetric - resources can run anywhere by default
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c On loss of CCM Quorum: Stop ALL resources
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resources are stopped
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resource actions are stopped
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Stopped resources are removed from the status section: false
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c By default resources are managed
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-b is online
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-a is online
Nov 13 14:43:57 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
Nov 13 14:43:57 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: Clone Set: pingd
Nov 13 14:43:57 cl-test-b pengine: [23740]: info:     pingd-child:0     (heartbeat::ocf:pingd): Started cl-test-b
Nov 13 14:43:57 cl-test-b pengine: [23740]: info:     pingd-child:1     (heartbeat::ocf:pingd): Started cl-test-a
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: Resource Group: group_1
Nov 13 14:43:57 cl-test-b pengine: [23740]: info:     IPaddr_10_128_43_133      (heartbeat::ocf:IPaddr):        Started cl-test-a
Nov 13 14:43:57 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Leave resource pingd-child:0  (cl-test-b)
Nov 13 14:43:57 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Leave resource pingd-child:1  (cl-test-a)
Nov 13 14:43:57 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Move  resource IPaddr_10_128_43_133   (cl-test-a -> cl-test-b)
Nov 13 14:43:57 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-b           IPaddr_10_128_43_133_monitor_5000
Nov 13 14:43:57 cl-test-b pengine: [23740]: notice: stage8:allocate.c Created transition graph 3.
Nov 13 14:43:57 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c No value specified for cluster preference: pe-warn-series-max
Nov 13 14:43:57 cl-test-b cib: [23794]: info: write_cib_contents:io.c Wrote version 0.1.24 of the CIB to disk (digest: ba9b3c5fca67a2a0e68b5af972cf423a)
Nov 13 14:43:57 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
Nov 13 14:43:57 cl-test-b tengine: [23739]: info: unpack_graph:unpack.c Unpacked transition 3: 7 actions in 7 synapses
Nov 13 14:43:57 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c Transition 3: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-64.bz2
Nov 13 14:43:57 cl-test-b pengine: [23740]: info: process_pe_message:pengine.c Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Nov 13 14:43:57 cl-test-b tengine: [23739]: info: te_pseudo_action:actions.c Pseudo action 20 confirmed
Nov 13 14:43:57 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 15: IPaddr_10_128_43_133_stop_0 on cl-test-a
Nov 13 14:43:58 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 188228 bytes (was 186152)
Nov 13 14:43:58 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17001, call:2): 0.1.24 -> 0.1.25 (ok)
Nov 13 14:43:58 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.24 -> 0.1.25
Nov 13 14:43:58 cl-test-b tengine: [23739]: info: extract_event:events.c Aborting on transient_attributes changes
Nov 13 14:43:58 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort priority upgraded to 1000000
Nov 13 14:43:58 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort action 0 superceeded by 2
Nov 13 14:43:58 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17001, call:3): 0.1.25 -> 0.1.26 (ok)
Nov 13 14:43:58 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.25 -> 0.1.26
Nov 13 14:43:58 cl-test-b cib: [23795]: info: write_cib_contents:io.c Wrote version 0.1.26 of the CIB to disk (digest: 4db1b37fcdf615a0464af1f8a4161ccf)
Nov 13 14:43:59 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 191328 bytes (was 188228)
Nov 13 14:43:59 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:25): 0.1.26 -> 0.1.27 (ok)
Nov 13 14:43:59 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.26 -> 0.1.27
Nov 13 14:43:59 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action IPaddr_10_128_43_133_stop_0 (15) confirmed
Nov 13 14:43:59 cl-test-b tengine: [23739]: info: run_graph:graph.c ====================================================
Nov 13 14:43:59 cl-test-b tengine: [23739]: notice: run_graph:graph.c Transition 3: (Complete=2, Pending=0, Fired=0, Skipped=5, Incomplete=0)
Nov 13 14:43:59 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ]
Nov 13 14:43:59 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c All 2 cluster nodes are eligable to run resources.
Nov 13 14:43:59 cl-test-b cib: [23796]: info: write_cib_contents:io.c Wrote version 0.1.27 of the CIB to disk (digest: 6eeb2bf36c6a643551605cfbf97db033)
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: process_pe_message: [generation] <cib admin_epoch="0" epoch="1" num_updates="27" have_quorum="true" generated="true" num_peers="2" ccm_transition="2" cib_feature_revision="1.3" dc_uuid="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08"/>
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default stickiness: 40
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default failure stickiness: 0
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH of failed nodes is disabled
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH will reboot nodes
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Cluster is symmetric - resources can run anywhere by default
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c On loss of CCM Quorum: Stop ALL resources
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resources are stopped
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resource actions are stopped
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Stopped resources are removed from the status section: false
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c By default resources are managed
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-b is online
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-a is online
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: Clone Set: pingd
Nov 13 14:43:59 cl-test-b pengine: [23740]: info:     pingd-child:0     (heartbeat::ocf:pingd): Started cl-test-b
Nov 13 14:43:59 cl-test-b pengine: [23740]: info:     pingd-child:1     (heartbeat::ocf:pingd): Started cl-test-a
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: Resource Group: group_1
Nov 13 14:43:59 cl-test-b pengine: [23740]: info:     IPaddr_10_128_43_133      (heartbeat::ocf:IPaddr):        Stopped
Nov 13 14:43:59 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Leave resource pingd-child:0  (cl-test-b)
Nov 13 14:43:59 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Leave resource pingd-child:1  (cl-test-a)
Nov 13 14:43:59 cl-test-b pengine: [23740]: notice: StartRsc:native.c  cl-test-a        Start IPaddr_10_128_43_133
Nov 13 14:43:59 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-a           IPaddr_10_128_43_133_monitor_5000
Nov 13 14:43:59 cl-test-b pengine: [23740]: notice: stage8:allocate.c Created transition graph 4.
Nov 13 14:43:59 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c No value specified for cluster preference: pe-input-series-max
Nov 13 14:43:59 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
Nov 13 14:43:59 cl-test-b pengine: [23740]: info: process_pe_message:pengine.c Transition 4: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-136.bz2
Nov 13 14:43:59 cl-test-b tengine: [23739]: info: unpack_graph:unpack.c Unpacked transition 4: 4 actions in 4 synapses
Nov 13 14:43:59 cl-test-b tengine: [23739]: info: te_pseudo_action:actions.c Pseudo action 16 confirmed
Nov 13 14:43:59 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 14: IPaddr_10_128_43_133_start_0 on cl-test-a
Nov 13 14:44:01 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:26): 0.1.27 -> 0.1.28 (ok)
Nov 13 14:44:01 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.27 -> 0.1.28
Nov 13 14:44:01 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action IPaddr_10_128_43_133_start_0 (14) confirmed
Nov 13 14:44:01 cl-test-b tengine: [23739]: info: te_pseudo_action:actions.c Pseudo action 17 confirmed
Nov 13 14:44:01 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 15: IPaddr_10_128_43_133_monitor_5000 on cl-test-a
Nov 13 14:44:01 cl-test-b cib: [23797]: info: write_cib_contents:io.c Wrote version 0.1.28 of the CIB to disk (digest: 5ff44be3368b6377e71e5488f93f8db5)
Nov 13 14:44:02 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:27): 0.1.28 -> 0.1.29 (ok)
Nov 13 14:44:02 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.28 -> 0.1.29
Nov 13 14:44:02 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action IPaddr_10_128_43_133_monitor_5000 (15) confirmed
Nov 13 14:44:02 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGEorigin=route_message ]
Nov 13 14:44:02 cl-test-b tengine: [23739]: info: run_graph:graph.c Transition 4: (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0)
Nov 13 14:44:02 cl-test-b tengine: [23739]: info: notify_crmd:actions.c Transition 4 status: te_complete - (null)
Nov 13 14:44:02 cl-test-b cib: [23798]: info: write_cib_contents:io.c Wrote version 0.1.29 of the CIB to disk (digest: 2eba33708fd092ba42a4742f297a8bd8)
Nov 13 14:53:17 cl-test-b cib: [23726]: info: cib_stats:main.c Processed 47 operations (8723.00us average, 0% utilization) in the last 10min

-------------- next part --------------
 <cib admin_epoch="0" epoch="1" num_updates="23" have_quorum="true" generated="true" num_peers="2" ccm_transition="2" cib_feature_revision="1.3" dc_uuid="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08" cib-last-written="Mon Nov 13 14:43:57 2006">
   <configuration>
     <crm_config>
       <cluster_property_set id="cib-bootstrap-options">
         <attributes>
           <nvpair id="cib-bootstrap-options-symmetric_cluster" name="symmetric_cluster" value="true"/>
           <nvpair id="cib-bootstrap-options-no_quorum_policy" name="no_quorum_policy" value="stop"/>
           <nvpair id="cib-bootstrap-options-default_resource_stickiness" name="default_resource_stickiness" value="40"/>
           <nvpair id="cib-bootstrap-options-default_resource_failure_stickiness" name="default_resource_failure_stickiness" value="0"/>
           <nvpair id="cib-bootstrap-options-stonith_enabled" name="stonith_enabled" value="false"/>
           <nvpair id="cib-bootstrap-options-stonith_action" name="stonith_action" value="reboot"/>
           <nvpair id="cib-bootstrap-options-stop_orphan_resources" name="stop_orphan_resources" value="true"/>
           <nvpair id="cib-bootstrap-options-stop_orphan_actions" name="stop_orphan_actions" value="true"/>
           <nvpair id="cib-bootstrap-options-remove_after_stop" name="remove_after_stop" value="false"/>
           <nvpair id="cib-bootstrap-options-short_resource_names" name="short_resource_names" value="true"/>
           <nvpair id="cib-bootstrap-options-transition_idle_timeout" name="transition_idle_timeout" value="5min"/>
           <nvpair id="cib-bootstrap-options-default_action_timeout" name="default_action_timeout" value="10s"/>
           <nvpair id="cib-bootstrap-options-is_managed_default" name="is_managed_default" value="true"/>
         </attributes>
       </cluster_property_set>
     </crm_config>
     <nodes>
       <node id="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08" uname="cl-test-b" type="normal"/>
       <node id="8f29b378-e694-4c8f-b4ad-9385db258ab7" uname="cl-test-a" type="normal"/>
     </nodes>
     <resources>
       <clone id="pingd">
         <instance_attributes id="pingd_instance_attrs">
           <attributes>
             <nvpair id="pingd-clone_max" name="clone_max" value="2"/>
             <nvpair id="pingd-clone_node_max" name="clone_node_max" value="1"/>
           </attributes>
         </instance_attributes>
         <primitive class="ocf" type="pingd" provider="heartbeat" id="pingd-child">
           <instance_attributes id="pingd-child_instance_attrs">
             <attributes>
               <nvpair id="pingd-dampen" name="dampen" value="5s"/>
               <nvpair id="pingd-multiplier" name="multiplier" value="110"/>
               <nvpair id="pingd-pidfile" name="pidfile" value="/var/run/pingd.pid"/>
               <nvpair id="pingd-user" name="user" value="root"/>
             </attributes>
           </instance_attributes>
           <operations>
             <op name="monitor" id="pingd-monitor" interval="20s" timeout="40s"/>
             <op id="pingd-start" name="start" prereq="nothing"/>
           </operations>
         </primitive>
       </clone>
       <group id="group_1">
         <primitive class="ocf" id="IPaddr_10_128_43_133" provider="heartbeat" type="IPaddr">
           <operations>
             <op id="IPaddr_10_128_43_133_mon" interval="5s" name="monitor" timeout="5s"/>
           </operations>
           <instance_attributes id="IPaddr_10_128_43_133_inst_attr">
             <attributes>
               <nvpair id="IPaddr_10_128_43_133_attr_0" name="ip" value="10.128.43.133"/>
             </attributes>
           </instance_attributes>
         </primitive>
       </group>
     </resources>
     <constraints>
       <rsc_location id="rsc_location_group_1" rsc="group_1">
         <rule id="cl-test-a_location_group_1" score="100">
           <expression attribute="#uname" id="cl-test-a_location_group_1_expr" operation="eq" value="cl-test-a"/>
         </rule>
         <rule id="cl-test-b_location_group_1" score="99">
           <expression attribute="#uname" id="cl-test-b_location_group_1_expr" operation="eq" value="cl-test-b"/>
         </rule>
         <rule id="my_resource:connected:rule" score_attribute="pingd" boolean_op="and">
           <expression id="my_resource:connected:expr:defined" attribute="pingd" operation="defined"/>
           <expression id="my_resource:connected:expr:positive" attribute="pingd" operation="gt" value="100"/>
         </rule>
       </rsc_location>
     </constraints>
   </configuration>
   <status>
     <node_state id="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08" uname="cl-test-b" crmd="online" crm-debug-origin="do_update_resource" shutdown="0" in_ccm="true" ha="active" join="member" expected="member">
       <lrm id="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08">
         <lrm_resources>
           <lrm_resource id="pingd-child:0" type="pingd" class="ocf" provider="heartbeat">
             <lrm_rsc_op id="pingd-child:0_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" transition_key="0:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="4:7;0:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="2" crm_feature_set="1.0.6" rc_code="7" op_status="4" interval="0" op_digest="bf303b7f80e362fc036db05984752c02"/>
             <lrm_rsc_op id="pingd-child:0_start_0" operation="start" crm-debug-origin="do_update_resource" transition_key="1:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="0:0;1:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="5" crm_feature_set="1.0.6" rc_code="0" op_status="0" interval="0" op_digest="bf303b7f80e362fc036db05984752c02"/>
             <lrm_rsc_op id="pingd-child:0_monitor_20000" operation="monitor" crm-debug-origin="do_update_resource" transition_key="1:d29d0e3f-f12c-4f75-9754-5a7278db944c"transition_magic="0:0;1:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="6" crm_feature_set="1.0.6" rc_code="0" op_status="0" interval="20000" op_digest="bf303b7f80e362fc036db05984752c02"/>
           </lrm_resource>
           <lrm_resource id="pingd-child:1" type="pingd" class="ocf" provider="heartbeat">
             <lrm_rsc_op id="pingd-child:1_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" transition_key="0:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="4:7;0:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="3" crm_feature_set="1.0.6" rc_code="7" op_status="4" interval="0" op_digest="bf303b7f80e362fc036db05984752c02"/>
           </lrm_resource>
           <lrm_resource id="IPaddr_10_128_43_133" type="IPaddr" class="ocf" provider="heartbeat">
             <lrm_rsc_op id="IPaddr_10_128_43_133_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" transition_key="0:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="4:7;0:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="4" crm_feature_set="1.0.6" rc_code="7" op_status="4" interval="0" op_digest="5744868951ed70ff6e8258604bfe0ff2"/>
           </lrm_resource>
         </lrm_resources>
       </lrm>
       <transient_attributes id="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08">
         <instance_attributes id="status-4f1f4cbc-5fe9-4828-bca2-6d92a5254b08">
           <attributes>
             <nvpair id="status-4f1f4cbc-5fe9-4828-bca2-6d92a5254b08-probe_complete" name="probe_complete" value="true"/>
             <nvpair id="status-4f1f4cbc-5fe9-4828-bca2-6d92a5254b08-pingd" name="pingd" value="110"/>
           </attributes>
         </instance_attributes>
       </transient_attributes>
     </node_state>
     <node_state id="8f29b378-e694-4c8f-b4ad-9385db258ab7" uname="cl-test-a" crmd="online" crm-debug-origin="do_update_resource" shutdown="0" in_ccm="true" ha="active" join="member" expected="member">
       <lrm id="8f29b378-e694-4c8f-b4ad-9385db258ab7">
         <lrm_resources>
           <lrm_resource id="pingd-child:0" type="pingd" class="ocf" provider="heartbeat">
             <lrm_rsc_op id="pingd-child:0_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" transition_key="0:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="4:7;0:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="2" crm_feature_set="1.0.6" rc_code="7" op_status="4" interval="0" op_digest="bf303b7f80e362fc036db05984752c02"/>
           </lrm_resource>
           <lrm_resource id="pingd-child:1" type="pingd" class="ocf" provider="heartbeat">
             <lrm_rsc_op id="pingd-child:1_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" transition_key="0:d29d0e3f-f12c-4f75-9754-5a7278db944c" tranition_magic="4:7;0:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="3" crm_feature_set="1.0.6" rc_code="7" op_status="4" interval="0" op_digest="bf303b7f80e362fc036db05984752c02"/>
             <lrm_rsc_op id="pingd-child:1_start_0" operation="start" crm-debug-origin="do_update_resource" transition_key="1:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="0:0;1:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="6" crm_feature_set="1.0.6" rc_code="0" op_status="0" interval="0" op_digest="bf303b7f80e362fc036db05984752c02"/>
             <lrm_rsc_op id="pingd-child:1_monitor_20000" operation="monitor" crm-debug-origin="do_update_resource" transition_key="2:d29d0e3f-f12c-4f75-9754-5a7278db944c"transition_magic="0:0;2:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="7" crm_feature_set="1.0.6" rc_code="0" op_status="0" interval="20000" op_digest="bf303b7f80e362fc036db05984752c02"/>
           </lrm_resource>
           <lrm_resource id="IPaddr_10_128_43_133" type="IPaddr" class="ocf" provider="heartbeat">
             <lrm_rsc_op id="IPaddr_10_128_43_133_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" transition_key="0:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="4:7;0:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="4" crm_feature_set="1.0.6" rc_code="7" op_status="4" interval="0" op_digest="5744868951ed70ff6e8258604bfe0ff2"/>
             <lrm_rsc_op id="IPaddr_10_128_43_133_start_0" operation="start" crm-debug-origin="do_update_resource" transition_key="1:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="0:0;1:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="5" crm_feature_set="1.0.6" rc_code="0" op_status="0" interval="0" op_digest="5744868951ed70ff6e8258604bfe0ff2"/>
             <lrm_rsc_op id="IPaddr_10_128_43_133_monitor_5000" operation="monitor" crm-debug-origin="do_update_resource" transition_key="2:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="0:0;2:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="8" crm_feature_set="1.0.6" rc_code="0" op_status="0" interval="5000" op_digest="5744868951ed70ff6e8258604bfe0ff2"/>
           </lrm_resource>
         </lrm_resources>
       </lrm>
       <transient_attributes id="8f29b378-e694-4c8f-b4ad-9385db258ab7">
         <instance_attributes id="status-8f29b378-e694-4c8f-b4ad-9385db258ab7">
           <attributes>
             <nvpair id="status-8f29b378-e694-4c8f-b4ad-9385db258ab7-probe_complete" name="probe_complete" value="true"/>
           </attributes>
         </instance_attributes>
       </transient_attributes>
     </node_state>
   </status>
 </cib>
               
-------------- next part --------------
A non-text attachment was scrubbed...
Name: cib.xml
Type: text/xml
Size: 6094 bytes
Desc: not available
Url : http://lists.community.tummy.com/pipermail/linux-ha/attachments/20061113/b8f73a9e/cib-0001.bin


More information about the Linux-HA mailing list