[Linux-HA] DC
Andrew Beekhof
beekhof at gmail.com
Mon Nov 13 07:44:13 MST 2006
On 11/13/06, Zachár Balázs <zachar at direkt-kfki.hu> wrote:
> I think the reason:
> The order:
>
> 1. Start pingd clones on both nodes
> 2. start resource on A node (because the constraints)
> 3. the B-node's pingd value become 110
> 4. the resource on A node get an stop operation
> 5. the A-node's pingd value become 110
4 and 5 _must_ be the other way around.
> 6. the resource on A node get a cancell avery another operation and get
> a start operation
>
It all seems to be working properly (based on the logs from B).
You might want to try increasing the value of "dampen" so that events
3 and 5 occur (as far as the cluster is concerned) "at the same time".
>
> I attached the DC log and the pengine warning message.
>
> In the log I see pengine warnings and I watch the pengine logs... This
> is that state when the B node's pingd has value and the A node hasn't
> pingd attr. yet.
>
>
> Regards,
> Balázs
>
> Andrew Beekhof írta:
> > On 11/13/06, Zachár Balázs <zachar at direkt-kfki.hu> wrote:
> >> In my case, maybe there is a reason to change the DC:
> >>
> >> In my cluster (active/passive 2 node) the B node is the default DC.
> >> If I don't use rsc_location constraints the resources will start on the
> >> B node (I think, It is because the B is the DC).
> >
> > nope - a node being or not being the DC has no effect on where
> > resources go.
> >
> >> So I use constraints to
> >> start they on the A node.
> >>
> >> If I use clone pingd. There is a strange thing when I starting the
> >> heartbeat:
> >> The resources are starting in the A node, but there is a state when the
> >> B node's pingd value positive (in my case 110) and the A node's value is
> >> zero
> >
> > do you know why this is?
> >
> >> and then the cluster failover. After the A node's pingd value
> >> become positive (110) the resources migrating back.
> >> All of this action were during the start method.
> >>
> >> Now I use the ha.cf respawn directive to using pingd.
> >>
> >> It is normally?
> >>
> >> Thanks,
> >> Balázs
> >>
> >>
> >>
> >> Andrew Beekhof írta:
> >> > On 11/11/06, Zachár Balázs <zachar at direkt-kfki.hu> wrote:
> >> >> Is there any significance which node is the DC?
> >> >
> >> > only internally.
> >> >
> >> >> Can I affect this?
> >> >
> >> > not really, but then again there's no real reason to need to
> >> > _______________________________________________
> >> > Linux-HA mailing list
> >> > Linux-HA at lists.linux-ha.org
> >> > http://lists.linux-ha.org/mailman/listinfo/linux-ha
> >> > See also: http://linux-ha.org/ReportingProblems
> >> >
> >> >
> >> >
> >>
> >>
> >> _______________________________________________
> >> Linux-HA mailing list
> >> Linux-HA at lists.linux-ha.org
> >> http://lists.linux-ha.org/mailman/listinfo/linux-ha
> >> See also: http://linux-ha.org/ReportingProblems
> >>
> > _______________________________________________
> > Linux-HA mailing list
> > Linux-HA at lists.linux-ha.org
> > http://lists.linux-ha.org/mailman/listinfo/linux-ha
> > See also: http://linux-ha.org/ReportingProblems
> >
> >
> >
>
>
>
> Nov 13 14:43:16 cl-test-b logd: [23693]: info: logd started with default configuration.
> Nov 13 14:43:16 cl-test-b logd: [23693]: WARN: Core dumps could be lost if multiple dumps occur
> Nov 13 14:43:16 cl-test-b logd: [23693]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
> Nov 13 14:43:16 cl-test-b logd: [23693]: info: G_main_add_SignalHandler: Added signal handler for signal 15
> Nov 13 14:43:16 cl-test-b logd: [23694]: info: G_main_add_SignalHandler: Added signal handler for signal 15
> Nov 13 14:43:16 cl-test-b heartbeat: [23714]: info: Enabling logging daemon
> Nov 13 14:43:16 cl-test-b heartbeat: [23714]: info: logfile and debug file are those specified in logd config file (default /etc/logd.cf)
> Nov 13 14:43:16 cl-test-b heartbeat: [23714]: WARN: Core dumps could be lost if multiple dumps occur
> Nov 13 14:43:16 cl-test-b heartbeat: [23714]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
> Nov 13 14:43:16 cl-test-b heartbeat: [23714]: info: **************************
> Nov 13 14:43:16 cl-test-b heartbeat: [23714]: info: Configuration validated. Starting heartbeat 2.0.7
> Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: heartbeat: version 2.0.7
> Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: Heartbeat generation: 36
> Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: G_main_add_TriggerHandler: Added signal manual handler
> Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: G_main_add_TriggerHandler: Added signal manual handler
> Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: Removing /var/run/heartbeat/rsctmp failed, recreating.
> Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth1
> Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: glib: UDP Broadcast heartbeat closed on port 694 interface eth1 - Status: 1
> Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: glib: ping heartbeat started.
> Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: G_main_add_SignalHandler: Added signal handler for signal 17
> Nov 13 14:43:16 cl-test-b heartbeat: [23715]: info: Local status now set to: 'up'
> Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Link cl-test-a:eth1 up.
> Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Link 10.128.43.1:10.128.43.1 up.
> Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Status update for node 10.128.43.1: status ping
> Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Status update for node cl-test-a: status up
> Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Link cl-test-b:eth1 up.
> Nov 13 14:43:17 cl-test-b heartbeat: [23715]: debug: get_delnodelist: delnodelist=
> Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Comm_now_up(): updating status to active
> Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Local status now set to: 'active'
> Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Starting child client "/usr/lib64/heartbeat/ccm" (1001,100)
> Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Starting child client "/usr/lib64/heartbeat/cib" (1001,100)
> Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Starting child client "/usr/lib64/heartbeat/lrmd" (0,0)
> Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Starting child client "/usr/lib64/heartbeat/stonithd" (0,0)
> Nov 13 14:43:17 cl-test-b heartbeat: [23725]: info: Starting "/usr/lib64/heartbeat/ccm" as uid 1001 gid 100 (pid 23725)
> Nov 13 14:43:17 cl-test-b heartbeat: [23726]: info: Starting "/usr/lib64/heartbeat/cib" as uid 1001 gid 100 (pid 23726)
> Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Starting child client "/usr/lib64/heartbeat/attrd" (1001,100)
> Nov 13 14:43:17 cl-test-b heartbeat: [23727]: info: Starting "/usr/lib64/heartbeat/lrmd" as uid 0 gid 0 (pid 23727)
> Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Starting child client "/usr/lib64/heartbeat/crmd" (1001,100)
> Nov 13 14:43:17 cl-test-b heartbeat: [23715]: info: Starting child client "/usr/lib64/heartbeat/mgmtd -v" (0,0)
> Nov 13 14:43:17 cl-test-b heartbeat: [23728]: info: Starting "/usr/lib64/heartbeat/stonithd" as uid 0 gid 0 (pid 23728)
> Nov 13 14:43:17 cl-test-b heartbeat: [23729]: info: Starting "/usr/lib64/heartbeat/attrd" as uid 1001 gid 100 (pid 23729)
> Nov 13 14:43:17 cl-test-b heartbeat: [23731]: info: Starting "/usr/lib64/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 23731)
> Nov 13 14:43:17 cl-test-b heartbeat: [23730]: info: Starting "/usr/lib64/heartbeat/crmd" as uid 1001 gid 100 (pid 23730)
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: G_main_add_SignalHandler: Added signal handler for signal 15
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: G_main_add_TriggerHandler: Added signal manual handler
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: G_main_add_SignalHandler: Added signal handler for signal 17
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: main:main.c Retrieval of a per-action CIB: disabled
> Nov 13 14:43:17 cl-test-b lrmd: [23727]: info: G_main_add_SignalHandler: Added signal handler for signal 15
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: cib_register_ha:main.c Signing in with Heartbeat
> Nov 13 14:43:17 cl-test-b ccm: [23725]: info: Hostname: cl-test-b
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: cib_register_ha:main.c FSA Hostname: cl-test-b
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile:io.c Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml
> Nov 13 14:43:17 cl-test-b stonithd: [23728]: WARN: Core dumps could be lost if multiple dumps occur
> Nov 13 14:43:17 cl-test-b stonithd: [23728]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
> Nov 13 14:43:17 cl-test-b stonithd: [23728]: info: G_main_add_SignalHandler: Added signal handler for signal 10
> Nov 13 14:43:17 cl-test-b stonithd: [23728]: info: G_main_add_SignalHandler: Added signal handler for signal 12
> Nov 13 14:43:17 cl-test-b lrmd: [23727]: info: G_main_add_SignalHandler: Added signal handler for signal 17
> Nov 13 14:43:17 cl-test-b attrd: [23729]: info: G_main_add_SignalHandler: Added signal handler for signal 15
> Nov 13 14:43:17 cl-test-b ccm: [23725]: info: G_main_add_SignalHandler: Added signal handler for signal 15
> Nov 13 14:43:17 cl-test-b attrd: [23729]: info: register_with_ha:attrd.c Hostname: cl-test-b
> Nov 13 14:43:17 cl-test-b lrmd: [23727]: WARN: Core dumps could be lost if multiple dumps occur
> Nov 13 14:43:17 cl-test-b lrmd: [23727]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
> Nov 13 14:43:17 cl-test-b lrmd: [23727]: info: G_main_add_SignalHandler: Added signal handler for signal 10
> Nov 13 14:43:17 cl-test-b lrmd: [23727]: info: G_main_add_SignalHandler: Added signal handler for signal 12
> Nov 13 14:43:17 cl-test-b lrmd: [23727]: info: Started.
> Nov 13 14:43:17 cl-test-b stonithd: [23728]: info: Signing in with heartbeat.
> Nov 13 14:43:17 cl-test-b mgmtd: [23731]: info: G_main_add_SignalHandler: Added signal handler for signal 15
> Nov 13 14:43:17 cl-test-b mgmtd: [23731]: debug: Enabling coredumps
> Nov 13 14:43:17 cl-test-b mgmtd: [23731]: WARN: Core dumps could be lost if multiple dumps occur
> Nov 13 14:43:17 cl-test-b mgmtd: [23731]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
> Nov 13 14:43:17 cl-test-b mgmtd: [23731]: info: G_main_add_SignalHandler: Added signal handler for signal 10
> Nov 13 14:43:17 cl-test-b mgmtd: [23731]: info: G_main_add_SignalHandler: Added signal handler for signal 12
> Nov 13 14:43:17 cl-test-b stonithd: [23728]: notice: /usr/lib64/heartbeat/stonithd start up successfully.
> Nov 13 14:43:17 cl-test-b stonithd: [23728]: info: G_main_add_SignalHandler: Added signal handler for signal 17
> Nov 13 14:43:17 cl-test-b attrd: [23729]: info: register_with_ha:attrd.c UUID: 4f1f4cbc-5fe9-4828-bca2-6d92a5254b08
> Nov 13 14:43:17 cl-test-b attrd: [23729]: WARN: cib_native_signon:cib_native.c Connection to CIB failed: connection failed
> Nov 13 14:43:17 cl-test-b mgmtd: [23731]: info: init_crm
> Nov 13 14:43:17 cl-test-b mgmtd: [23731]: info: login to cib: 0, ret:-10
> Nov 13 14:43:17 cl-test-b crmd: [23730]: WARN: Core dumps could be lost if multiple dumps occur
> Nov 13 14:43:17 cl-test-b crmd: [23730]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
> Nov 13 14:43:17 cl-test-b crmd: [23730]: info: init_start:main.c Starting crmd
> Nov 13 14:43:17 cl-test-b crmd: [23730]: info: G_main_add_SignalHandler: Added signal handler for signal 15
> Nov 13 14:43:17 cl-test-b crmd: [23730]: info: G_main_add_TriggerHandler: Added signal manual handler
> Nov 13 14:43:17 cl-test-b crmd: [23730]: info: G_main_add_SignalHandler: Added signal handler for signal 17
> Nov 13 14:43:17 cl-test-b crmd: [23730]: WARN: cib_native_signon:cib_native.c Connection to CIB failed: connection failed
> Nov 13 14:43:17 cl-test-b cib: [23726]: WARN: validate_cib_digest:io.c No on-disk digest present
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <cib admin_epoch="0" epoch="0" num_updates="0" have_quorum="false">
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <configuration>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <crm_config>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <cluster_property_set id="cib-bootstrap-options">
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <attributes>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-symmetric_cluster" name="symmetric_cluster" value="true"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-no_quorum_policy" name="no_quorum_policy" value="stop"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-default_resource_stickiness" name="default_resource_stickiness" value="40"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-default_resource_failure_stickiness" name="default_resource_failure_stickiness" value="0"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-stonith_enabled" name="stonith_enabled" value="false"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-stonith_action" name="stonith_action" value="reboot"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-stop_orphan_resources" name="stop_orphan_resources" value="true"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-stop_orphan_actions" name="stop_orphan_actions" value="true"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-remove_after_stop" name="remove_after_stop" value="false"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-short_resource_names" name="short_resource_names" value="true"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-transition_idle_timeout" name="transition_idle_timeout"value="5min"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-default_action_timeout" name="default_action_timeout" value="10s"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-is_managed_default" name="is_managed_default" value="true"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </attributes>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </cluster_property_set>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </crm_config>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nodes/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <resources>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <clone id="pingd">
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <instance_attributes id="pingd_instance_attrs">
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <attributes>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="pingd-clone_max" name="clone_max" value="2"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="pingd-clone_node_max" name="clone_node_max" value="1"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </attributes>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </instance_attributes>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <primitive class="ocf" type="pingd" provider="heartbeat" id="pingd-child">
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <instance_attributes id="pingd-child_instance_attrs">
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <attributes>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="pingd-dampen" name="dampen" value="5s"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="pingd-multiplier" name="multiplier" value="110"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="pingd-pidfile" name="pidfile" value="/var/run/pingd.pid"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="pingd-user" name="user" value="root"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </attributes>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </instance_attributes>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <operations>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <op name="monitor" id="pingd-monitor" interval="20s" timeout="40s"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <op id="pingd-start" name="start" prereq="nothing"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </operations>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </primitive>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </clone>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <group id="group_1">
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <primitive class="ocf" id="IPaddr_10_128_43_133" provider="heartbeat" type="IPaddr">
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <operations>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <op id="IPaddr_10_128_43_133_mon" interval="5s" name="monitor" timeout="5s"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </operations>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <instance_attributes id="IPaddr_10_128_43_133_inst_attr">
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <attributes>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <nvpair id="IPaddr_10_128_43_133_attr_0" name="ip" value="10.128.43.133"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </attributes>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </instance_attributes>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </primitive>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </group>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </resources>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <constraints>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <rsc_location id="rsc_location_group_1" rsc="group_1">
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <rule id="cl-test-a_location_group_1" score="100">
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <expression attribute="#uname" id="cl-test-a_location_group_1_expr" operation="eq" value="cl-test-a"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </rule>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <rule id="cl-test-b_location_group_1" score="99">
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <expression attribute="#uname" id="cl-test-b_location_group_1_expr" operation="eq" value="cl-test-b"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </rule>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <rule id="my_resource:connected:rule" score_attribute="pingd" boolean_op="and">
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <expression id="my_resource:connected:expr:defined" attribute="pingd" operation="defined"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <expression id="my_resource:connected:expr:positive" attribute="pingd" operation="gt" value="100"/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </rule>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </rsc_location>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </constraints>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </configuration>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] <status/>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: readCibXmlFile: [on-disk] </cib>
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 101700 bytes (was 0)
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: startCib:main.c CIB Initialization completed successfully
> Nov 13 14:43:17 cl-test-b cib: [23726]: info: init_start:main.c Starting cib mainloop
> Nov 13 14:43:17 cl-test-b cib: [23733]: WARN: validate_cib_digest:io.c No on-disk digest present
> Nov 13 14:43:17 cl-test-b cib: [23733]: info: write_cib_contents:io.c Wrote version 0.0.0 of the CIB to disk (digest: 3034143137cb3433f672f51554097553)
> Nov 13 14:43:18 cl-test-b heartbeat: [23715]: info: Status update for node cl-test-a: status active
> Nov 13 14:43:18 cl-test-b cib: [23726]: info: cib_client_status_callback:callbacks.c Status update: Client cl-test-b/cib now has status [join]
> Nov 13 14:43:18 cl-test-b cib: [23726]: info: cib_client_status_callback:callbacks.c Status update: Client cl-test-a/cib now has status [join]
> Nov 13 14:43:18 cl-test-b cib: [23726]: info: cib_client_status_callback:callbacks.c Status update: Client cl-test-b/cib now has status [online]
> Nov 13 14:43:18 cl-test-b cib: [23726]: info: cib_null_callback:callbacks.c Setting cib_diff_notify callbacks for mgmtd: on
> Nov 13 14:43:18 cl-test-b crmd: [23730]: info: do_cib_control:cib.c CIB connection established
> Nov 13 14:43:18 cl-test-b cib: [23726]: info: cib_client_status_callback:callbacks.c Status update: Client cl-test-a/cib now has status [online]
> Nov 13 14:43:18 cl-test-b crmd: [23730]: info: register_with_ha:control.c Hostname: cl-test-b
> Nov 13 14:43:18 cl-test-b cib: [23726]: info: cib_null_callback:callbacks.c Setting cib_refresh_notify callbacks for crmd: on
> Nov 13 14:43:18 cl-test-b crmd: [23730]: info: register_with_ha:control.c UUID: 4f1f4cbc-5fe9-4828-bca2-6d92a5254b08
> Nov 13 14:43:19 cl-test-b mgmtd: [23731]: debug: main: run the loop...
> Nov 13 14:43:19 cl-test-b mgmtd: [23731]: info: Started.
> Nov 13 14:43:19 cl-test-b ccm: [23725]: debug: quorum plugin: majority
> Nov 13 14:43:19 cl-test-b cib: [23726]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
> Nov 13 14:43:19 cl-test-b ccm: [23725]: debug: cluster:linux-ha, member_count=1, member_quorum_votes=100
> Nov 13 14:43:19 cl-test-b cib: [23726]: info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3
> Nov 13 14:43:19 cl-test-b ccm: [23725]: debug: total_node_count=2, total_quorum_votes=200
> Nov 13 14:43:19 cl-test-b cib: [23726]: info: cib_ccm_msg_callback:callbacks.c PEER: cl-test-b
> Nov 13 14:43:19 cl-test-b ccm: [23725]: debug: quorum plugin: twonodes
> Nov 13 14:43:19 cl-test-b ccm: [23725]: debug: cluster:linux-ha, member_count=1, member_quorum_votes=100
> Nov 13 14:43:19 cl-test-b ccm: [23725]: debug: total_node_count=2, total_quorum_votes=200
> Nov 13 14:43:19 cl-test-b ccm: [23725]: info: Break tie for 2 nodes cluster
> Nov 13 14:43:19 cl-test-b crmd: [23730]: info: populate_cib_nodes:control.c Requesting the list of configured nodes
> Nov 13 14:43:19 cl-test-b heartbeat: [23715]: WARN: 1 lost packet(s) for [cl-test-a] [14:16]
> Nov 13 14:43:19 cl-test-b heartbeat: [23715]: info: No pkts missing from cl-test-a!
> Nov 13 14:43:20 cl-test-b ccm: [23725]: debug: quorum plugin: majority
> Nov 13 14:43:20 cl-test-b ccm: [23725]: debug: cluster:linux-ha, member_count=2, member_quorum_votes=200
> Nov 13 14:43:20 cl-test-b ccm: [23725]: debug: total_node_count=2, total_quorum_votes=200
> Nov 13 14:43:20 cl-test-b cib: [23726]: info: mem_handle_event: Got an event OC_EV_MS_INVALID from ccm
> Nov 13 14:43:20 cl-test-b cib: [23726]: info: mem_handle_event: no mbr_track info
> Nov 13 14:43:20 cl-test-b cib: [23726]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
> Nov 13 14:43:20 cl-test-b cib: [23726]: info: mem_handle_event: instance=2, nodes=2, new=1, lost=0, n_idx=0, new_idx=2, old_idx=4
> Nov 13 14:43:20 cl-test-b cib: [23726]: info: cib_ccm_msg_callback:callbacks.c PEER: cl-test-b
> Nov 13 14:43:20 cl-test-b cib: [23726]: info: cib_ccm_msg_callback:callbacks.c PEER: cl-test-a
> Nov 13 14:43:20 cl-test-b heartbeat: [23715]: WARN: 1 lost packet(s) for [cl-test-a] [20:22]
> Nov 13 14:43:20 cl-test-b heartbeat: [23715]: info: No pkts missing from cl-test-a!
> Nov 13 14:43:20 cl-test-b crmd: [23730]: notice: populate_cib_nodes:control.c Node: cl-test-b (uuid: 4f1f4cbc-5fe9-4828-bca2-6d92a5254b08)
> Nov 13 14:43:21 cl-test-b crmd: [23730]: notice: populate_cib_nodes:control.c Node: cl-test-a (uuid: 8f29b378-e694-4c8f-b4ad-9385db258ab7)
> Nov 13 14:43:21 cl-test-b crmd: [23730]: info: do_ha_control:control.c Connected to Heartbeat
> Nov 13 14:43:21 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 106092 bytes (was 101940)
> Nov 13 14:43:21 cl-test-b crmd: [23730]: info: do_ccm_control:ccm.c CCM connection established... waiting for first callback
> Nov 13 14:43:21 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Local-only Change (client:23730, call: 3): 0.0.0 (ok)
> Nov 13 14:43:21 cl-test-b crmd: [23730]: info: do_started:control.c Delaying start, CCM (0000000000100000) not connected
> Nov 13 14:43:21 cl-test-b crmd: [23730]: info: init_start:main.c Starting crmd's mainloop
> Nov 13 14:43:21 cl-test-b crmd: [23730]: notice: crmd_client_status_callback:callbacks.c Status update: Client cl-test-b/crmd now has status [online]
> Nov 13 14:43:21 cl-test-b crmd: [23730]: info: crmd_client_status_callback:callbacks.c Uncaching UUID for cl-test-b
> Nov 13 14:43:21 cl-test-b cib: [23734]: info: write_cib_contents:io.c Wrote version 0.0.0 of the CIB to disk (digest: 9f094e00ce559fcf23f1025c1f4238b6)
> Nov 13 14:43:22 cl-test-b crmd: [23730]: notice: crmd_client_status_callback:callbacks.c Status update: Client cl-test-a/crmd now has status [online]
> Nov 13 14:43:22 cl-test-b crmd: [23730]: info: crmd_client_status_callback:callbacks.c Uncaching UUID for cl-test-a
> Nov 13 14:43:22 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 108408 bytes (was 106092)
> Nov 13 14:43:22 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Local-only Change (client:23730, call: 5): 0.0.0 (ok)
> Nov 13 14:43:22 cl-test-b cib: [23735]: info: write_cib_contents:io.c Wrote version 0.0.0 of the CIB to disk (digest: 481fa21844415e2fcb557c361f499a46)
> Nov 13 14:43:22 cl-test-b crmd: [23730]: notice: crmd_client_status_callback:callbacks.c Status update: Client cl-test-b/crmd now has status [online]
> Nov 13 14:43:22 cl-test-b crmd: [23730]: info: crmd_client_status_callback:callbacks.c Uncaching UUID for cl-test-b
> Nov 13 14:43:22 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 110724 bytes (was 108408)
> Nov 13 14:43:22 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Local-only Change (client:23730, call: 6): 0.0.0 (ok)
> Nov 13 14:43:22 cl-test-b cib: [23736]: info: write_cib_contents:io.c Wrote version 0.0.0 of the CIB to disk (digest: 481fa21844415e2fcb557c361f499a46)
> Nov 13 14:43:23 cl-test-b crmd: [23730]: notice: crmd_client_status_callback:callbacks.c Status update: Client cl-test-a/crmd now has status [online]
> Nov 13 14:43:23 cl-test-b crmd: [23730]: info: crmd_client_status_callback:callbacks.c Uncaching UUID for cl-test-a
> Nov 13 14:43:23 cl-test-b cib: [23737]: info: write_cib_contents:io.c Wrote version 0.0.0 of the CIB to disk (digest: cd15aa1c40d215c9bda7ea3c127273c1)
> Nov 13 14:43:23 cl-test-b crmd: [23730]: info: do_started:control.c Delaying start, CCM (0000000000100000) not connected
> Nov 13 14:43:23 cl-test-b crmd: [23730]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
> Nov 13 14:43:23 cl-test-b crmd: [23730]: info: mem_handle_event: instance=2, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
> Nov 13 14:43:23 cl-test-b crmd: [23730]: info: crmd_ccm_msg_callback:callbacks.c Quorum (re)attained after event=NEW MEMBERSHIP (id=2)
> Nov 13 14:43:23 cl-test-b crmd: [23730]: info: ccm_event_detail:ccm.c NEW MEMBERSHIP: trans=2, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4
> Nov 13 14:43:23 cl-test-b crmd: [23730]: info: ccm_event_detail:ccm.c CURRENT: cl-test-b [nodeid=1, born=1]
> Nov 13 14:43:23 cl-test-b crmd: [23730]: info: ccm_event_detail:ccm.c CURRENT: cl-test-a [nodeid=0, born=2]
> Nov 13 14:43:23 cl-test-b crmd: [23730]: info: ccm_event_detail:ccm.c NEW: cl-test-b [nodeid=1, born=1]
> Nov 13 14:43:23 cl-test-b crmd: [23730]: info: ccm_event_detail:ccm.c NEW: cl-test-a [nodeid=0, born=2]
> Nov 13 14:43:23 cl-test-b crmd: [23730]: info: do_started:control.c The local CRM is operational
> Nov 13 14:43:23 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ]
> Nov 13 14:43:23 cl-test-b crmd: [23730]: info: update_dc:utils.c Set DC to <null> (<null>)
> Nov 13 14:43:23 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 110964 bytes (was 110724)
> Nov 13 14:43:23 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Local-only Change (client:23730, call: 9): 0.0.0 (ok)
> Nov 13 14:43:23 cl-test-b cib: [23738]: info: write_cib_contents:io.c Wrote version 0.0.0 of the CIB to disk (digest: cd15aa1c40d215c9bda7ea3c127273c1)
> Nov 13 14:43:27 cl-test-b attrd: [23729]: info: main:attrd.c Starting mainloop...
> Nov 13 14:43:39 cl-test-b crmd: [23730]: info: crm_timer_popped:utils.c Election Trigger (I_DC_TIMEOUT) just popped!
> Nov 13 14:43:39 cl-test-b crmd: [23730]: WARN: do_log:misc.c [[FSA]] Input I_DC_TIMEOUT from crm_timer_popped() received in state (S_PENDING)
> Nov 13 14:43:39 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ]
> Nov 13 14:43:39 cl-test-b crmd: [23730]: info: update_dc:utils.c Set DC to <null> (<null>)
> Nov 13 14:43:39 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Election check: vote from cl-test-a
> Nov 13 14:43:39 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Election won over cl-test-a
> Nov 13 14:43:39 cl-test-b crmd: [23730]: info: do_election_check:election.c Still waiting on 2 non-votes (2 total)
> Nov 13 14:43:39 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Updated voted hash for cl-test-b to vote
> Nov 13 14:43:39 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Election ignore: our vote (cl-test-b)
> Nov 13 14:43:39 cl-test-b crmd: [23730]: info: do_election_check:election.c Still waiting on 1 non-votes (2 total)
> Nov 13 14:43:40 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Updated voted hash for cl-test-a to no-vote
> Nov 13 14:43:40 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Election ignore: no-vote from cl-test-a
> Nov 13 14:43:40 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNALorigin=do_election_check ]
> Nov 13 14:43:40 cl-test-b crmd: [23730]: info: start_subsystem:subsystems.c Starting sub-system "tengine"
> Nov 13 14:43:40 cl-test-b cib: [23726]: info: cib_null_callback:callbacks.c Setting cib_diff_notify callbacks for tengine: on
> Nov 13 14:43:40 cl-test-b crmd: [23730]: info: start_subsystem:subsystems.c Starting sub-system "pengine"
> Nov 13 14:43:40 cl-test-b tengine: [23739]: info: G_main_add_SignalHandler: Added signal handler for signal 15
> Nov 13 14:43:40 cl-test-b cib: [23726]: info: cib_process_readwrite:messages.c We are now in R/W mode
> Nov 13 14:43:40 cl-test-b crmd: [23730]: info: do_dc_takeover:election.c Taking over DC status for this partition
> Nov 13 14:43:40 cl-test-b tengine: [23739]: info: G_main_add_TriggerHandler: Added signal manual handler
> Nov 13 14:43:40 cl-test-b cib: [23726]: info: revision_check:messages.c Updating CIB revision to 1.3
> Nov 13 14:43:40 cl-test-b crmd: [23730]: info: update_dc:utils.c Set DC to <null> (<null>)
> Nov 13 14:43:40 cl-test-b tengine: [23739]: info: init_start:main.c Registering TE UUID: d29d0e3f-f12c-4f75-9754-5a7278db944c
> Nov 13 14:43:40 cl-test-b crmd: [23730]: info: do_dc_join_offer_all:join_dc.c join-1: Waiting on 2 outstanding join acks
> Nov 13 14:43:40 cl-test-b tengine: [23739]: info: set_graph_functions:utils.c Setting custom graph functions
> Nov 13 14:43:40 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Updated voted hash for cl-test-b to vote
> Nov 13 14:43:40 cl-test-b tengine: [23739]: info: unpack_graph:unpack.c Unpacked transition -1: 0 actions in 0 synapses
> Nov 13 14:43:40 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Election ignore: our vote (cl-test-b)
> Nov 13 14:43:40 cl-test-b tengine: [23739]: info: init_start:main.c Starting tengine
> Nov 13 14:43:40 cl-test-b pengine: [23740]: info: G_main_add_SignalHandler: Added signal handler for signal 15
> Nov 13 14:43:40 cl-test-b pengine: [23740]: info: init_start:main.c Starting pengine
> Nov 13 14:43:40 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:13): 0.0.0 -> 0.0.1 (ok)
> Nov 13 14:43:40 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.0.0 -> 0.0.1
> Nov 13 14:43:40 cl-test-b cib: [23741]: info: write_cib_contents:io.c Wrote version 0.0.1 of the CIB to disk (digest: 6eb7c6fe575ada1f364741f1f7c637f6)
> Nov 13 14:43:40 cl-test-b crmd: [23730]: info: update_dc:utils.c Set DC to cl-test-b (1.0.6)
> Nov 13 14:43:41 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Updated voted hash for cl-test-a to no-vote
> Nov 13 14:43:41 cl-test-b crmd: [23730]: info: do_election_count_vote:election.c Election ignore: no-vote from cl-test-a
> Nov 13 14:43:41 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
> Nov 13 14:43:41 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c All 2 cluster nodes responded to the join offer.
> Nov 13 14:43:41 cl-test-b crmd: [23730]: info: update_attrd:join_dc.c Connecting to attrd...
> Nov 13 14:43:41 cl-test-b cib: [23726]: info: sync_our_cib:messages.c Syncing CIB to all peers
> Nov 13 14:43:41 cl-test-b attrd: [23729]: info: attrd_local_callback:attrd.c Sending full refresh
> Nov 13 14:43:41 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 111236 bytes (was 111084)
> Nov 13 14:43:41 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:16): 0.0.1 -> 0.0.2 (ok)
> Nov 13 14:43:41 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.0.1 -> 0.0.2
> Nov 13 14:43:41 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:17): 0.0.2 -> 0.1.3 (ok)
> Nov 13 14:43:41 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_bump): 0.0.2 -> 0.1.3
> Nov 13 14:43:41 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:18): 0.1.3 -> 0.1.4 (ok)
> Nov 13 14:43:41 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.3 -> 0.1.4
> Nov 13 14:43:41 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:19): 0.1.4 -> 0.1.5 (ok)
> Nov 13 14:43:41 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.4 -> 0.1.5
> Nov 13 14:43:41 cl-test-b cib: [23742]: info: write_cib_contents:io.c Wrote version 0.1.5 of the CIB to disk (digest: f467f69b413c810d964e608c6aa6a952)
> Nov 13 14:43:42 cl-test-b crmd: [23730]: info: update_dc:utils.c Set DC to cl-test-b (1.0.6)
> Nov 13 14:43:42 cl-test-b crmd: [23730]: info: do_dc_join_ack:join_dc.c join-1: Updating node state to member for cl-test-b)
> Nov 13 14:43:42 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 115116 bytes (was 111236)
> Nov 13 14:43:42 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:20): 0.1.5 -> 0.1.6 (ok)
> Nov 13 14:43:42 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.5 -> 0.1.6
> Nov 13 14:43:42 cl-test-b cib: [23743]: info: write_cib_contents:io.c Wrote version 0.1.6 of the CIB to disk (digest: 25e1a0890d62f532fca492f3ef101493)
> Nov 13 14:43:43 cl-test-b crmd: [23730]: info: do_dc_join_ack:join_dc.c join-1: Updating node state to member for cl-test-a)
> Nov 13 14:43:43 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 118996 bytes (was 115116)
> Nov 13 14:43:43 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:21): 0.1.6 -> 0.1.7 (ok)
> Nov 13 14:43:43 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
> Nov 13 14:43:43 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c All 2 cluster nodes are eligable to run resources.
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort priority upgraded to 1000000
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.6 -> 0.1.7
> Nov 13 14:43:43 cl-test-b cib: [23744]: info: write_cib_contents:io.c Wrote version 0.1.7 of the CIB to disk (digest: bd2d96fb20e3d048ab8cc537089ae71a)
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: process_pe_message: [generation] <cib admin_epoch="0" epoch="1" num_updates="7" have_quorum="true" generated="true" num_peers="2" ccm_transition="2" cib_feature_revision="1.3" dc_uuid="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08"/>
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default stickiness: 40
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default failure stickiness: 0
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH of failed nodes is disabled
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH will reboot nodes
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Cluster is symmetric - resources can run anywhere by default
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c On loss of CCM Quorum: Stop ALL resources
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resources are stopped
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resource actions are stopped
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Stopped resources are removed from the status section: false
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: unpack_config:unpack.c By default resources are managed
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-b is online
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-a is online
> Nov 13 14:43:43 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-b did not have a value for pingd
> Nov 13 14:43:43 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
> Nov 13 14:43:43 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-b did not have a value for pingd
> Nov 13 14:43:43 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: Clone Set: pingd
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: pingd-child:0 (heartbeat::ocf:pingd): Stopped
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: pingd-child:1 (heartbeat::ocf:pingd): Stopped
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: Resource Group: group_1
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: IPaddr_10_128_43_133 (heartbeat::ocf:IPaddr): Stopped
> Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: native_create_probe:native.c cl-test-b: Created probe for pingd-child:0
> Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: native_create_probe:native.c cl-test-b: Created probe for pingd-child:1
> Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: native_create_probe:native.c cl-test-b: Created probe for IPaddr_10_128_43_133
> Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: native_create_probe:native.c cl-test-a: Created probe for pingd-child:0
> Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: native_create_probe:native.c cl-test-a: Created probe for pingd-child:1
> Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: native_create_probe:native.c cl-test-a: Created probe for IPaddr_10_128_43_133
> Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: StartRsc:native.c cl-test-b Start pingd-child:0
> Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-b pingd-child:0_monitor_20000
> Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: StartRsc:native.c cl-test-a Start pingd-child:1
> Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-a pingd-child:1_monitor_20000
> Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: StartRsc:native.c cl-test-a Start IPaddr_10_128_43_133
> Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-a IPaddr_10_128_43_133_monitor_5000
> Nov 13 14:43:43 cl-test-b pengine: [23740]: notice: stage8:allocate.c Created transition graph 0.
> Nov 13 14:43:43 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c No value specified for cluster preference: pe-warn-series-max
> Nov 13 14:43:43 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c Transition 0: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-61.bz2
> Nov 13 14:43:43 cl-test-b pengine: [23740]: info: process_pe_message:pengine.c Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues.
> Nov 13 14:43:43 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: unpack_graph:unpack.c Unpacked transition 0: 19 actions in 19 synapses
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 3: pingd-child:0_monitor_0 on cl-test-b
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 7: pingd-child:0_monitor_0 on cl-test-a
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 4: pingd-child:1_monitor_0 on cl-test-b
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 8: pingd-child:1_monitor_0 on cl-test-a
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 5: IPaddr_10_128_43_133_monitor_0 on cl-test-b
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 9: IPaddr_10_128_43_133_monitor_0 on cl-test-a
> Nov 13 14:43:43 cl-test-b crmd: [23730]: info: do_lrm_rsc_op:lrm.c Performing op monitor on pingd-child:0 (interval=0ms, key=0:d29d0e3f-f12c-4f75-9754-5a7278db944c)
> Nov 13 14:43:43 cl-test-b crmd: [23730]: info: do_lrm_rsc_op:lrm.c Performing op monitor on pingd-child:1 (interval=0ms, key=0:d29d0e3f-f12c-4f75-9754-5a7278db944c)
> Nov 13 14:43:43 cl-test-b crmd: [23730]: info: do_lrm_rsc_op:lrm.c Performing op monitor on IPaddr_10_128_43_133 (interval=0ms, key=0:d29d0e3f-f12c-4f75-9754-5a7278db944c)
> Nov 13 14:43:43 cl-test-b crmd: [23730]: info: process_lrm_event:lrm.c LRM operation (2) monitor_0 on pingd-child:0 Error: (7) not running
> Nov 13 14:43:43 cl-test-b crmd: [23730]: info: process_lrm_event:lrm.c LRM operation (3) monitor_0 on pingd-child:1 Error: (7) not running
> Nov 13 14:43:43 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 124260 bytes (was 118996)
> Nov 13 14:43:43 cl-test-b crmd: [23730]: info: process_lrm_event:lrm.c LRM operation (4) monitor_0 on IPaddr_10_128_43_133 Error: (7) not running
> Nov 13 14:43:43 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:23): 0.1.7 -> 0.1.8 (ok)
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.7 -> 0.1.8
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:0_monitor_0 (3) confirmed
> Nov 13 14:43:43 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 129524 bytes (was 124260)
> Nov 13 14:43:43 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:24): 0.1.8 -> 0.1.9 (ok)
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.8 -> 0.1.9
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:1_monitor_0 (4) confirmed
> Nov 13 14:43:43 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 134788 bytes (was 129524)
> Nov 13 14:43:43 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:25): 0.1.9 -> 0.1.10 (ok)
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.9 -> 0.1.10
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action IPaddr_10_128_43_133_monitor_0 (5) confirmed
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 2: probe_complete on cl-test-b
> Nov 13 14:43:43 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 142220 bytes (was 134788)
> Nov 13 14:43:43 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:26): 0.1.10 -> 0.1.11 (ok)
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.10 -> 0.1.11
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: extract_event:events.c Aborting on transient_attributes changes
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort priority upgraded to 1000000
> Nov 13 14:43:43 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort action 0 superceeded by 2
> Nov 13 14:43:43 cl-test-b cib: [23760]: info: write_cib_contents:io.c Wrote version 0.1.10 of the CIB to disk (digest: 1114450a090210db4e8cfb07c564a4ce)
> Nov 13 14:43:43 cl-test-b cib: [23761]: info: write_cib_contents:io.c Wrote version 0.1.11 of the CIB to disk (digest: 7bd5200de58361a79400125756357bba)
> Nov 13 14:43:44 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 147484 bytes (was 142220)
> Nov 13 14:43:44 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:16): 0.1.11 -> 0.1.12 (ok)
> Nov 13 14:43:44 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.11 -> 0.1.12
> Nov 13 14:43:44 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:0_monitor_0 (7) confirmed
> Nov 13 14:43:44 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 152748 bytes (was 147484)
> Nov 13 14:43:44 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:17): 0.1.12 -> 0.1.13 (ok)
> Nov 13 14:43:44 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.12 -> 0.1.13
> Nov 13 14:43:44 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:1_monitor_0 (8) confirmed
> Nov 13 14:43:45 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 158012 bytes (was 152748)
> Nov 13 14:43:45 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:18): 0.1.13 -> 0.1.14 (ok)
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.13 -> 0.1.14
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action IPaddr_10_128_43_133_monitor_0 (9) confirmed
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 6: probe_complete on cl-test-a
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: run_graph:graph.c ====================================================
> Nov 13 14:43:45 cl-test-b tengine: [23739]: notice: run_graph:graph.c Transition 0: (Complete=8, Pending=0, Fired=0, Skipped=10, Incomplete=1)
> Nov 13 14:43:45 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ]
> Nov 13 14:43:45 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c All 2 cluster nodes are eligable to run resources.
> Nov 13 14:43:45 cl-test-b cib: [23762]: info: write_cib_contents:io.c Wrote version 0.1.14 of the CIB to disk (digest: f09828e03cf54dc72036331a37092a0c)
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: process_pe_message: [generation] <cib admin_epoch="0" epoch="1" num_updates="14" have_quorum="true" generated="true" num_peers="2" ccm_transition="2" cib_feature_revision="1.3" dc_uuid="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08"/>
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default stickiness: 40
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default failure stickiness: 0
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH of failed nodes is disabled
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH will reboot nodes
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Cluster is symmetric - resources can run anywhere by default
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c On loss of CCM Quorum: Stop ALL resources
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resources are stopped
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resource actions are stopped
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Stopped resources are removed from the status section: false
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: unpack_config:unpack.c By default resources are managed
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-b is online
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-a is online
> Nov 13 14:43:45 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-b did not have a value for pingd
> Nov 13 14:43:45 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
> Nov 13 14:43:45 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-b did not have a value for pingd
> Nov 13 14:43:45 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: Clone Set: pingd
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: pingd-child:0 (heartbeat::ocf:pingd): Stopped
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: pingd-child:1 (heartbeat::ocf:pingd): Stopped
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: Resource Group: group_1
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: IPaddr_10_128_43_133 (heartbeat::ocf:IPaddr): Stopped
> Nov 13 14:43:45 cl-test-b pengine: [23740]: notice: StartRsc:native.c cl-test-b Start pingd-child:0
> Nov 13 14:43:45 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-b pingd-child:0_monitor_20000
> Nov 13 14:43:45 cl-test-b pengine: [23740]: notice: StartRsc:native.c cl-test-a Start pingd-child:1
> Nov 13 14:43:45 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-a pingd-child:1_monitor_20000
> Nov 13 14:43:45 cl-test-b pengine: [23740]: notice: StartRsc:native.c cl-test-a Start IPaddr_10_128_43_133
> Nov 13 14:43:45 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-a IPaddr_10_128_43_133_monitor_5000
> Nov 13 14:43:45 cl-test-b pengine: [23740]: notice: stage8:allocate.c Created transition graph 1.
> Nov 13 14:43:45 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c No value specified for cluster preference: pe-warn-series-max
> Nov 13 14:43:45 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c Transition 1: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-62.bz2
> Nov 13 14:43:45 cl-test-b pengine: [23740]: info: process_pe_message:pengine.c Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues.
> Nov 13 14:43:45 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: unpack_graph:unpack.c Unpacked transition 1: 11 actions in 11 synapses
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: te_pseudo_action:actions.c Pseudo action 8 confirmed
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: te_pseudo_action:actions.c Pseudo action 14 confirmed
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 12: IPaddr_10_128_43_133_start_0 on cl-test-a
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 3: probe_complete on cl-test-a
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 4: pingd-child:0_start_0 on cl-test-b
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 6: pingd-child:1_start_0 on cl-test-a
> Nov 13 14:43:45 cl-test-b crmd: [23730]: info: do_lrm_rsc_op:lrm.c Performing op start on pingd-child:0 (interval=0ms, key=1:d29d0e3f-f12c-4f75-9754-5a7278db944c)
> Nov 13 14:43:45 cl-test-b su: (to root) root on none
> Nov 13 14:43:45 cl-test-b crmd: [23730]: info: process_lrm_event:lrm.c LRM operation (5) start_0 on pingd-child:0 complete
> Nov 13 14:43:45 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 161112 bytes (was 158012)
> Nov 13 14:43:45 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:28): 0.1.14 -> 0.1.15 (ok)
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.14 -> 0.1.15
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:0_start_0 (4) confirmed
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 5: pingd-child:0_monitor_20000 on cl-test-b
> Nov 13 14:43:45 cl-test-b crmd: [23730]: info: do_lrm_rsc_op:lrm.c Performing op monitor on pingd-child:0 (interval=20000ms, key=1:d29d0e3f-f12c-4f75-9754-5a7278db944c)
> Nov 13 14:43:45 cl-test-b cib: [23786]: info: write_cib_contents:io.c Wrote version 0.1.15 of the CIB to disk (digest: 71642c874c0f360ff28f145763ac732e)
> Nov 13 14:43:45 cl-test-b crmd: [23730]: info: process_lrm_event:lrm.c LRM operation (6) monitor_20000 on pingd-child:0 complete
> Nov 13 14:43:45 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 164212 bytes (was 161112)
> Nov 13 14:43:45 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23730, call:29): 0.1.15 -> 0.1.16 (ok)
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.15 -> 0.1.16
> Nov 13 14:43:45 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:0_monitor_20000 (5) confirmed
> Nov 13 14:43:45 cl-test-b cib: [23791]: info: write_cib_contents:io.c Wrote version 0.1.16 of the CIB to disk (digest: cde454d96335acb782ebee88ccaa07cf)
> Nov 13 14:43:46 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 171644 bytes (was 164212)
> Nov 13 14:43:46 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:19): 0.1.16 -> 0.1.17 (ok)
> Nov 13 14:43:46 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.16 -> 0.1.17
> Nov 13 14:43:46 cl-test-b tengine: [23739]: info: extract_event:events.c Aborting on transient_attributes changes
> Nov 13 14:43:46 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort priority upgraded to 1000000
> Nov 13 14:43:46 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort action 0 superceeded by 2
> Nov 13 14:43:46 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:20): 0.1.17 -> 0.1.18 (ok)
> Nov 13 14:43:46 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.17 -> 0.1.18
> Nov 13 14:43:46 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 174744 bytes (was 171644)
> Nov 13 14:43:46 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:21): 0.1.18 -> 0.1.19 (ok)
> Nov 13 14:43:46 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.18 -> 0.1.19
> Nov 13 14:43:46 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action IPaddr_10_128_43_133_start_0 (12) confirmed
> Nov 13 14:43:46 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 177844 bytes (was 174744)
> Nov 13 14:43:46 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:22): 0.1.19 -> 0.1.20 (ok)
> Nov 13 14:43:46 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.19 -> 0.1.20
> Nov 13 14:43:46 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ]
> Nov 13 14:43:46 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:1_start_0 (6) confirmed
> Nov 13 14:43:46 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c All 2 cluster nodes are eligable to run resources.
> Nov 13 14:43:46 cl-test-b tengine: [23739]: info: te_pseudo_action:actions.c Pseudo action 9 confirmed
> Nov 13 14:43:46 cl-test-b tengine: [23739]: info: run_graph:graph.c ====================================================
> Nov 13 14:43:46 cl-test-b tengine: [23739]: notice: run_graph:graph.c Transition 1: (Complete=8, Pending=0, Fired=0, Skipped=3, Incomplete=0)
> Nov 13 14:43:46 cl-test-b cib: [23792]: info: write_cib_contents:io.c Wrote version 0.1.20 of the CIB to disk (digest: 437424767bf2a91647c968e6f6c783c6)
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: process_pe_message: [generation] <cib admin_epoch="0" epoch="1" num_updates="20" have_quorum="true" generated="true" num_peers="2" ccm_transition="2" cib_feature_revision="1.3" dc_uuid="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08"/>
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default stickiness: 40
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default failure stickiness: 0
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH of failed nodes is disabled
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH will reboot nodes
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Cluster is symmetric - resources can run anywhere by default
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c On loss of CCM Quorum: Stop ALL resources
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resources are stopped
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resource actions are stopped
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Stopped resources are removed from the status section: false
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: unpack_config:unpack.c By default resources are managed
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-b is online
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-a is online
> Nov 13 14:43:46 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-b did not have a value for pingd
> Nov 13 14:43:46 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
> Nov 13 14:43:46 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-b did not have a value for pingd
> Nov 13 14:43:46 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: Clone Set: pingd
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: pingd-child:0 (heartbeat::ocf:pingd): Started cl-test-b
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: pingd-child:1 (heartbeat::ocf:pingd): Started cl-test-a
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: Resource Group: group_1
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: IPaddr_10_128_43_133 (heartbeat::ocf:IPaddr): Started cl-test-a
> Nov 13 14:43:46 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Leave resource pingd-child:0 (cl-test-b)
> Nov 13 14:43:46 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Leave resource pingd-child:1 (cl-test-a)
> Nov 13 14:43:46 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-a pingd-child:1_monitor_20000
> Nov 13 14:43:46 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Leave resource IPaddr_10_128_43_133 (cl-test-a)
> Nov 13 14:43:46 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-a IPaddr_10_128_43_133_monitor_5000
> Nov 13 14:43:46 cl-test-b pengine: [23740]: notice: stage8:allocate.c Created transition graph 2.
> Nov 13 14:43:46 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c No value specified for cluster preference: pe-warn-series-max
> Nov 13 14:43:46 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
> Nov 13 14:43:46 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c Transition 2: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-63.bz2
> Nov 13 14:43:46 cl-test-b tengine: [23739]: info: unpack_graph:unpack.c Unpacked transition 2: 2 actions in 2 synapses
> Nov 13 14:43:46 cl-test-b pengine: [23740]: info: process_pe_message:pengine.c Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues.
> Nov 13 14:43:46 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 9: pingd-child:1_monitor_20000 on cl-test-a
> Nov 13 14:43:46 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 16: IPaddr_10_128_43_133_monitor_5000 on cl-test-a
> Nov 13 14:43:47 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 180944 bytes (was 177844)
> Nov 13 14:43:47 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:23): 0.1.20 -> 0.1.21 (ok)
> Nov 13 14:43:47 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.20 -> 0.1.21
> Nov 13 14:43:47 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action pingd-child:1_monitor_20000 (9) confirmed
> Nov 13 14:43:48 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 184076 bytes (was 180944)
> Nov 13 14:43:48 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:24): 0.1.21 -> 0.1.22 (ok)
> Nov 13 14:43:48 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.21 -> 0.1.22
> Nov 13 14:43:48 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action IPaddr_10_128_43_133_monitor_5000 (16) confirmed
> Nov 13 14:43:48 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGEorigin=route_message ]
> Nov 13 14:43:48 cl-test-b tengine: [23739]: info: run_graph:graph.c Transition 2: (Complete=2, Pending=0, Fired=0, Skipped=0, Incomplete=0)
> Nov 13 14:43:48 cl-test-b tengine: [23739]: info: notify_crmd:actions.c Transition 2 status: te_complete - (null)
> Nov 13 14:43:48 cl-test-b cib: [23793]: info: write_cib_contents:io.c Wrote version 0.1.22 of the CIB to disk (digest: 395a72d325e9ccd2b46088ca9d241b9f)
> Nov 13 14:43:50 cl-test-b pingd: [23785]: info: do_node_walk:pingd.c Requesting the list of configured nodes
> Nov 13 14:43:51 cl-test-b heartbeat: [23715]: WARN: 1 lost packet(s) for [cl-test-a] [56:58]
> Nov 13 14:43:51 cl-test-b heartbeat: [23715]: info: No pkts missing from cl-test-a!
> Nov 13 14:43:52 cl-test-b pingd: [23785]: info: send_update:pingd.c 1 active ping nodes
> Nov 13 14:43:52 cl-test-b pingd: [23785]: info: main:pingd.c Starting pingd
> Nov 13 14:43:52 cl-test-b attrd: [23729]: info: find_hash_entry:attrd.c Creating hash entry for pingd
> Nov 13 14:43:57 cl-test-b attrd: [23729]: info: attrd_timer_callback:attrd.c Sending flush op to all hosts for: pingd
> Nov 13 14:43:57 cl-test-b attrd: [23729]: info: attrd_ha_callback:attrd.c flush message from cl-test-a
> Nov 13 14:43:57 cl-test-b attrd: [23729]: info: attrd_ha_callback:attrd.c Sent update 2: pingd=110
> Nov 13 14:43:57 cl-test-b attrd: [23729]: info: attrd_ha_callback:attrd.c flush message from cl-test-b
> Nov 13 14:43:57 cl-test-b attrd: [23729]: info: attrd_ha_callback:attrd.c Sent update 3: pingd=110
> Nov 13 14:43:57 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 186152 bytes (was 184076)
> Nov 13 14:43:57 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23729, call:2): 0.1.22 -> 0.1.23 (ok)
> Nov 13 14:43:57 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.22 -> 0.1.23
> Nov 13 14:43:57 cl-test-b tengine: [23739]: info: extract_event:events.c Aborting on transient_attributes changes
> Nov 13 14:43:57 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort priority upgraded to 1000000
> Nov 13 14:43:57 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ]
> Nov 13 14:43:57 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c All 2 cluster nodes are eligable to run resources.
> Nov 13 14:43:57 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 23729, call:3): 0.1.23 -> 0.1.24 (ok)
> Nov 13 14:43:57 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.23 -> 0.1.24
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: process_pe_message: [generation] <cib admin_epoch="0" epoch="1" num_updates="23" have_quorum="true" generated="true" num_peers="2" ccm_transition="2" cib_feature_revision="1.3" dc_uuid="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08"/>
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default stickiness: 40
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default failure stickiness: 0
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH of failed nodes is disabled
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH will reboot nodes
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Cluster is symmetric - resources can run anywhere by default
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c On loss of CCM Quorum: Stop ALL resources
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resources are stopped
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resource actions are stopped
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Stopped resources are removed from the status section: false
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: unpack_config:unpack.c By default resources are managed
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-b is online
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-a is online
> Nov 13 14:43:57 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
> Nov 13 14:43:57 cl-test-b pengine: [23740]: WARN: generate_location_rule:allocate.c node cl-test-a did not have a value for pingd
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: Clone Set: pingd
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: pingd-child:0 (heartbeat::ocf:pingd): Started cl-test-b
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: pingd-child:1 (heartbeat::ocf:pingd): Started cl-test-a
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: Resource Group: group_1
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: IPaddr_10_128_43_133 (heartbeat::ocf:IPaddr): Started cl-test-a
> Nov 13 14:43:57 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Leave resource pingd-child:0 (cl-test-b)
> Nov 13 14:43:57 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Leave resource pingd-child:1 (cl-test-a)
> Nov 13 14:43:57 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Move resource IPaddr_10_128_43_133 (cl-test-a -> cl-test-b)
> Nov 13 14:43:57 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-b IPaddr_10_128_43_133_monitor_5000
> Nov 13 14:43:57 cl-test-b pengine: [23740]: notice: stage8:allocate.c Created transition graph 3.
> Nov 13 14:43:57 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c No value specified for cluster preference: pe-warn-series-max
> Nov 13 14:43:57 cl-test-b cib: [23794]: info: write_cib_contents:io.c Wrote version 0.1.24 of the CIB to disk (digest: ba9b3c5fca67a2a0e68b5af972cf423a)
> Nov 13 14:43:57 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
> Nov 13 14:43:57 cl-test-b tengine: [23739]: info: unpack_graph:unpack.c Unpacked transition 3: 7 actions in 7 synapses
> Nov 13 14:43:57 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c Transition 3: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-64.bz2
> Nov 13 14:43:57 cl-test-b pengine: [23740]: info: process_pe_message:pengine.c Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues.
> Nov 13 14:43:57 cl-test-b tengine: [23739]: info: te_pseudo_action:actions.c Pseudo action 20 confirmed
> Nov 13 14:43:57 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 15: IPaddr_10_128_43_133_stop_0 on cl-test-a
> Nov 13 14:43:58 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 188228 bytes (was 186152)
> Nov 13 14:43:58 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17001, call:2): 0.1.24 -> 0.1.25 (ok)
> Nov 13 14:43:58 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.24 -> 0.1.25
> Nov 13 14:43:58 cl-test-b tengine: [23739]: info: extract_event:events.c Aborting on transient_attributes changes
> Nov 13 14:43:58 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort priority upgraded to 1000000
> Nov 13 14:43:58 cl-test-b tengine: [23739]: info: update_abort_priority:utils.c Abort action 0 superceeded by 2
> Nov 13 14:43:58 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17001, call:3): 0.1.25 -> 0.1.26 (ok)
> Nov 13 14:43:58 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.25 -> 0.1.26
> Nov 13 14:43:58 cl-test-b cib: [23795]: info: write_cib_contents:io.c Wrote version 0.1.26 of the CIB to disk (digest: 4db1b37fcdf615a0464af1f8a4161ccf)
> Nov 13 14:43:59 cl-test-b cib: [23726]: info: activateCibXml:io.c CIB size is 191328 bytes (was 188228)
> Nov 13 14:43:59 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:25): 0.1.26 -> 0.1.27 (ok)
> Nov 13 14:43:59 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.26 -> 0.1.27
> Nov 13 14:43:59 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action IPaddr_10_128_43_133_stop_0 (15) confirmed
> Nov 13 14:43:59 cl-test-b tengine: [23739]: info: run_graph:graph.c ====================================================
> Nov 13 14:43:59 cl-test-b tengine: [23739]: notice: run_graph:graph.c Transition 3: (Complete=2, Pending=0, Fired=0, Skipped=5, Incomplete=0)
> Nov 13 14:43:59 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ]
> Nov 13 14:43:59 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c All 2 cluster nodes are eligable to run resources.
> Nov 13 14:43:59 cl-test-b cib: [23796]: info: write_cib_contents:io.c Wrote version 0.1.27 of the CIB to disk (digest: 6eeb2bf36c6a643551605cfbf97db033)
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: process_pe_message: [generation] <cib admin_epoch="0" epoch="1" num_updates="27" have_quorum="true" generated="true" num_peers="2" ccm_transition="2" cib_feature_revision="1.3" dc_uuid="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08"/>
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default stickiness: 40
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Default failure stickiness: 0
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH of failed nodes is disabled
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c STONITH will reboot nodes
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Cluster is symmetric - resources can run anywhere by default
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c On loss of CCM Quorum: Stop ALL resources
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resources are stopped
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Orphan resource actions are stopped
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c Stopped resources are removed from the status section: false
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: unpack_config:unpack.c By default resources are managed
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-b is online
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: determine_online_status:unpack.c Node cl-test-a is online
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: Clone Set: pingd
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: pingd-child:0 (heartbeat::ocf:pingd): Started cl-test-b
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: pingd-child:1 (heartbeat::ocf:pingd): Started cl-test-a
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: Resource Group: group_1
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: IPaddr_10_128_43_133 (heartbeat::ocf:IPaddr): Stopped
> Nov 13 14:43:59 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Leave resource pingd-child:0 (cl-test-b)
> Nov 13 14:43:59 cl-test-b pengine: [23740]: notice: NoRoleChange:native.c Leave resource pingd-child:1 (cl-test-a)
> Nov 13 14:43:59 cl-test-b pengine: [23740]: notice: StartRsc:native.c cl-test-a Start IPaddr_10_128_43_133
> Nov 13 14:43:59 cl-test-b pengine: [23740]: notice: Recurring:native.c cl-test-a IPaddr_10_128_43_133_monitor_5000
> Nov 13 14:43:59 cl-test-b pengine: [23740]: notice: stage8:allocate.c Created transition graph 4.
> Nov 13 14:43:59 cl-test-b pengine: [23740]: WARN: process_pe_message:pengine.c No value specified for cluster preference: pe-input-series-max
> Nov 13 14:43:59 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
> Nov 13 14:43:59 cl-test-b pengine: [23740]: info: process_pe_message:pengine.c Transition 4: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-136.bz2
> Nov 13 14:43:59 cl-test-b tengine: [23739]: info: unpack_graph:unpack.c Unpacked transition 4: 4 actions in 4 synapses
> Nov 13 14:43:59 cl-test-b tengine: [23739]: info: te_pseudo_action:actions.c Pseudo action 16 confirmed
> Nov 13 14:43:59 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 14: IPaddr_10_128_43_133_start_0 on cl-test-a
> Nov 13 14:44:01 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:26): 0.1.27 -> 0.1.28 (ok)
> Nov 13 14:44:01 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.27 -> 0.1.28
> Nov 13 14:44:01 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action IPaddr_10_128_43_133_start_0 (14) confirmed
> Nov 13 14:44:01 cl-test-b tengine: [23739]: info: te_pseudo_action:actions.c Pseudo action 17 confirmed
> Nov 13 14:44:01 cl-test-b tengine: [23739]: info: send_rsc_command:actions.c Initiating action 15: IPaddr_10_128_43_133_monitor_5000 on cl-test-a
> Nov 13 14:44:01 cl-test-b cib: [23797]: info: write_cib_contents:io.c Wrote version 0.1.28 of the CIB to disk (digest: 5ff44be3368b6377e71e5488f93f8db5)
> Nov 13 14:44:02 cl-test-b cib: [23726]: info: cib_diff_notify:notify.c Update (client: 17002, call:27): 0.1.28 -> 0.1.29 (ok)
> Nov 13 14:44:02 cl-test-b tengine: [23739]: info: te_update_diff:callbacks.c Processing diff (cib_update): 0.1.28 -> 0.1.29
> Nov 13 14:44:02 cl-test-b tengine: [23739]: info: match_graph_event:events.c Action IPaddr_10_128_43_133_monitor_5000 (15) confirmed
> Nov 13 14:44:02 cl-test-b crmd: [23730]: info: do_state_transition:fsa.c cl-test-b: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGEorigin=route_message ]
> Nov 13 14:44:02 cl-test-b tengine: [23739]: info: run_graph:graph.c Transition 4: (Complete=4, Pending=0, Fired=0, Skipped=0, Incomplete=0)
> Nov 13 14:44:02 cl-test-b tengine: [23739]: info: notify_crmd:actions.c Transition 4 status: te_complete - (null)
> Nov 13 14:44:02 cl-test-b cib: [23798]: info: write_cib_contents:io.c Wrote version 0.1.29 of the CIB to disk (digest: 2eba33708fd092ba42a4742f297a8bd8)
> Nov 13 14:53:17 cl-test-b cib: [23726]: info: cib_stats:main.c Processed 47 operations (8723.00us average, 0% utilization) in the last 10min
>
>
>
> <cib admin_epoch="0" epoch="1" num_updates="23" have_quorum="true" generated="true" num_peers="2" ccm_transition="2" cib_feature_revision="1.3" dc_uuid="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08" cib-last-written="Mon Nov 13 14:43:57 2006">
> <configuration>
> <crm_config>
> <cluster_property_set id="cib-bootstrap-options">
> <attributes>
> <nvpair id="cib-bootstrap-options-symmetric_cluster" name="symmetric_cluster" value="true"/>
> <nvpair id="cib-bootstrap-options-no_quorum_policy" name="no_quorum_policy" value="stop"/>
> <nvpair id="cib-bootstrap-options-default_resource_stickiness" name="default_resource_stickiness" value="40"/>
> <nvpair id="cib-bootstrap-options-default_resource_failure_stickiness" name="default_resource_failure_stickiness" value="0"/>
> <nvpair id="cib-bootstrap-options-stonith_enabled" name="stonith_enabled" value="false"/>
> <nvpair id="cib-bootstrap-options-stonith_action" name="stonith_action" value="reboot"/>
> <nvpair id="cib-bootstrap-options-stop_orphan_resources" name="stop_orphan_resources" value="true"/>
> <nvpair id="cib-bootstrap-options-stop_orphan_actions" name="stop_orphan_actions" value="true"/>
> <nvpair id="cib-bootstrap-options-remove_after_stop" name="remove_after_stop" value="false"/>
> <nvpair id="cib-bootstrap-options-short_resource_names" name="short_resource_names" value="true"/>
> <nvpair id="cib-bootstrap-options-transition_idle_timeout" name="transition_idle_timeout" value="5min"/>
> <nvpair id="cib-bootstrap-options-default_action_timeout" name="default_action_timeout" value="10s"/>
> <nvpair id="cib-bootstrap-options-is_managed_default" name="is_managed_default" value="true"/>
> </attributes>
> </cluster_property_set>
> </crm_config>
> <nodes>
> <node id="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08" uname="cl-test-b" type="normal"/>
> <node id="8f29b378-e694-4c8f-b4ad-9385db258ab7" uname="cl-test-a" type="normal"/>
> </nodes>
> <resources>
> <clone id="pingd">
> <instance_attributes id="pingd_instance_attrs">
> <attributes>
> <nvpair id="pingd-clone_max" name="clone_max" value="2"/>
> <nvpair id="pingd-clone_node_max" name="clone_node_max" value="1"/>
> </attributes>
> </instance_attributes>
> <primitive class="ocf" type="pingd" provider="heartbeat" id="pingd-child">
> <instance_attributes id="pingd-child_instance_attrs">
> <attributes>
> <nvpair id="pingd-dampen" name="dampen" value="5s"/>
> <nvpair id="pingd-multiplier" name="multiplier" value="110"/>
> <nvpair id="pingd-pidfile" name="pidfile" value="/var/run/pingd.pid"/>
> <nvpair id="pingd-user" name="user" value="root"/>
> </attributes>
> </instance_attributes>
> <operations>
> <op name="monitor" id="pingd-monitor" interval="20s" timeout="40s"/>
> <op id="pingd-start" name="start" prereq="nothing"/>
> </operations>
> </primitive>
> </clone>
> <group id="group_1">
> <primitive class="ocf" id="IPaddr_10_128_43_133" provider="heartbeat" type="IPaddr">
> <operations>
> <op id="IPaddr_10_128_43_133_mon" interval="5s" name="monitor" timeout="5s"/>
> </operations>
> <instance_attributes id="IPaddr_10_128_43_133_inst_attr">
> <attributes>
> <nvpair id="IPaddr_10_128_43_133_attr_0" name="ip" value="10.128.43.133"/>
> </attributes>
> </instance_attributes>
> </primitive>
> </group>
> </resources>
> <constraints>
> <rsc_location id="rsc_location_group_1" rsc="group_1">
> <rule id="cl-test-a_location_group_1" score="100">
> <expression attribute="#uname" id="cl-test-a_location_group_1_expr" operation="eq" value="cl-test-a"/>
> </rule>
> <rule id="cl-test-b_location_group_1" score="99">
> <expression attribute="#uname" id="cl-test-b_location_group_1_expr" operation="eq" value="cl-test-b"/>
> </rule>
> <rule id="my_resource:connected:rule" score_attribute="pingd" boolean_op="and">
> <expression id="my_resource:connected:expr:defined" attribute="pingd" operation="defined"/>
> <expression id="my_resource:connected:expr:positive" attribute="pingd" operation="gt" value="100"/>
> </rule>
> </rsc_location>
> </constraints>
> </configuration>
> <status>
> <node_state id="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08" uname="cl-test-b" crmd="online" crm-debug-origin="do_update_resource" shutdown="0" in_ccm="true" ha="active" join="member" expected="member">
> <lrm id="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08">
> <lrm_resources>
> <lrm_resource id="pingd-child:0" type="pingd" class="ocf" provider="heartbeat">
> <lrm_rsc_op id="pingd-child:0_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" transition_key="0:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="4:7;0:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="2" crm_feature_set="1.0.6" rc_code="7" op_status="4" interval="0" op_digest="bf303b7f80e362fc036db05984752c02"/>
> <lrm_rsc_op id="pingd-child:0_start_0" operation="start" crm-debug-origin="do_update_resource" transition_key="1:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="0:0;1:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="5" crm_feature_set="1.0.6" rc_code="0" op_status="0" interval="0" op_digest="bf303b7f80e362fc036db05984752c02"/>
> <lrm_rsc_op id="pingd-child:0_monitor_20000" operation="monitor" crm-debug-origin="do_update_resource" transition_key="1:d29d0e3f-f12c-4f75-9754-5a7278db944c"transition_magic="0:0;1:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="6" crm_feature_set="1.0.6" rc_code="0" op_status="0" interval="20000" op_digest="bf303b7f80e362fc036db05984752c02"/>
> </lrm_resource>
> <lrm_resource id="pingd-child:1" type="pingd" class="ocf" provider="heartbeat">
> <lrm_rsc_op id="pingd-child:1_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" transition_key="0:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="4:7;0:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="3" crm_feature_set="1.0.6" rc_code="7" op_status="4" interval="0" op_digest="bf303b7f80e362fc036db05984752c02"/>
> </lrm_resource>
> <lrm_resource id="IPaddr_10_128_43_133" type="IPaddr" class="ocf" provider="heartbeat">
> <lrm_rsc_op id="IPaddr_10_128_43_133_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" transition_key="0:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="4:7;0:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="4" crm_feature_set="1.0.6" rc_code="7" op_status="4" interval="0" op_digest="5744868951ed70ff6e8258604bfe0ff2"/>
> </lrm_resource>
> </lrm_resources>
> </lrm>
> <transient_attributes id="4f1f4cbc-5fe9-4828-bca2-6d92a5254b08">
> <instance_attributes id="status-4f1f4cbc-5fe9-4828-bca2-6d92a5254b08">
> <attributes>
> <nvpair id="status-4f1f4cbc-5fe9-4828-bca2-6d92a5254b08-probe_complete" name="probe_complete" value="true"/>
> <nvpair id="status-4f1f4cbc-5fe9-4828-bca2-6d92a5254b08-pingd" name="pingd" value="110"/>
> </attributes>
> </instance_attributes>
> </transient_attributes>
> </node_state>
> <node_state id="8f29b378-e694-4c8f-b4ad-9385db258ab7" uname="cl-test-a" crmd="online" crm-debug-origin="do_update_resource" shutdown="0" in_ccm="true" ha="active" join="member" expected="member">
> <lrm id="8f29b378-e694-4c8f-b4ad-9385db258ab7">
> <lrm_resources>
> <lrm_resource id="pingd-child:0" type="pingd" class="ocf" provider="heartbeat">
> <lrm_rsc_op id="pingd-child:0_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" transition_key="0:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="4:7;0:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="2" crm_feature_set="1.0.6" rc_code="7" op_status="4" interval="0" op_digest="bf303b7f80e362fc036db05984752c02"/>
> </lrm_resource>
> <lrm_resource id="pingd-child:1" type="pingd" class="ocf" provider="heartbeat">
> <lrm_rsc_op id="pingd-child:1_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" transition_key="0:d29d0e3f-f12c-4f75-9754-5a7278db944c" tranition_magic="4:7;0:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="3" crm_feature_set="1.0.6" rc_code="7" op_status="4" interval="0" op_digest="bf303b7f80e362fc036db05984752c02"/>
> <lrm_rsc_op id="pingd-child:1_start_0" operation="start" crm-debug-origin="do_update_resource" transition_key="1:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="0:0;1:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="6" crm_feature_set="1.0.6" rc_code="0" op_status="0" interval="0" op_digest="bf303b7f80e362fc036db05984752c02"/>
> <lrm_rsc_op id="pingd-child:1_monitor_20000" operation="monitor" crm-debug-origin="do_update_resource" transition_key="2:d29d0e3f-f12c-4f75-9754-5a7278db944c"transition_magic="0:0;2:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="7" crm_feature_set="1.0.6" rc_code="0" op_status="0" interval="20000" op_digest="bf303b7f80e362fc036db05984752c02"/>
> </lrm_resource>
> <lrm_resource id="IPaddr_10_128_43_133" type="IPaddr" class="ocf" provider="heartbeat">
> <lrm_rsc_op id="IPaddr_10_128_43_133_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" transition_key="0:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="4:7;0:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="4" crm_feature_set="1.0.6" rc_code="7" op_status="4" interval="0" op_digest="5744868951ed70ff6e8258604bfe0ff2"/>
> <lrm_rsc_op id="IPaddr_10_128_43_133_start_0" operation="start" crm-debug-origin="do_update_resource" transition_key="1:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="0:0;1:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="5" crm_feature_set="1.0.6" rc_code="0" op_status="0" interval="0" op_digest="5744868951ed70ff6e8258604bfe0ff2"/>
> <lrm_rsc_op id="IPaddr_10_128_43_133_monitor_5000" operation="monitor" crm-debug-origin="do_update_resource" transition_key="2:d29d0e3f-f12c-4f75-9754-5a7278db944c" transition_magic="0:0;2:d29d0e3f-f12c-4f75-9754-5a7278db944c" call_id="8" crm_feature_set="1.0.6" rc_code="0" op_status="0" interval="5000" op_digest="5744868951ed70ff6e8258604bfe0ff2"/>
> </lrm_resource>
> </lrm_resources>
> </lrm>
> <transient_attributes id="8f29b378-e694-4c8f-b4ad-9385db258ab7">
> <instance_attributes id="status-8f29b378-e694-4c8f-b4ad-9385db258ab7">
> <attributes>
> <nvpair id="status-8f29b378-e694-4c8f-b4ad-9385db258ab7-probe_complete" name="probe_complete" value="true"/>
> </attributes>
> </instance_attributes>
> </transient_attributes>
> </node_state>
> </status>
> </cib>
>
>
>
> _______________________________________________
> Linux-HA mailing list
> Linux-HA at lists.linux-ha.org
> http://lists.linux-ha.org/mailman/listinfo/linux-ha
> See also: http://linux-ha.org/ReportingProblems
>
>
>
More information about the Linux-HA
mailing list