[Linux-HA] crm_mon confused?
Ian Turner
vectro at vectro.org
Wed Oct 31 12:51:26 MDT 2007
> From: Dejan Muhamedagic <dejanmm at fastmail.fm>
>
> Not only crm_mon, but also cibadmin produces a CIB with a
> surprisingly short status section. Something's very wrong on that
> node. Can't say what without the logs. Did you take a look there?
I have attached the logs from a startup of heartbeat after a clean shutdown.
Heartbeat logs are so verbose I have a hard time discerning anything from
them, but maybe you can see something.
> NB: The constraint you defined is a odd. The rule evaluates to
> true if the #uname attribute is defined which is always true.
That is there so that even if crm_failcount=100 for a node, the
resource_failure_stickiness will not bring the total score below zero. I want
services to keep running if possible; if there is a better way, I'd love to
hear it.
Cheers,
--Ian
-------------- next part --------------
Oct 31 11:42:01 brutus /USR/SBIN/CRON[18768]: (hacluster) CMD (/usr/lib/heartbeat/update-status)
Oct 31 11:42:17 brutus logd: [18784]: info: logd started with default configuration.
Oct 31 11:42:17 brutus logd: [18784]: WARN: Core dumps could be lost if multiple dumps occur
Oct 31 11:42:17 brutus logd: [18784]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
Oct 31 11:42:17 brutus logd: [18785]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Oct 31 11:42:17 brutus logd: [18784]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Oct 31 11:42:17 brutus heartbeat: [18805]: info: Enabling logging daemon
Oct 31 11:42:17 brutus heartbeat: [18805]: info: logfile and debug file are those specified in logd config file (default /etc/logd.cf)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: uid=hacluster, gid=<null>
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: uid=hacluster, gid=<null>
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: uid=<null>, gid=haclient
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: uid=root, gid=<null>
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: uid=<null>, gid=haclient
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: Beginning authentication parsing
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: 16 max authentication methods
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: Keyfile opened
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: Keyfile perms OK
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: 16 max authentication methods
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: Found authentication method [md5]
Oct 31 11:42:17 brutus heartbeat: [18805]: info: AUTH: i=1: key = 0x80f3818, auth=0x403a6af8, authname=md5
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: Outbound signing method is 1
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: Authentication parsing complete [1]
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(cluster,linux-ha)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(hopfudge,1)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(baud,19200)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(hbgenmethod,file)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(realtime,true)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(msgfmt,classic)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(conn_logd_time,60)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(log_badpack,true)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(coredumps,true)
Oct 31 11:42:17 brutus heartbeat: [18805]: WARN: Core dumps could be lost if multiple dumps occur
Oct 31 11:42:17 brutus heartbeat: [18805]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(autojoin,none)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(uuidfrom,file)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(compression,zlib)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(compression_threshold,2)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(traditional_compression,no)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(max_rexmit_delay,250)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: Setting max_rexmit_delay to 250 ms
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(record_config_changes,on)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(record_pengine_inputs,on)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(enable_config_writes,on)
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: add_option(memreserve,6500)
Oct 31 11:42:17 brutus heartbeat: [18805]: info: **************************
Oct 31 11:42:17 brutus heartbeat: [18805]: info: Configuration validated. Starting heartbeat 2.0.7
Oct 31 11:42:17 brutus heartbeat: [18805]: debug: HA configuration OK. Heartbeat starting.
Oct 31 11:42:17 brutus heartbeat: [18806]: info: heartbeat: version 2.0.7
Oct 31 11:42:17 brutus heartbeat: [18806]: info: Heartbeat generation: 103
Oct 31 11:42:17 brutus heartbeat: [18806]: debug: uuid is:787dd4cd-f84b-4310-8a39-622c8f3e2f06
Oct 31 11:42:17 brutus heartbeat: [18806]: info: G_main_add_TriggerHandler: Added signal manual handler
Oct 31 11:42:17 brutus heartbeat: [18806]: info: G_main_add_TriggerHandler: Added signal manual handler
Oct 31 11:42:17 brutus heartbeat: [18806]: info: Removing /var/run/heartbeat/rsctmp failed, recreating.
Oct 31 11:42:17 brutus heartbeat: [18806]: debug: opening ucast eth0 (UDP/IP unicast)
Oct 31 11:42:17 brutus heartbeat: [18806]: debug: FIFO process pid: 18813
Oct 31 11:42:17 brutus heartbeat: [18806]: info: glib: ucast: write socket priority set to IPTOS_LOWDELAY on eth0
Oct 31 11:42:17 brutus heartbeat: [18806]: info: glib: ucast: bound send socket to device: eth0
Oct 31 11:42:17 brutus heartbeat: [18806]: info: glib: ucast: bound receive socket to device: eth0
Oct 31 11:42:17 brutus heartbeat: [18806]: info: glib: ucast: started on port 694 interface eth0 to 172.16.59.3
Oct 31 11:42:17 brutus heartbeat: [18806]: debug: write process pid: 18814
Oct 31 11:42:17 brutus heartbeat: [18806]: debug: read child process pid: 18815
Oct 31 11:42:17 brutus heartbeat: [18806]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Oct 31 11:42:17 brutus heartbeat: [18806]: debug: Limiting CPU: 42 CPU seconds every 60000 milliseconds
Oct 31 11:42:17 brutus heartbeat: [18806]: debug: pid 18806 locked in memory.
Oct 31 11:42:17 brutus heartbeat: [18806]: debug: Waiting for child processes to start
Oct 31 11:42:17 brutus heartbeat: [18806]: info: Local status now set to: 'up'
Oct 31 11:42:17 brutus heartbeat: [18806]: debug: All your child process are belong to us
Oct 31 11:42:17 brutus heartbeat: [18806]: debug: Starting local status message @ 1500 ms intervals
Oct 31 11:42:18 brutus heartbeat: [18813]: debug: pid 18813 locked in memory.
Oct 31 11:42:18 brutus heartbeat: [18813]: debug: Limiting CPU: 6 CPU seconds every 60000 milliseconds
Oct 31 11:42:18 brutus heartbeat: [18814]: debug: pid 18814 locked in memory.
Oct 31 11:42:18 brutus heartbeat: [18814]: debug: Limiting CPU: 24 CPU seconds every 60000 milliseconds
Oct 31 11:42:18 brutus heartbeat: [18815]: debug: pid 18815 locked in memory.
Oct 31 11:42:18 brutus heartbeat: [18815]: debug: Limiting CPU: 6 CPU seconds every 60000 milliseconds
Oct 31 11:42:18 brutus heartbeat: [18806]: info: Link anthony:eth0 up.
Oct 31 11:42:18 brutus heartbeat: [18806]: info: Status update for node anthony: status active
Oct 31 11:42:18 brutus heartbeat: [18806]: debug: Status seqno: 41221 msgtime: 1193856138
Oct 31 11:42:18 brutus heartbeat: [18806]: debug: sending reqnodes msg to node anthony
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: Get a repnodes msg from anthony
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: nodelist received:brutus anthony
Oct 31 11:42:19 brutus heartbeat: [18806]: info: Comm_now_up(): updating status to active
Oct 31 11:42:19 brutus heartbeat: [18806]: info: Local status now set to: 'active'
Oct 31 11:42:19 brutus heartbeat: [18806]: info: Starting child client "/usr/lib/heartbeat/ccm" (1001,105)
Oct 31 11:42:19 brutus heartbeat: [18806]: info: Starting child client "/usr/lib/heartbeat/cib" (1001,105)
Oct 31 11:42:19 brutus heartbeat: [18806]: info: Starting child client "/usr/lib/heartbeat/lrmd" (0,0)
Oct 31 11:42:19 brutus heartbeat: [18806]: info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0)
Oct 31 11:42:19 brutus heartbeat: [18806]: info: Starting child client "/usr/lib/heartbeat/attrd" (1001,105)
Oct 31 11:42:19 brutus heartbeat: [18806]: info: Starting child client "/usr/lib/heartbeat/crmd" (1001,105)
Oct 31 11:42:19 brutus heartbeat: [18806]: info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0)
Oct 31 11:42:19 brutus heartbeat: [18819]: info: Starting "/usr/lib/heartbeat/ccm" as uid 1001 gid 105 (pid 18819)
Oct 31 11:42:19 brutus ccm: [18819]: debug: Signing in with Heartbeat
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: APIregistration_dispatch() {
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: process_registerevent() {
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: client->gsource = 0x8100a78
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: }/*process_registerevent*/;
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: }/*APIregistration_dispatch*/;
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: Checking client authorization for client ccm (1001:105)
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: create_seq_snapshot_table:no missing packets found for node brutus
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: create_seq_snapshot_table:no missing packets found for node anthony
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: Signing on API client 18819 (ccm)
Oct 31 11:42:19 brutus heartbeat: [18820]: info: Starting "/usr/lib/heartbeat/cib" as uid 1001 gid 105 (pid 18820)
Oct 31 11:42:19 brutus cib: [18820]: debug: crm_set_env_options:utils.c HA_debug = 1
Oct 31 11:42:19 brutus cib: [18820]: debug: crm_set_env_options:utils.c HA_logfacility = (null)
Oct 31 11:42:19 brutus cib: [18820]: debug: crm_set_env_options:utils.c HA_logfile = (null)
Oct 31 11:42:19 brutus cib: [18820]: debug: crm_set_env_options:utils.c HA_debugfile = (null)
Oct 31 11:42:19 brutus cib: [18820]: debug: crm_set_env_options:utils.c HA_use_logd = yes
Oct 31 11:42:19 brutus cib: [18820]: debug: crm_set_env_options:utils.c HA_conn_logd_time = 60
Oct 31 11:42:19 brutus cib: [18820]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Oct 31 11:42:19 brutus cib: [18820]: info: G_main_add_TriggerHandler: Added signal manual handler
Oct 31 11:42:19 brutus cib: [18820]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Oct 31 11:42:19 brutus cib: [18820]: info: main:main.c Retrieval of a per-action CIB: disabled
Oct 31 11:42:19 brutus cib: [18820]: info: cib_register_ha:main.c Signing in with Heartbeat
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: APIregistration_dispatch() {
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: process_registerevent() {
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: client->gsource = 0x81026d8
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: }/*process_registerevent*/;
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: }/*APIregistration_dispatch*/;
Oct 31 11:42:19 brutus ccm: [18819]: info: Hostname: brutus
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: Checking client authorization for client cib (1001:105)
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: create_seq_snapshot_table:no missing packets found for node brutus
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: create_seq_snapshot_table:no missing packets found for node anthony
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: Signing on API client 18820 (cib)
Oct 31 11:42:19 brutus cib: [18820]: info: cib_register_ha:main.c FSA Hostname: brutus
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile:io.c Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml
Oct 31 11:42:19 brutus cib: [18820]: debug: validate_cib_digest:io.c Digest comparision passed: 93076a8ce1bef90197ceec99ef8304da
Oct 31 11:42:19 brutus cib: [18820]: debug: update_quorum:io.c CCM quorum: old=true, new=false
Oct 31 11:42:19 brutus cib: [18820]: debug: readCibXmlFile:io.c Counters updated
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <cib generated="false" have_quorum="false" num_peers="2" cib_feature_revision="1" crm_feature_set="1.0.4" admin_epoch="22" epoch="247" num_updates="12335" cib-last-written="Tue Oct 30 19:35:34 2007" ccm_transition="54">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <configuration>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <crm_config>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <cluster_property_set id="cib-bootstrap-options">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nvpair name="no_quorum_policy" value="ignore" id="58104902-dcb7-49e6-85a2-efe1c09357f5"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nvpair name="default_resource_stickiness" value="1" id="52496a4e-0ed4-4bd9-8611-1bc577dae251"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nvpair name="default_resource_failure_stickiness" value="-8" id="7df1d8d0-1c25-4d4c-a263-af034168e658"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nvpair name="short_resource_names" value="TRUE" id="5258ba1e-c160-4358-9ca8-3d7462c4c40b"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-last-lrm-refresh" name="last-lrm-refresh" value="1167796376"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </cluster_property_set>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </crm_config>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nodes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <node uname="anthony" id="674f0b6c-4ea1-46fe-b393-1800e0e590f0" type="normal">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <instance_attributes id="nodes-674f0b6c-4ea1-46fe-b393-1800e0e590f0">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <attributes/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </instance_attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </node>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <node id="787dd4cd-f84b-4310-8a39-622c8f3e2f06" uname="brutus" type="normal">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <instance_attributes id="nodes-787dd4cd-f84b-4310-8a39-622c8f3e2f06">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <attributes/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </instance_attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </node>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </nodes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <resources>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <group id="fileserver">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <instance_attributes id="group_attributes">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nvpair name="target_role" value="Started" id="uuid-target-role"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </instance_attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <primitive id="ip" class="ocf" type="IPaddr" provider="heartbeat">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <instance_attributes id="ip_attributes">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nvpair name="nic" value="eth0" id="d8c083f0-34b4-4eb3-8784-ee0f060c8646"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nvpair name="ip" value="172.16.59.10" id="eb4b0bea-e323-4865-9745-ab2895b6a8bd"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nvpair name="netmask" value="24" id="a757221e-6bc5-44b1-bd22-269c89f3a944"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nvpair name="broadcast" value="172.16.59.255" id="98833b70-4609-486f-b407-a1975afc6c66"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </instance_attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </primitive>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <primitive id="drbd" class="heartbeat" type="drbddisk" provider="heartbeat">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <instance_attributes id="drbd_attributes">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nvpair name="1" value="r0" id="85d6e802-a5be-42ca-ac2b-c2dbc218dfeb"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </instance_attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </primitive>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <primitive id="rep" class="ocf" type="Filesystem" provider="heartbeat">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <instance_attributes id="rep_attributes">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nvpair name="device" value="/dev/drbd0" id="35d95883-3687-4736-a789-231f8e4ad917"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nvpair name="directory" value="/rep" id="fd48accf-5250-4a0f-b8d7-3dd10461e057"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nvpair name="fstype" value="ext3" id="93ef51ce-6323-403e-982f-be99d221c753"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <nvpair name="options" value="nodev,nosuid,noatime" id="869edb95-b85d-47af-95b3-2e34932d781e"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </instance_attributes>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </primitive>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <primitive id="samba" class="lsb" type="samba" provider="heartbeat">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <operations>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <op id="sambamonitor" name="monitor" interval="50s" timeout="30s"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </operations>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </primitive>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </group>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </resources>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <constraints>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <rsc_location rsc="fileserver" id="fileserver:prefer">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <rule id="fileserver:prefer:1" score="100000">
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <expression attribute="#uname" id="fileserver:prefer:1:expr" operation="defined"/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </rule>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </rsc_location>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </constraints>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </configuration>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] <status/>
Oct 31 11:42:19 brutus cib: [18820]: info: readCibXmlFile: [on-disk] </cib>
Oct 31 11:42:19 brutus cib: [18820]: debug: set_transition:io.c CCM transition: old=54, new=(null)
Oct 31 11:42:19 brutus cib: [18820]: debug: initializeCib:io.c Counters updated
Oct 31 11:42:19 brutus cib: [18820]: info: activateCibXml:io.c CIB size is 60932 bytes (was 0)
Oct 31 11:42:19 brutus cib: [18820]: debug: crm_adjust_mem_stats:utils.c Adjusted CIB Memory usage by: 60932 bytes, 1235 allocs, 518 frees
Oct 31 11:42:19 brutus cib: [18820]: info: startCib:main.c CIB Initialization completed successfully
Oct 31 11:42:19 brutus cib: [18820]: WARN: init_start:main.c CCM Activation failed
Oct 31 11:42:19 brutus cib: [18820]: WARN: init_start:main.c CCM Connection failed 1 times (30 max)
Oct 31 11:42:19 brutus heartbeat: [18821]: info: Starting "/usr/lib/heartbeat/lrmd" as uid 0 gid 0 (pid 18821)
Oct 31 11:42:19 brutus lrmd: [18821]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Oct 31 11:42:19 brutus lrmd: [18821]: debug: LRM debug level set to 1
Oct 31 11:42:19 brutus lrmd: [18821]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Oct 31 11:42:19 brutus lrmd: [18821]: debug: Enabling coredumps
Oct 31 11:42:19 brutus lrmd: [18821]: WARN: Core dumps could be lost if multiple dumps occur
Oct 31 11:42:19 brutus lrmd: [18821]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
Oct 31 11:42:19 brutus lrmd: [18821]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Oct 31 11:42:19 brutus lrmd: [18821]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Oct 31 11:42:19 brutus lrmd: [18821]: debug: main: run the loop...
Oct 31 11:42:19 brutus lrmd: [18821]: info: Started.
Oct 31 11:42:19 brutus heartbeat: [18822]: info: Starting "/usr/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 18822)
Oct 31 11:42:19 brutus stonithd: [18822]: WARN: Core dumps could be lost if multiple dumps occur
Oct 31 11:42:19 brutus stonithd: [18822]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
Oct 31 11:42:19 brutus stonithd: [18822]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Oct 31 11:42:19 brutus stonithd: [18822]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Oct 31 11:42:19 brutus heartbeat: [18823]: info: Starting "/usr/lib/heartbeat/attrd" as uid 1001 gid 105 (pid 18823)
Oct 31 11:42:19 brutus attrd: [18823]: debug: crm_set_env_options:utils.c HA_debug = 1
Oct 31 11:42:19 brutus attrd: [18823]: debug: crm_set_env_options:utils.c HA_logfacility = (null)
Oct 31 11:42:19 brutus attrd: [18823]: debug: crm_set_env_options:utils.c HA_logfile = (null)
Oct 31 11:42:19 brutus attrd: [18823]: debug: crm_set_env_options:utils.c HA_debugfile = (null)
Oct 31 11:42:19 brutus attrd: [18823]: debug: crm_set_env_options:utils.c HA_use_logd = yes
Oct 31 11:42:19 brutus attrd: [18823]: debug: crm_set_env_options:utils.c HA_conn_logd_time = 60
Oct 31 11:42:19 brutus attrd: [18823]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Oct 31 11:42:19 brutus attrd: [18823]: debug: register_with_ha:attrd.c Signing in with Heartbeat
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: APIregistration_dispatch() {
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: process_registerevent() {
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: client->gsource = 0x8104d80
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: }/*process_registerevent*/;
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: }/*APIregistration_dispatch*/;
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: Checking client authorization for client attrd (1001:105)
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: create_seq_snapshot_table:no missing packets found for node brutus
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: create_seq_snapshot_table:no missing packets found for node anthony
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: Signing on API client 18823 (attrd)
Oct 31 11:42:19 brutus attrd: [18823]: info: register_with_ha:attrd.c Hostname: brutus
Oct 31 11:42:19 brutus heartbeat: [18824]: info: Starting "/usr/lib/heartbeat/crmd" as uid 1001 gid 105 (pid 18824)
Oct 31 11:42:19 brutus crmd: [18824]: debug: crm_set_env_options:utils.c HA_debug = 1
Oct 31 11:42:19 brutus crmd: [18824]: debug: crm_set_env_options:utils.c HA_logfacility = (null)
Oct 31 11:42:19 brutus crmd: [18824]: debug: crm_set_env_options:utils.c HA_logfile = (null)
Oct 31 11:42:19 brutus crmd: [18824]: debug: crm_set_env_options:utils.c HA_debugfile = (null)
Oct 31 11:42:19 brutus crmd: [18824]: debug: crm_set_env_options:utils.c HA_use_logd = yes
Oct 31 11:42:19 brutus crmd: [18824]: debug: crm_set_env_options:utils.c HA_conn_logd_time = 60
Oct 31 11:42:19 brutus crmd: [18824]: WARN: Core dumps could be lost if multiple dumps occur
Oct 31 11:42:19 brutus crmd: [18824]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
Oct 31 11:42:19 brutus crmd: [18824]: info: init_start:main.c Starting crmd
Oct 31 11:42:19 brutus crmd: [18824]: debug: s_crmd_fsa:fsa.c Processing I_STARTUP: [ state=S_STARTING cause=C_STARTUP origin=init_start ]
Oct 31 11:42:19 brutus crmd: [18824]: debug: actions:trace: ^I// A_LOG
Oct 31 11:42:19 brutus crmd: [18824]: debug: actions:trace: ^I// A_STARTUP
Oct 31 11:42:19 brutus crmd: [18824]: debug: do_startup:control.c Registering Signal Handlers
Oct 31 11:42:19 brutus crmd: [18824]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Oct 31 11:42:19 brutus crmd: [18824]: info: G_main_add_TriggerHandler: Added signal manual handler
Oct 31 11:42:19 brutus crmd: [18824]: debug: do_startup:control.c Init server comms
Oct 31 11:42:19 brutus crmd: [18824]: debug: do_startup:control.c Creating CIB object
Oct 31 11:42:19 brutus crmd: [18824]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Oct 31 11:42:19 brutus crmd: [18824]: debug: actions:trace: ^I// A_CIB_START
Oct 31 11:42:19 brutus stonithd: [18822]: debug: pid 18822 locked in memory.
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: APIregistration_dispatch() {
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: process_registerevent() {
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: client->gsource = 0x8105b40
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: }/*process_registerevent*/;
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: }/*APIregistration_dispatch*/;
Oct 31 11:42:19 brutus attrd: [18823]: info: register_with_ha:attrd.c UUID: 787dd4cd-f84b-4310-8a39-622c8f3e2f06
Oct 31 11:42:19 brutus attrd: [18823]: debug: main:attrd.c CIB signon attempt 0
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: Checking client authorization for client stonithd (0:0)
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: create_seq_snapshot_table:no missing packets found for node brutus
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: create_seq_snapshot_table:no missing packets found for node anthony
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: Signing on API client 18822 (stonithd)
Oct 31 11:42:19 brutus stonithd: [18822]: info: Signing in with heartbeat.
Oct 31 11:42:19 brutus stonithd: [18822]: debug: Setting message filter mode
Oct 31 11:42:19 brutus heartbeat: [18825]: info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 18825)
Oct 31 11:42:19 brutus mgmtd: [18825]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Oct 31 11:42:19 brutus mgmtd: [18825]: debug: Enabling coredumps
Oct 31 11:42:19 brutus mgmtd: [18825]: WARN: Core dumps could be lost if multiple dumps occur
Oct 31 11:42:19 brutus mgmtd: [18825]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
Oct 31 11:42:19 brutus mgmtd: [18825]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Oct 31 11:42:19 brutus mgmtd: [18825]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: APIregistration_dispatch() {
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: process_registerevent() {
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: client->gsource = 0x8108818
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: }/*process_registerevent*/;
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: }/*APIregistration_dispatch*/;
Oct 31 11:42:19 brutus stonithd: [18822]: debug: apichan=0x805fdd8
Oct 31 11:42:19 brutus stonithd: [18822]: debug: callback_chan=0x805d000
Oct 31 11:42:19 brutus stonithd: [18822]: notice: /usr/lib/heartbeat/stonithd start up successfully.
Oct 31 11:42:19 brutus stonithd: [18822]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: Checking client authorization for client mgmtd (0:0)
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: create_seq_snapshot_table:no missing packets found for node brutus
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: create_seq_snapshot_table:no missing packets found for node anthony
Oct 31 11:42:19 brutus heartbeat: [18806]: debug: Signing on API client 18825 (mgmtd)
Oct 31 11:42:19 brutus lrmd: [18821]: debug: on_msg_register:client mgmtd [18825] registered
Oct 31 11:42:19 brutus mgmtd: [18825]: info: init_crm
Oct 31 11:42:20 brutus cib: [18820]: WARN: init_start:main.c CCM Activation failed
Oct 31 11:42:20 brutus cib: [18820]: WARN: init_start:main.c CCM Connection failed 2 times (30 max)
Oct 31 11:42:20 brutus ccm: [18819]: debug: node state CCM_STATE_NONE -> CCM_STATE_NONE
Oct 31 11:42:20 brutus ccm: [18819]: debug: node state CCM_STATE_NONE -> CCM_STATE_NONE
Oct 31 11:42:20 brutus ccm: [18819]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Oct 31 11:42:21 brutus ccm: [18819]: debug: recv msg hbapi-clstat from brutus, status:join
Oct 31 11:42:21 brutus cib: [18820]: info: init_start:main.c Starting cib mainloop
Oct 31 11:42:21 brutus cib: [18827]: debug: validate_cib_digest:io.c Digest comparision passed: 93076a8ce1bef90197ceec99ef8304da
Oct 31 11:42:21 brutus cib: [18827]: info: write_cib_contents:io.c Wrote version 22.247.12335 of the CIB to disk (digest: 219cce6e551916d63c07c25959c3d265)
Oct 31 11:42:21 brutus crmd: [18824]: debug: cib_native_signon:cib_native.c Connection to CIB successful
Oct 31 11:42:21 brutus attrd: [18823]: debug: cib_native_signon:cib_native.c Connection to CIB successful
Oct 31 11:42:21 brutus crmd: [18824]: info: do_cib_control:cib.c CIB connection established
Oct 31 11:42:21 brutus heartbeat: [18806]: debug: APIregistration_dispatch() {
Oct 31 11:42:21 brutus crmd: [18824]: debug: actions:trace: ^I// A_HA_CONNECT
Oct 31 11:42:21 brutus heartbeat: [18806]: debug: process_registerevent() {
Oct 31 11:42:21 brutus cib: [18820]: info: cib_client_status_callback:callbacks.c Status update: Client brutus/cib now has status [join]
Oct 31 11:42:22 brutus crmd: [18824]: debug: register_with_ha:control.c Signing in with Heartbeat
Oct 31 11:42:22 brutus heartbeat: [18806]: debug: client->gsource = 0x8105090
Oct 31 11:42:22 brutus cib: [18820]: debug: set_connected_peers:io.c We now have 1 active peers
Oct 31 11:42:22 brutus crmd: [18824]: info: register_with_ha:control.c Hostname: brutus
Oct 31 11:42:22 brutus heartbeat: [18806]: debug: }/*process_registerevent*/;
Oct 31 11:42:22 brutus cib: [18820]: info: cib_client_status_callback:callbacks.c Status update: Client brutus/cib now has status [online]
Oct 31 11:42:22 brutus heartbeat: [18806]: debug: }/*APIregistration_dispatch*/;
Oct 31 11:42:22 brutus cib: [18820]: info: cib_null_callback:callbacks.c Setting cib_refresh_notify callbacks for crmd: on
Oct 31 11:42:22 brutus heartbeat: [18806]: debug: Checking client authorization for client crmd (1001:105)
Oct 31 11:42:22 brutus cib: [18820]: debug: parse_local_options:callbacks.c Processing locally scoped cib_query op from 18824
Oct 31 11:42:22 brutus heartbeat: [18806]: debug: create_seq_snapshot_table:no missing packets found for node brutus
Oct 31 11:42:22 brutus heartbeat: [18806]: debug: create_seq_snapshot_table:no missing packets found for node anthony
Oct 31 11:42:22 brutus heartbeat: [18806]: debug: Signing on API client 18824 (crmd)
Oct 31 11:42:22 brutus cib: [18820]: info: cib_null_callback:callbacks.c Setting cib_diff_notify callbacks for mgmtd: on
Oct 31 11:42:22 brutus cib: [18820]: info: cib_client_status_callback:callbacks.c Status update: Client anthony/cib now has status [online]
Oct 31 11:42:22 brutus crmd: [18824]: info: register_with_ha:control.c UUID: 787dd4cd-f84b-4310-8a39-622c8f3e2f06
Oct 31 11:42:22 brutus cib: [18820]: debug: set_connected_peers:io.c We now have 2 active peers
Oct 31 11:42:22 brutus crmd: [18824]: info: populate_cib_nodes:control.c Requesting the list of configured nodes
Oct 31 11:42:22 brutus mgmtd: [18825]: debug: main: run the loop...
Oct 31 11:42:22 brutus mgmtd: [18825]: info: Started.
Oct 31 11:42:22 brutus ccm: [18819]: debug: send msg CCM_TYPE_PROTOVERSION to cluster, status:(null)
Oct 31 11:42:22 brutus ccm: [18819]: debug: node state CCM_STATE_NONE -> CCM_STATE_VERSION_REQUEST
Oct 31 11:42:23 brutus ccm: [18819]: debug: recv msg CCM_TYPE_PROTOVERSION from brutus, status:[null ptr]
Oct 31 11:42:23 brutus crmd: [18824]: notice: populate_cib_nodes:control.c Node: anthony (uuid: 674f0b6c-4ea1-46fe-b393-1800e0e590f0)
Oct 31 11:42:24 brutus ccm: [18819]: debug: recv msg CCM_TYPE_PROTOVERSION_RESP from anthony, status:[null ptr]
Oct 31 11:42:24 brutus crmd: [18824]: notice: populate_cib_nodes:control.c Node: brutus (uuid: 787dd4cd-f84b-4310-8a39-622c8f3e2f06)
Oct 31 11:42:24 brutus ccm: [18819]: debug: send msg CCM_TYPE_ALIVE to cluster, status:(null)
Oct 31 11:42:24 brutus ccm: [18819]: debug: node state CCM_STATE_VERSION_REQUEST -> CCM_STATE_NEW_NODE_WAIT_FOR_MEM_LIST
Oct 31 11:42:24 brutus crmd: [18824]: info: do_ha_control:control.c Connected to Heartbeat
Oct 31 11:42:24 brutus crmd: [18824]: debug: actions:trace: ^I// A_READCONFIG
Oct 31 11:42:24 brutus crmd: [18824]: debug: actions:trace: ^I// A_LRM_CONNECT
Oct 31 11:42:24 brutus crmd: [18824]: debug: do_lrm_control:lrm.c Connecting to the LRM
Oct 31 11:42:24 brutus cib: [18820]: debug: parse_local_options:callbacks.c Processing locally scoped cib_update op from 18824
Oct 31 11:42:24 brutus cib: [18820]: debug: parse_local_options:callbacks.c Processing locally scoped cib_query op from 18824
Oct 31 11:42:24 brutus cib: [18830]: debug: validate_cib_digest:io.c Digest comparision passed: 219cce6e551916d63c07c25959c3d265
Oct 31 11:42:24 brutus cib: [18830]: info: write_cib_contents:io.c Wrote version 22.247.12335 of the CIB to disk (digest: 752581d9b783d23b28023ae1bdae9241)
Oct 31 11:42:24 brutus lrmd: [18821]: debug: on_msg_register:client crmd [18824] registered
Oct 31 11:42:24 brutus crmd: [18824]: debug: do_lrm_control:lrm.c LRM connection established
Oct 31 11:42:24 brutus crmd: [18824]: debug: actions:trace: ^I// A_CCM_CONNECT
Oct 31 11:42:24 brutus crmd: [18824]: info: do_ccm_control:ccm.c CCM connection established... waiting for first callback
Oct 31 11:42:24 brutus crmd: [18824]: debug: actions:trace: ^I// A_STARTED
Oct 31 11:42:24 brutus crmd: [18824]: info: do_started:control.c Delaying start, CCM (0000000000100000) not connected
Oct 31 11:42:24 brutus crmd: [18824]: debug: register_fsa_input_adv:messages.c Stalling the FSA pending further input: cause=C_FSA_INTERNAL
Oct 31 11:42:24 brutus crmd: [18824]: debug: s_crmd_fsa:fsa.c Exiting the FSA: queue=0, fsa_actions=0x2, stalled=true
Oct 31 11:42:24 brutus crmd: [18824]: debug: fsa_dump_inputs:utils.c Added input: 0000000000000100 (R_CIB_CONNECTED)
Oct 31 11:42:24 brutus crmd: [18824]: debug: fsa_dump_inputs:utils.c Added input: 0000000000000800 (R_LRM_CONNECTED)
Oct 31 11:42:24 brutus crmd: [18824]: info: init_start:main.c Starting crmd's mainloop
Oct 31 11:42:24 brutus crmd: [18824]: debug: config_query_callback:control.c Call 4 : Parsing CIB options
Oct 31 11:42:24 brutus crmd: [18824]: debug: config_query_callback:control.c HA_initdead = 15000ms
Oct 31 11:42:24 brutus crmd: [18824]: notice: crmd_client_status_callback:callbacks.c Status update: Client brutus/crmd now has status [online]
Oct 31 11:42:24 brutus crmd: [18824]: info: crmd_client_status_callback:callbacks.c Uncaching UUID for brutus
Oct 31 11:42:24 brutus ccm: [18819]: debug: recv msg CCM_TYPE_ALIVE from brutus, status:[null ptr]
Oct 31 11:42:24 brutus crmd: [18824]: notice: crmd_client_status_callback:callbacks.c Status update: Client brutus/crmd now has status [online]
Oct 31 11:42:24 brutus crmd: [18824]: info: crmd_client_status_callback:callbacks.c Uncaching UUID for brutus
Oct 31 11:42:24 brutus cib: [18820]: debug: parse_local_options:callbacks.c Processing locally scoped cib_update op from 18824
Oct 31 11:42:24 brutus cib: [18820]: info: activateCibXml:io.c CIB size is 62536 bytes (was 60932)
Oct 31 11:42:24 brutus cib: [18820]: debug: crm_adjust_mem_stats:utils.c Adjusted CIB Memory usage by: 1604 bytes, 32 allocs, 11 frees
Oct 31 11:42:24 brutus cib: [18820]: info: cib_diff_notify:notify.c Local-only Change (client:18824, call: 5): 22.247.12335 (ok)
Oct 31 11:42:24 brutus mgmtd: [18825]: debug: update cib finished
Oct 31 11:42:24 brutus cib: [18831]: debug: validate_cib_digest:io.c Digest comparision passed: 752581d9b783d23b28023ae1bdae9241
Oct 31 11:42:24 brutus cib: [18831]: info: write_cib_contents:io.c Wrote version 22.247.12335 of the CIB to disk (digest: 752581d9b783d23b28023ae1bdae9241)
Oct 31 11:42:25 brutus cib: [18820]: debug: parse_local_options:callbacks.c Processing locally scoped cib_update op from 18824
Oct 31 11:42:25 brutus crmd: [18824]: notice: crmd_client_status_callback:callbacks.c Status update: Client anthony/crmd now has status [online]
Oct 31 11:42:25 brutus crmd: [18824]: info: crmd_client_status_callback:callbacks.c Uncaching UUID for anthony
Oct 31 11:42:25 brutus cib: [18832]: debug: validate_cib_digest:io.c Digest comparision passed: 752581d9b783d23b28023ae1bdae9241
Oct 31 11:42:25 brutus cib: [18832]: info: write_cib_contents:io.c Wrote version 22.247.12335 of the CIB to disk (digest: c20048c0cca1daa378f8ec62f95878c3)
Oct 31 11:42:25 brutus cib: [18820]: debug: parse_local_options:callbacks.c Processing locally scoped cib_update op from 18824
Oct 31 11:42:25 brutus crmd: [18824]: debug: crmd_ha_msg_callback:callbacks.c Ignoring HA messages until we are connected to the CCM (noop op from anthony)
Oct 31 11:42:25 brutus crmd: [18824]: debug: actions:trace: ^I// A_STARTED
Oct 31 11:42:25 brutus crmd: [18824]: info: do_started:control.c Delaying start, CCM (0000000000100000) not connected
Oct 31 11:42:25 brutus crmd: [18824]: debug: register_fsa_input_adv:messages.c Stalling the FSA pending further input: cause=C_FSA_INTERNAL
Oct 31 11:42:25 brutus crmd: [18824]: debug: s_crmd_fsa:fsa.c Exiting the FSA: queue=0, fsa_actions=0x2, stalled=true
Oct 31 11:42:25 brutus cib: [18820]: info: activateCibXml:io.c CIB size is 64036 bytes (was 62536)
Oct 31 11:42:25 brutus cib: [18820]: debug: crm_adjust_mem_stats:utils.c Adjusted CIB Memory usage by: 1500 bytes, 30 allocs, 11 frees
Oct 31 11:42:25 brutus cib: [18820]: info: cib_diff_notify:notify.c Local-only Change (client:18824, call: 7): 22.247.12335 (ok)
Oct 31 11:42:25 brutus mgmtd: [18825]: debug: update cib finished
Oct 31 11:42:25 brutus ccm: [18819]: debug: recv msg CCM_TYPE_MEM_LIST from anthony, status:[null ptr]
Oct 31 11:42:25 brutus ccm: [18819]: debug: node state CCM_STATE_NEW_NODE_WAIT_FOR_MEM_LIST -> CCM_STATE_JOINED
Oct 31 11:42:25 brutus ccm: [18819]: debug: dump current membership
Oct 31 11:42:25 brutus ccm: [18819]: debug: ^Ileader=anthony
Oct 31 11:42:25 brutus ccm: [18819]: debug: ^Itransition=56
Oct 31 11:42:25 brutus ccm: [18819]: debug: ^Istatus=CCM_STATE_JOINED
Oct 31 11:42:25 brutus ccm: [18819]: debug: ^Inodename=anthony bornon=44
Oct 31 11:42:25 brutus ccm: [18819]: debug: ^Inodename=brutus bornon=56
Oct 31 11:42:25 brutus ccm: [18819]: debug: No quorum selected,using default quorum plugin(majority:twonodes)
Oct 31 11:42:25 brutus ccm: [18819]: debug: quorum plugin: majority
Oct 31 11:42:25 brutus crmd: [18824]: debug: actions:trace: ^I// A_STARTED
Oct 31 11:42:25 brutus ccm: [18819]: debug: cluster:linux-ha, member_count=2, member_quorum_votes=200
Oct 31 11:42:25 brutus crmd: [18824]: info: do_started:control.c Delaying start, CCM (0000000000100000) not connected
Oct 31 11:42:25 brutus ccm: [18819]: debug: total_node_count=2, total_quorum_votes=200
Oct 31 11:42:25 brutus crmd: [18824]: debug: register_fsa_input_adv:messages.c Stalling the FSA pending further input: cause=C_FSA_INTERNAL
Oct 31 11:42:25 brutus ccm: [18819]: debug: quorum is 1
Oct 31 11:42:25 brutus crmd: [18824]: debug: s_crmd_fsa:fsa.c Exiting the FSA: queue=0, fsa_actions=0x2, stalled=true
Oct 31 11:42:25 brutus ccm: [18819]: debug: delivering new membership to 2 clients:
Oct 31 11:42:25 brutus ccm: [18819]: debug: client: pid =18820
Oct 31 11:42:25 brutus ccm: [18819]: debug: client: pid =18824
Oct 31 11:42:25 brutus crmd: [18824]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Oct 31 11:42:25 brutus crmd: [18824]: info: mem_handle_event: instance=56, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Oct 31 11:42:25 brutus crmd: [18824]: info: crmd_ccm_msg_callback:callbacks.c Quorum (re)attained after event=NEW MEMBERSHIP (id=56)
Oct 31 11:42:25 brutus crmd: [18824]: debug: s_crmd_fsa:fsa.c Processing I_CCM_EVENT: [ state=S_STARTING cause=C_CCM_CALLBACK origin=crmd_ccm_msg_callback ]
Oct 31 11:42:25 brutus crmd: [18824]: debug: actions:trace: ^I// A_CCM_UPDATE_CACHE
Oct 31 11:42:25 brutus crmd: [18824]: debug: actions:trace: ^I// A_CCM_EVENT
Oct 31 11:42:25 brutus crmd: [18824]: info: ccm_event_detail:ccm.c NEW MEMBERSHIP: trans=56, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4
Oct 31 11:42:25 brutus crmd: [18824]: info: ccm_event_detail:ccm.c ^ICURRENT: anthony [nodeid=0, born=44]
Oct 31 11:42:25 brutus crmd: [18824]: info: ccm_event_detail:ccm.c ^ICURRENT: brutus [nodeid=1, born=56]
Oct 31 11:42:25 brutus crmd: [18824]: info: ccm_event_detail:ccm.c ^INEW: anthony [nodeid=0, born=44]
Oct 31 11:42:25 brutus crmd: [18824]: info: ccm_event_detail:ccm.c ^INEW: brutus [nodeid=1, born=56]
Oct 31 11:42:25 brutus crmd: [18824]: debug: actions:trace: ^I// A_STARTED
Oct 31 11:42:25 brutus crmd: [18824]: info: do_started:control.c The local CRM is operational
Oct 31 11:42:25 brutus crmd: [18824]: debug: s_crmd_fsa:fsa.c Processing I_PENDING: [ state=S_STARTING cause=C_CCM_CALLBACK origin=do_started ]
Oct 31 11:42:25 brutus crmd: [18824]: debug: actions:trace: ^I// A_LOG
Oct 31 11:42:25 brutus crmd: [18824]: info: do_state_transition:fsa.c brutus: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ]
Oct 31 11:42:25 brutus crmd: [18824]: info: update_dc:utils.c Set DC to <null> (<null>)
Oct 31 11:42:25 brutus crmd: [18824]: debug: actions:trace: ^I// A_INTEGRATE_TIMER_STOP
Oct 31 11:42:25 brutus crmd: [18824]: debug: actions:trace: ^I// A_FINALIZE_TIMER_STOP
Oct 31 11:42:25 brutus crmd: [18824]: debug: actions:trace: ^I// A_CL_JOIN_QUERY
Oct 31 11:42:25 brutus cib: [18833]: debug: validate_cib_digest:io.c Digest comparision passed: c20048c0cca1daa378f8ec62f95878c3
Oct 31 11:42:25 brutus cib: [18833]: info: write_cib_contents:io.c Wrote version 22.247.12335 of the CIB to disk (digest: c20048c0cca1daa378f8ec62f95878c3)
Oct 31 11:42:25 brutus cib: [18820]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Oct 31 11:42:25 brutus cib: [18820]: info: mem_handle_event: instance=56, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Oct 31 11:42:25 brutus cib: [18820]: debug: cib_ccm_msg_callback:callbacks.c Process CCM event=NEW MEMBERSHIP (id=56)
Oct 31 11:42:25 brutus cib: [18820]: debug: set_transition:io.c CCM transition: old=(null), new=56
Oct 31 11:42:25 brutus cib: [18820]: debug: cib_ccm_msg_callback:callbacks.c Quorum (re)attained after event=NEW MEMBERSHIP (id=56)
Oct 31 11:42:25 brutus cib: [18820]: info: cib_ccm_msg_callback:callbacks.c PEER: anthony
Oct 31 11:42:25 brutus cib: [18820]: info: cib_ccm_msg_callback:callbacks.c PEER: brutus
Oct 31 11:42:25 brutus cib: [18820]: debug: parse_local_options:callbacks.c Processing locally scoped cib_update op from 18824
Oct 31 11:42:25 brutus cib: [18820]: info: activateCibXml:io.c CIB size is 64348 bytes (was 64140)
Oct 31 11:42:25 brutus cib: [18820]: debug: crm_adjust_mem_stats:utils.c Adjusted CIB Memory usage by: 208 bytes, 4 allocs, 0 frees
Oct 31 11:42:25 brutus cib: [18820]: info: cib_diff_notify:notify.c Local-only Change (client:18824, call: 8): 22.247.12335 (ok)
Oct 31 11:42:25 brutus mgmtd: [18825]: debug: update cib finished
Oct 31 11:42:25 brutus cib: [18820]: debug: parse_local_options:callbacks.c Processing locally scoped cib_slave op from 18824
Oct 31 11:42:25 brutus cib: [18834]: debug: validate_cib_digest:io.c Digest comparision passed: c20048c0cca1daa378f8ec62f95878c3
Oct 31 11:42:25 brutus cib: [18834]: info: write_cib_contents:io.c Wrote version 22.247.12335 of the CIB to disk (digest: b9d9470cd9db365a3caa363f869d9931)
Oct 31 11:42:26 brutus crmd: [18824]: debug: do_cl_join_query:join_client.c Querying for a DC
Oct 31 11:42:26 brutus crmd: [18824]: debug: actions:trace: ^I// A_DC_TIMER_START
Oct 31 11:42:26 brutus crmd: [18824]: debug: crm_timer_start:utils.c Started Election Trigger (I_DC_TIMEOUT:7500ms), src=10
Oct 31 11:42:26 brutus crmd: [18824]: debug: fsa_dump_inputs:utils.c Added input: 0000000000100000 (R_CCM_DATA)
Oct 31 11:42:26 brutus crmd: [18824]: debug: ccm_node_update_complete:ccm.c Node update 8 complete
Oct 31 11:42:26 brutus attrd: [18823]: info: main:attrd.c Starting mainloop...
Oct 31 11:42:27 brutus crmd: [18824]: debug: handle_request:messages.c Raising I_JOIN_OFFER: join-7
Oct 31 11:42:27 brutus cib: [18820]: debug: parse_local_options:callbacks.c Processing locally scoped cib_query op from 18824
Oct 31 11:42:27 brutus crmd: [18824]: debug: s_crmd_fsa:fsa.c Processing I_JOIN_OFFER: [ state=S_PENDING cause=C_HA_MESSAGE origin=route_message ]
Oct 31 11:42:27 brutus crmd: [18824]: debug: actions:trace: ^I// A_DC_TIMER_STOP
Oct 31 11:42:27 brutus crmd: [18824]: debug: crm_timer_stop:utils.c Stopping Election Trigger (I_DC_TIMEOUT:7500ms), src=10
Oct 31 11:42:27 brutus crmd: [18824]: debug: actions:trace: ^I// A_CL_JOIN_REQUEST
Oct 31 11:42:27 brutus crmd: [18824]: debug: do_cl_join_offer_respond:join_client.c Accepting join offer: join-7
Oct 31 11:42:27 brutus crmd: [18824]: info: update_dc:utils.c Set DC to anthony (1.0.6)
Oct 31 11:42:27 brutus crmd: [18824]: debug: do_cl_join_offer_respond:join_client.c Registered join query callback: 10
Oct 31 11:42:27 brutus crmd: [18824]: debug: do_cl_join_offer_respond:join_client.c do_cl_join_offer_respond added action A_DC_TIMER_STOP to the FSA
Oct 31 11:42:27 brutus crmd: [18824]: debug: actions:trace: ^I// A_DC_TIMER_STOP
Oct 31 11:42:27 brutus crmd: [18824]: debug: join_query_callback:join_client.c Respond to join offer join-7
Oct 31 11:42:27 brutus crmd: [18824]: debug: join_query_callback:join_client.c Acknowledging anthony as our DC
Oct 31 11:42:28 brutus heartbeat: [18806]: WARN: 1 lost packet(s) for [anthony] [41237:41239]
Oct 31 11:42:28 brutus crmd: [18824]: debug: handle_request:messages.c Raising I_JOIN_RESULT: join-7
Oct 31 11:42:28 brutus crmd: [18824]: debug: s_crmd_fsa:fsa.c Processing I_JOIN_RESULT: [ state=S_PENDING cause=C_HA_MESSAGE origin=route_message ]
Oct 31 11:42:28 brutus crmd: [18824]: debug: actions:trace: ^I// A_CL_JOIN_RESULT
Oct 31 11:42:28 brutus crmd: [18824]: info: update_dc:utils.c Set DC to anthony (1.0.6)
Oct 31 11:42:28 brutus crmd: [18824]: debug: do_cl_join_finalize_respond:join_client.c Confirming join join-7: join_ack_nack
Oct 31 11:42:28 brutus crmd: [18824]: debug: do_cl_join_finalize_respond:join_client.c join-7: Join complete. Sending local LRM status.
Oct 31 11:42:28 brutus crmd: [18824]: debug: s_crmd_fsa:fsa.c Processing I_NOT_DC: [ state=S_PENDING cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Oct 31 11:42:28 brutus crmd: [18824]: debug: actions:trace: ^I// A_LOG
Oct 31 11:42:28 brutus crmd: [18824]: info: do_state_transition:fsa.c brutus: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Oct 31 11:42:28 brutus crmd: [18824]: debug: actions:trace: ^I// A_DC_TIMER_STOP
Oct 31 11:42:28 brutus crmd: [18824]: debug: actions:trace: ^I// A_INTEGRATE_TIMER_STOP
Oct 31 11:42:28 brutus crmd: [18824]: debug: actions:trace: ^I// A_FINALIZE_TIMER_STOP
Oct 31 11:42:28 brutus cib: [18820]: debug: parse_peer_options:callbacks.c Processing global/peer update from anthony
Oct 31 11:42:28 brutus cib: [18820]: info: cib_process_diff:messages.c Diff 22.253.12423 -> 22.253.12424 not applied to 22.247.12335: current "epoch" is less than required
Oct 31 11:42:28 brutus cib: [18820]: info: cib_process_diff:messages.c Requesting re-sync from peer: current "epoch" is less than required
Oct 31 11:42:28 brutus cib: [18820]: WARN: do_cib_notify:notify.c cib_apply_diff of <diff > FAILED: Application of an update diff failed, requesting a full refresh
Oct 31 11:42:28 brutus cib: [18820]: WARN: cib_process_request:callbacks.c cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh
Oct 31 11:42:28 brutus cib: [18820]: debug: parse_peer_options:callbacks.c Processing global/peer update from anthony
Oct 31 11:42:28 brutus cib: [18820]: WARN: cib_process_diff:messages.c Not applying diff 22.253.12424 -> 22.254.12425 (sync in progress)
Oct 31 11:42:28 brutus cib: [18820]: WARN: do_cib_notify:notify.c cib_apply_diff of <diff > FAILED: Application of an update diff failed, requesting a full refresh
Oct 31 11:42:28 brutus cib: [18820]: WARN: cib_process_request:callbacks.c cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh
Oct 31 11:42:28 brutus cib: [18820]: debug: parse_peer_options:callbacks.c Processing global/peer update from anthony
Oct 31 11:42:28 brutus cib: [18820]: WARN: cib_process_diff:messages.c Not applying diff 22.254.12425 -> 22.254.12426 (sync in progress)
Oct 31 11:42:28 brutus cib: [18820]: WARN: do_cib_notify:notify.c cib_apply_diff of <diff > FAILED: Application of an update diff failed, requesting a full refresh
Oct 31 11:42:28 brutus cib: [18820]: WARN: cib_process_request:callbacks.c cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh
Oct 31 11:42:28 brutus cib: [18820]: debug: parse_peer_options:callbacks.c Processing global/peer update from anthony
Oct 31 11:42:28 brutus cib: [18820]: WARN: cib_process_diff:messages.c Not applying diff 22.254.12426 -> 22.254.12427 (sync in progress)
Oct 31 11:42:28 brutus cib: [18820]: WARN: do_cib_notify:notify.c cib_apply_diff of <diff > FAILED: Application of an update diff failed, requesting a full refresh
Oct 31 11:42:28 brutus cib: [18820]: WARN: cib_process_request:callbacks.c cib_apply_diff operation failed: Application of an update diff failed, requesting a full refresh
Oct 31 11:42:29 brutus cib: [18820]: debug: cib_peer_callback:callbacks.c Discarding cib_sync_one message 1d from ourselves
Oct 31 11:42:30 brutus heartbeat: [18806]: WARN: 2 lost packet(s) for [anthony] [41245:41248]
Oct 31 11:42:30 brutus heartbeat: [18806]: WARN: 1 lost packet(s) for [anthony] [41250:41252]
Oct 31 11:42:30 brutus heartbeat: [18806]: WARN: 1 lost packet(s) for [anthony] [41252:41254]
Oct 31 11:42:30 brutus cib: [18820]: debug: parse_peer_options:callbacks.c Forward reply sent from anthony to local clients
Oct 31 11:42:30 brutus lrmd: [18821]: debug: on_msg_add_rsc:client [18824] adds resource ip
Oct 31 11:42:30 brutus crmd: [18824]: debug: get_lrm_resource:lrm.c Adding rsc ip before operation
Oct 31 11:42:30 brutus lrmd: [18821]: debug: on_msg_perform_op: add an operation operation monitor[2] on ocf::IPaddr::ip for client 18824, its parameters: ip=[172.16.59.10] CRM_meta_op_target_rc=[7] netmask=[24] broadcast=[172.16.59.255] CRM_meta_timeout=[60000] crm_feature_set=[1.0.6] nic=[eth0] to the operation list.
Oct 31 11:42:30 brutus crmd: [18824]: info: do_lrm_rsc_op:lrm.c Performing op monitor on ip (interval=0ms, key=26:f8c4238a-7219-427d-a22a-0f813b80eff4)
Oct 31 11:42:30 brutus crmd: [18824]: debug: get_lrm_resource:lrm.c Adding rsc drbd before operation
Oct 31 11:42:30 brutus lrmd: [18821]: debug: on_msg_add_rsc:client [18824] adds resource drbd
Oct 31 11:42:30 brutus crmd: [18824]: info: do_lrm_rsc_op:lrm.c Performing op monitor on drbd (interval=0ms, key=26:f8c4238a-7219-427d-a22a-0f813b80eff4)
Oct 31 11:42:30 brutus lrmd: [18821]: debug: on_msg_perform_op: add an operation operation monitor[3] on heartbeat::drbddisk::drbd for client 18824, its parameters: CRM_meta_op_target_rc=[7] 1=[r0] CRM_meta_timeout=[60000] crm_feature_set=[1.0.6] to the operation list.
Oct 31 11:42:30 brutus crmd: [18824]: debug: get_lrm_resource:lrm.c Adding rsc rep before operation
Oct 31 11:42:30 brutus lrmd: [18821]: debug: on_msg_add_rsc:client [18824] adds resource rep
Oct 31 11:42:30 brutus crmd: [18824]: info: do_lrm_rsc_op:lrm.c Performing op monitor on rep (interval=0ms, key=26:f8c4238a-7219-427d-a22a-0f813b80eff4)
Oct 31 11:42:30 brutus lrmd: [18821]: debug: on_msg_perform_op: add an operation operation monitor[4] on ocf::Filesystem::rep for client 18824, its parameters: directory=[/rep] fstype=[ext3] CRM_meta_op_target_rc=[7] device=[/dev/drbd0] CRM_meta_timeout=[60000] crm_feature_set=[1.0.6] options=[nodev,nosuid,noatime] to the operation list.
Oct 31 11:42:30 brutus crmd: [18824]: debug: get_lrm_resource:lrm.c Adding rsc samba before operation
Oct 31 11:42:30 brutus lrmd: [18821]: debug: on_msg_add_rsc:client [18824] adds resource samba
Oct 31 11:42:30 brutus crmd: [18824]: info: do_lrm_rsc_op:lrm.c Performing op monitor on samba (interval=0ms, key=26:f8c4238a-7219-427d-a22a-0f813b80eff4)
Oct 31 11:42:30 brutus lrmd: [18821]: debug: on_msg_perform_op: add an operation operation monitor[5] on lsb::samba::samba for client 18824, its parameters: CRM_meta_op_target_rc=[7] CRM_meta_timeout=[60000] crm_feature_set=[1.0.6] to the operation list.
Oct 31 11:42:30 brutus crmd: [18824]: info: process_lrm_event:lrm.c LRM operation (2) monitor_0 on ip Error: (7) not running
Oct 31 11:42:30 brutus crmd: [18824]: debug: build_operation_update:lrm.c Resource action ip/monitor Error: 7
Oct 31 11:42:30 brutus crmd: [18824]: debug: do_update_resource:lrm.c Sent resource state update message: 11
Oct 31 11:42:30 brutus cib: [18820]: debug: parse_local_options:callbacks.c cib_update op from 18824 needs to be forwarded to the master instance
Oct 31 11:42:30 brutus crmd: [18824]: info: process_lrm_event:lrm.c LRM operation (4) monitor_0 on rep Error: (7) not running
Oct 31 11:42:30 brutus crmd: [18824]: debug: build_operation_update:lrm.c Resource action rep/monitor Error: 7
Oct 31 11:42:30 brutus cib: [18820]: debug: parse_local_options:callbacks.c cib_update op from 18824 needs to be forwarded to the master instance
Oct 31 11:42:30 brutus crmd: [18824]: debug: do_update_resource:lrm.c Sent resource state update message: 12
Oct 31 11:42:30 brutus lrmd: [18821]: debug: RA output was: [stopped ]
Oct 31 11:42:30 brutus lrmd: [18821]: debug: RA output [stopped ] matched stopped pattern [*stopped*] or [*not*running*]
Oct 31 11:42:30 brutus crmd: [18824]: info: process_lrm_event:lrm.c LRM operation (3) monitor_0 on drbd Error: (7) not running
Oct 31 11:42:30 brutus crmd: [18824]: debug: process_lrm_event:lrm.c Result: stopped
Oct 31 11:42:30 brutus crmd: [18824]: debug: build_operation_update:lrm.c Resource action drbd/monitor Error: 7
Oct 31 11:42:30 brutus cib: [18820]: debug: parse_local_options:callbacks.c cib_update op from 18824 needs to be forwarded to the master instance
Oct 31 11:42:30 brutus crmd: [18824]: debug: do_update_resource:lrm.c Sent resource state update message: 13
Oct 31 11:42:30 brutus cib: [18820]: debug: cib_peer_callback:callbacks.c Discarding cib_update message 20 from ourselves
Oct 31 11:42:30 brutus cib: [18820]: debug: cib_peer_callback:callbacks.c Discarding cib_update message 21 from ourselves
Oct 31 11:42:30 brutus cib: [18820]: debug: cib_peer_callback:callbacks.c Discarding cib_update message 22 from ourselves
Oct 31 11:42:30 brutus crmd: [18824]: info: process_lrm_event:lrm.c LRM operation (5) monitor_0 on samba complete
Oct 31 11:42:30 brutus cib: [18820]: debug: parse_local_options:callbacks.c cib_update op from 18824 needs to be forwarded to the master instance
Oct 31 11:42:30 brutus crmd: [18824]: debug: do_update_resource:lrm.c Sent resource state update message: 14
Oct 31 11:42:31 brutus cib: [18820]: debug: cib_peer_callback:callbacks.c Discarding cib_update message 24 from ourselves
Oct 31 11:42:32 brutus heartbeat: [18806]: WARN: 3 lost packet(s) for [anthony] [41255:41259]
Oct 31 11:42:32 brutus heartbeat: [18806]: WARN: 1 lost packet(s) for [anthony] [41259:41261]
Oct 31 11:42:32 brutus crmd: [18824]: info: do_lrm_rsc_op:lrm.c Performing op stop on samba (interval=0ms, key=27:f8c4238a-7219-427d-a22a-0f813b80eff4)
Oct 31 11:42:32 brutus lrmd: [18821]: debug: on_msg_perform_op: add an operation operation stop[6] on lsb::samba::samba for client 18824, its parameters: CRM_meta_timeout=[60000] crm_feature_set=[1.0.6] to the operation list.
Oct 31 11:42:32 brutus lrmd: [18872]: WARN: For LSB init script, no additional parameters are needed.
Oct 31 11:42:32 brutus cib: [18820]: debug: parse_local_options:callbacks.c cib_update op from 18824 needs to be forwarded to the master instance
Oct 31 11:42:32 brutus lrmd: [18821]: info: RA output: (samba:stop:stdout) Stopping Samba daemons: nmbd
Oct 31 11:42:33 brutus cib: [18820]: debug: cib_peer_callback:callbacks.c Discarding cib_update message 26 from ourselves
Oct 31 11:42:33 brutus lrmd: [18821]: info: RA output: (samba:stop:stdout) smbd
Oct 31 11:42:34 brutus lrmd: [18821]: info: RA output: (samba:stop:stdout) .
Oct 31 11:42:34 brutus crmd: [18824]: info: process_lrm_event:lrm.c LRM operation (6) stop_0 on samba complete
Oct 31 11:42:34 brutus cib: [18820]: debug: parse_local_options:callbacks.c cib_update op from 18824 needs to be forwarded to the master instance
Oct 31 11:42:34 brutus crmd: [18824]: debug: do_update_resource:lrm.c Sent resource state update message: 16
Oct 31 11:42:34 brutus cib: [18820]: debug: cib_peer_callback:callbacks.c Discarding cib_update message 28 from ourselves
Oct 31 11:42:35 brutus heartbeat: [18806]: WARN: 1 lost packet(s) for [anthony] [41266:41268]
Oct 31 11:43:01 brutus /USR/SBIN/CRON[18897]: (hacluster) CMD (/usr/lib/heartbeat/update-status)
Oct 31 11:44:01 brutus /USR/SBIN/CRON[18930]: (hacluster) CMD (/usr/lib/heartbeat/update-status)
Oct 31 11:45:01 brutus /USR/SBIN/CRON[18964]: (hacluster) CMD (/usr/lib/heartbeat/update-status)
More information about the Linux-HA
mailing list