[Linux-HA] how to check HBA with heartbeat
Cristina Bulfon
cristina.bulfon at roma1.infn.it
Tue Apr 14 06:27:48 MDT 2009
Ciao,
I don't think.. in V1 style is working, the behavior change with V2
style.
At the end of message you will find a ha-log file ( is not a whole ha-
log file )
I don't know if the output of "ciblint" could help
[root at afsitfs3 crm]# ciblint -L
ERROR: <nvpair name="short-resource-names"...>: [short-resource-names]
is not a legal name for the <crm_config> section
ERROR: <nvpair name="transition-idle-timeout"...>: [transition-idle-
timeout] is not a legal name for the <crm_config> section
WARNING: STONITH disabled <nvpair name="stonith-enabled"
value="false">. STONITH is STRONGLY recommended.
WARNING: No STONITH resources configured. STONITH is not available.
INFO: See http://linux-ha.org/ciblint/stonith for more information on
this topic.
INFO: See http://linux-ha.org/ciblint/crm_config#stonith-enabled for
more information on this topic.
WARNING: resource afs_6 has failcount 2 on node afsitfs3.roma1.infn.it
INFO: Resource Filesystem_4 running on node afsitfs3.roma1.infn.it
INFO: Resource Filesystem_2 running on node afsitfs3.roma1.infn.it
INFO: Resource drbddisk_1 running on node afsitfs3.roma1.infn.it
INFO: Resource drbddisk_3 running on node afsitfs3.roma1.infn.it
WARNING: Resource afs_6 not running anywhere.
INFO: Resource IPaddr_141_108_26_31 running on node
afsitfs3.roma1.infn.it
Thanks cristina
-------------------------------------------------------------------
heartbeat[19161]: 2009/04/14_13:35:43 info: Version 2 support: yes
heartbeat[19161]: 2009/04/14_13:35:43 WARN: File /etc/ha.d/haresources
exists.
heartbeat[19161]: 2009/04/14_13:35:43 WARN: This file is not used
because crm is enabled
heartbeat[19161]: 2009/04/14_13:35:43 ERROR: Duplicate apiauth
directive for API client pingd: [pingd uid=root]
heartbeat[19161]: 2009/04/14_13:35:43 ERROR: Invalid apiauth directive
[pingd uid=root]
heartbeat[19161]: 2009/04/14_13:35:43 info: Syntax: apiauth client
[uid=uidlist] [gid=gidlist]
heartbeat[19161]: 2009/04/14_13:35:43 info: Where uidlist is a comma-
separated list of uids,
heartbeat[19161]: 2009/04/14_13:35:43 info: and gidlist is a comma-
separated list of gids
heartbeat[19161]: 2009/04/14_13:35:43 info: One or the other must be
specified.
heartbeat[19161]: 2009/04/14_13:35:43 ERROR: Directive apiauth
pingd uid=root failed
heartbeat[19161]: 2009/04/14_13:35:43 WARN: Logging daemon is disabled
--enabling logging daemon is recommended
heartbeat[19161]: 2009/04/14_13:35:43 info: **************************
heartbeat[19161]: 2009/04/14_13:35:43 info: Configuration validated.
Starting heartbeat 2.1.4
heartbeat[19162]: 2009/04/14_13:35:43 info: heartbeat: version 2.1.4
heartbeat[19162]: 2009/04/14_13:35:43 info: Heartbeat generation:
1239351242
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: write socket
priority set to IPTOS_LOWDELAY on eth1
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: bound send
socket to device: eth1
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: bound receive
socket to device: eth1
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: started on
port 694 interface eth1 to 10.0.0.1
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: write socket
priority set to IPTOS_LOWDELAY on eth0
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: bound send
socket to device: eth0
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: bound receive
socket to device: eth0
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: started on
port 694 interface eth0 to 141.108.26.49
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ping heartbeat
started.
heartbeat[19162]: 2009/04/14_13:35:43 info: G_main_add_TriggerHandler:
Added signal manual handler
heartbeat[19162]: 2009/04/14_13:35:43 info: G_main_add_TriggerHandler:
Added signal manual handler
heartbeat[19162]: 2009/04/14_13:35:43 info: G_main_add_SignalHandler:
Added signal handler for signal 17
heartbeat[19162]: 2009/04/14_13:35:43 info: Local status now set to:
'up'
heartbeat[19162]: 2009/04/14_13:35:44 info: Link
141.108.26.254:141.108.26.254 up.
heartbeat[19162]: 2009/04/14_13:35:44 info: Status update for node
141.108.26.254: status ping
heartbeat[19161]: 2009/04/14_13:35:43 info: Version 2 support: yes
heartbeat[19161]: 2009/04/14_13:35:43 WARN: File /etc/ha.d/haresources
exists.
heartbeat[19161]: 2009/04/14_13:35:43 WARN: This file is not used
because crm is enabled
heartbeat[19161]: 2009/04/14_13:35:43 ERROR: Duplicate apiauth
directive for API client pingd: [pingd uid=root]
heartbeat[19161]: 2009/04/14_13:35:43 ERROR: Invalid apiauth directive
[pingd uid=root]
heartbeat[19161]: 2009/04/14_13:35:43 info: Syntax: apiauth client
[uid=uidlist] [gid=gidlist]
heartbeat[19161]: 2009/04/14_13:35:43 info: Where uidlist is a comma-
separated list of uids,
heartbeat[19161]: 2009/04/14_13:35:43 info: and gidlist is a comma-
separated list of gids
heartbeat[19161]: 2009/04/14_13:35:43 info: One or the other must be
specified.
heartbeat[19161]: 2009/04/14_13:35:43 ERROR: Directive apiauth
pingd uid=root failed
heartbeat[19161]: 2009/04/14_13:35:43 WARN: Logging daemon is disabled
--enabling logging daemon is recommended
heartbeat[19161]: 2009/04/14_13:35:43 info: **************************
heartbeat[19161]: 2009/04/14_13:35:43 info: Configuration validated.
Starting heartbeat 2.1.4
heartbeat[19162]: 2009/04/14_13:35:43 info: heartbeat: version 2.1.4
heartbeat[19162]: 2009/04/14_13:35:43 info: Heartbeat generation:
1239351242
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: write socket
priority set to IPTOS_LOWDELAY on eth1
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: bound send
socket to device: eth1
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: bound receive
socket to device: eth1
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: started on
port 694 interface eth1 to 10.0.0.1
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: write socket
priority set to IPTOS_LOWDELAY on eth0
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: bound send
socket to device: eth0
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: bound receive
socket to device: eth0
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ucast: started on
port 694 interface eth0 to 141.108.26.49
heartbeat[19162]: 2009/04/14_13:35:43 info: glib: ping heartbeat
started.
heartbeat[19162]: 2009/04/14_13:35:43 info: G_main_add_TriggerHandler:
Added signal manual handler
heartbeat[19162]: 2009/04/14_13:35:43 info: G_main_add_TriggerHandler:
Added signal manual handler
heartbeat[19162]: 2009/04/14_13:35:43 info: G_main_add_SignalHandler:
Added signal handler for signal 17
heartbeat[19162]: 2009/04/14_13:35:43 info: Local status now set to:
'up'
heartbeat[19162]: 2009/04/14_13:35:44 info: Link
141.108.26.254:141.108.26.254 up.
heartbeat[19162]: 2009/04/14_13:35:44 info: Status update for node
141.108.26.254: status ping
heartbeat[19162]: 2009/04/14_13:36:18 info: Starting child client "/
usr/lib64/heartbeat/mgmtd -v" (0,0)
heartbeat[19162]: 2009/04/14_13:36:18 info: Status update for node
afsitfs4.roma1.infn.it: status active
heartbeat[19175]: 2009/04/14_13:36:18 info: Starting "/usr/lib64/
heartbeat/ccm" as uid 500 gid 500 (pid 19175)
heartbeat[19176]: 2009/04/14_13:36:18 info: Starting "/usr/lib64/
heartbeat/cib" as uid 500 gid 500 (pid 19176)
heartbeat[19177]: 2009/04/14_13:36:18 info: Starting "/usr/lib64/
heartbeat/lrmd -r" as uid 0 gid 0 (pid 19177)
pingd[19174]: 2009/04/14_13:36:18 info: Invoked: /usr/lib64/heartbeat/
pingd -m 100 -d 5s
heartbeat[19181]: 2009/04/14_13:36:18 info: Starting "/usr/lib64/
heartbeat/mgmtd -v" as uid 0 gid 0 (pid 19181)
stonithd[19178]: 2009/04/14_13:36:18 info: G_main_add_SignalHandler:
Added signal handler for signal 10
stonithd[19178]: 2009/04/14_13:36:18 info: G_main_add_SignalHandler:
Added signal handler for signal 12
heartbeat[19179]: 2009/04/14_13:36:18 info: Starting "/usr/lib64/
heartbeat/attrd" as uid 500 gid 500 (pid 19179)
heartbeat[19180]: 2009/04/14_13:36:18 info: Starting "/usr/lib64/
heartbeat/crmd" as uid 500 gid 500 (pid 19180)
stonithd[19178]: 2009/04/14_13:36:18 info: Signing in with heartbeat.
stonithd[19178]: 2009/04/14_13:36:18 notice: /usr/lib64/heartbeat/
stonithd start up successfully.
stonithd[19178]: 2009/04/14_13:36:18 info: G_main_add_SignalHandler:
Added signal handler for signal 17
lrmd[19177]: 2009/04/14_13:36:18 info: G_main_add_SignalHandler: Added
signal handler for signal 15
cib[19176]: 2009/04/14_13:36:18 info: G_main_add_SignalHandler: Added
signal handler for signal 15
cib[19176]: 2009/04/14_13:36:18 info: G_main_add_TriggerHandler: Added
signal manual handler
cib[19176]: 2009/04/14_13:36:18 info: G_main_add_SignalHandler: Added
signal handler for signal 17
crmd[19180]: 2009/04/14_13:36:18 info: main: CRM Hg Version: node:
74d736e8f667fae1e4a904ccd13ad6553c5c010c
cib[19176]: 2009/04/14_13:36:18 info: main: Retrieval of a per-action
CIB: disabled
cib[19176]: 2009/04/14_13:36:18 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/
heartbeat/crm/cib.xml.sig)
crmd[19180]: 2009/04/14_13:36:18 info: crmd_init: Starting crmd
mgmtd[19181]: 2009/04/14_13:36:18 info: G_main_add_SignalHandler:
Added signal handler for signal 15
lrmd[19177]: 2009/04/14_13:36:18 info: G_main_add_SignalHandler: Added
signal handler for signal 17
attrd[19179]: 2009/04/14_13:36:18 info: G_main_add_SignalHandler:
Added signal handler for signal 15
cib[19176]: 2009/04/14_13:36:18 WARN: validate_cib_digest: No on-disk
digest present
ccm[19175]: 2009/04/14_13:36:18 info: Hostname: afsitfs3.roma1.infn.it
crmd[19180]: 2009/04/14_13:36:18 info: G_main_add_SignalHandler: Added
signal handler for signal 15
lrmd[19177]: 2009/04/14_13:36:18 info: G_main_add_SignalHandler: Added
signal handler for signal 10
attrd[19179]: 2009/04/14_13:36:18 info: register_with_ha: Hostname:
afsitfs3.roma1.infn.it
cib[19176]: 2009/04/14_13:36:18 info: log_data_element:
readCibXmlFile: [on-disk] <cib admin_epoch="0" generated="false"
have_quorum="false" ignore_dtd="false" num_peers="2"
cib_feature_revision="2.0" crm_feature_set="2.0" ccm_transition="2"
epoch="9" num_updates="3" cib-last-written="Tue Apr 14 12:02:03 2009">
crmd[19180]: 2009/04/14_13:36:18 info: G_main_add_TriggerHandler:
Added signal manual handler
mgmtd[19181]: 2009/04/14_13:36:18 info: G_main_add_SignalHandler:
Added signal handler for signal 10
lrmd[19177]: 2009/04/14_13:36:18 info: G_main_add_SignalHandler: Added
signal handler for signal 12
cib[19176]: 2009/04/14_13:36:18 info: log_data_element:
readCibXmlFile: [on-disk] <configuration>
crmd[19180]: 2009/04/14_13:36:18 info: G_main_add_SignalHandler: Added
signal handler for signal 17
mgmtd[19181]: 2009/04/14_13:36:18 info: G_main_add_SignalHandler:
Added signal handler for signal 12
lrmd[19177]: 2009/04/14_13:36:18 info: Started.
attrd[19179]: 2009/04/14_13:36:19 info: register_with_ha: UUID:
586817af-703a-4eff-ac9b-b96de063493a
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <crm_config>
mgmtd[19181]: 2009/04/14_13:36:19 info: init_crm
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <cluster_property_set id="cib-
bootstrap-options">
mgmtd[19181]: 2009/04/14_13:36:19 info: login to cib: 0, ret:-10
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <attributes>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
symmetric-cluster" name="symmetric-cluster" value="true"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
no-quorum-policy" name="no-quorum-policy" value="stop"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
default-resource-stickiness" name="default-resource-stickiness"
value="0"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
default-resource-failure-stickiness" name="default-resource-failure-
stickiness" value="0"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
stonith-enabled" name="stonith-enabled" value="false"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
stonith-action" name="stonith-action" value="reboot"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
startup-fencing" name="startup-fencing" value="true"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
stop-orphan-resources" name="stop-orphan-resources" value="true"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
stop-orphan-actions" name="stop-orphan-actions" value="true"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
remove-after-stop" name="remove-after-stop" value="false"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
short-resource-names" name="short-resource-names" value="true"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
transition-idle-timeout" name="transition-idle-timeout" value="5min"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
default-action-timeout" name="default-action-timeout" value="20s"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
is-managed-default" name="is-managed-default" value="true"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
cluster-delay" name="cluster-delay" value="60s"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
pe-error-series-max" name="pe-error-series-max" value="-1"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
pe-warn-series-max" name="pe-warn-series-max" value="-1"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
pe-input-series-max" name="pe-input-series-max" value="-1"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-
dc-version" name="dc-version" value="2.1.4-node:
74d736e8f667fae1e4a904ccd13ad6553c5c010c"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] </attributes>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] </cluster_property_set>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] </crm_config>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <nodes>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <node id="08f3c79e-0799-47bc-
bf0d-5d422324754e" uname="afsitfs4.roma1.infn.it" type="normal"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <node id="586817af-703a-4eff-ac9b-
b96de063493a" uname="afsitfs3.roma1.infn.it" type="normal"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] </nodes>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <resources>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <group id="group_1">
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <primitive class="heartbeat"
id="drbddisk_1" provider="heartbeat" type="drbddisk">
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <operations>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <op id="drbddisk_1_mon"
interval="120s" name="monitor" timeout="60s"/>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] </operations>
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <instance_attributes
id="drbddisk_1_inst_attr">
cib[19176]: 2009/04/14_13:36:19 info: log_data_element:
readCibXmlFile: [on-disk] <attributes>
crmd[19180]: 2009/04/14_13:36:19 WARN: do_cib_control: Couldn't
complete CIB registration 1 times... pause and retry
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="drbddisk_1_attr_1"
name="1" value="afs_fs"/>
crmd[19180]: 2009/04/14_13:36:20 info: crmd_init: Starting crmd's
mainloop
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] </attributes>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] </instance_attributes>
mgmtd[19181]: 2009/04/14_13:36:20 info: login to cib: 1, ret:-10
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] </primitive>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <primitive class="ocf"
id="Filesystem_2" provider="heartbeat" type="Filesystem">
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <operations>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <op id="Filesystem_2_mon"
interval="120s" name="monitor" timeout="60s"/>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] </operations>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <instance_attributes
id="Filesystem_2_inst_attr">
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <attributes>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair
id="Filesystem_2_attr_0" name="device" value="/dev/drbd1"/>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair
id="Filesystem_2_attr_1" name="directory" value="/vicepa/"/>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair
id="Filesystem_2_attr_2" name="fstype" value="xfs"/>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] </attributes>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] </instance_attributes>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] </primitive>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <primitive class="heartbeat"
id="drbddisk_3" provider="heartbeat" type="drbddisk">
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <operations>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <op id="drbddisk_3_mon"
interval="120s" name="monitor" timeout="60s"/>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] </operations>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <instance_attributes
id="drbddisk_3_inst_attr">
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <attributes>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair id="drbddisk_3_attr_1"
name="1" value="afs_sw"/>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] </attributes>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] </instance_attributes>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] </primitive>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <primitive class="ocf"
id="Filesystem_4" provider="heartbeat" type="Filesystem">
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <operations>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <op id="Filesystem_4_mon"
interval="120s" name="monitor" timeout="60s"/>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] </operations>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <instance_attributes
id="Filesystem_4_inst_attr">
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <attributes>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair
id="Filesystem_4_attr_0" name="device" value="/dev/drbd2"/>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair
id="Filesystem_4_attr_1" name="directory" value="/usr/afs"/>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair
id="Filesystem_4_attr_2" name="fstype" value="ext3"/>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] </attributes>
cib[19176]: 2009/04/14_13:36:20 info: log_data_element:
readCibXmlFile: [on-disk] </instance_attributes>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] </primitive>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] <primitive class="ocf"
id="IPaddr_141_108_26_31" provider="heartbeat" type="IPaddr">
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] <operations>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] <op
id="IPaddr_141_108_26_31_mon" interval="5s" name="monitor"
timeout="5s"/>
mgmtd[19181]: 2009/04/14_13:36:21 info: login to cib: 2, ret:-10
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] </operations>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] <instance_attributes
id="IPaddr_141_108_26_31_inst_attr">
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] <attributes>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] <nvpair
id="IPaddr_141_108_26_31_attr_0" name="ip" value="141.108.26.31"/>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] </attributes>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] </instance_attributes>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] </primitive>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] <primitive class="lsb" id="afs_6"
provider="heartbeat" type="afs">
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] <operations>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] <op id="afs_6_mon"
interval="120s" name="monitor" timeout="60s"/>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] </operations>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] </primitive>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] </group>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] </resources>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] <constraints>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] <rsc_location
id="rsc_location_group_1" rsc="group_1">
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] <rule id="prefered_location_group_1"
score="100">
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] <expression attribute="#uname"
id="prefered_location_group_1_expr" operation="eq"
value="afsitfs3.roma1.infn.it"/>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] </rule>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] </rsc_location>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] </constraints>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] </configuration>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] <status/>
cib[19176]: 2009/04/14_13:36:21 info: log_data_element:
readCibXmlFile: [on-disk] </cib>
cib[19176]: 2009/04/14_13:36:21 info: startCib: CIB Initialization
completed successfully
cib[19176]: 2009/04/14_13:36:21 info: cib_register_ha: Signing in with
Heartbeat
heartbeat[19162]: 2009/04/14_13:36:21 WARN: 1 lost packet(s) for
[afsitfs4.roma1.infn.it] [14:16]
heartbeat[19162]: 2009/04/14_13:36:21 info: No pkts missing from
afsitfs4.roma1.infn.it!
cib[19176]: 2009/04/14_13:36:21 info: cib_register_ha: FSA Hostname:
afsitfs3.roma1.infn.it
cib[19176]: 2009/04/14_13:36:21 info: ccm_connect: Registering with
CCM...
cib[19176]: 2009/04/14_13:36:21 WARN: ccm_connect: CCM Activation failed
cib[19176]: 2009/04/14_13:36:21 WARN: ccm_connect: CCM Connection
failed 1 times (30 max)
ccm[19175]: 2009/04/14_13:36:21 info: G_main_add_SignalHandler: Added
signal handler for signal 15
crmd[19180]: 2009/04/14_13:36:21 info: crm_timer_popped: Wait Timer
(I_NULL) just popped!
heartbeat[19162]: 2009/04/14_13:36:23 WARN: 1 lost packet(s) for
[afsitfs4.roma1.infn.it] [18:20]
heartbeat[19162]: 2009/04/14_13:36:23 info: No pkts missing from
afsitfs4.roma1.infn.it!
cib[19176]: 2009/04/14_13:36:24 info: ccm_connect: Registering with
CCM..
cib[19176]: 2009/04/14_13:36:25 info: cib_init: Starting cib mainloop
cib[19184]: 2009/04/14_13:36:25 WARN: validate_cib_digest: No on-disk
digest present
cib[19184]: 2009/04/14_13:36:25 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/
heartbeat/crm/cib.xml.sig)
cib[19184]: 2009/04/14_13:36:25 WARN: validate_cib_digest: No on-disk
digest present
cib[19176]: 2009/04/14_13:36:25 info: cib_null_callback: Setting
cib_diff_notify callbacks for mgmtd: on
crmd[19180]: 2009/04/14_13:36:25 info: do_cib_control: CIB connection
established
cib[19176]: 2009/04/14_13:36:25 info: cib_null_callback: Setting
cib_refresh_notify callbacks for crmd: on
crmd[19180]: 2009/04/14_13:36:25 info: register_with_ha: Hostname:
afsitfs3.roma1.infn.it
cib[19176]: 2009/04/14_13:36:25 info: cib_client_status_callback:
Status update: Client afsitfs3.roma1.infn.it/cib now has status [join]
cib[19176]: 2009/04/14_13:36:25 info: cib_client_status_callback:
Status update: Client afsitfs3.roma1.infn.it/cib now has status [online]
cib[19184]: 2009/04/14_13:36:25 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/
heartbeat/crm/cib.xml.sig)
cib[19184]: 2009/04/14_13:36:25 WARN: validate_cib_digest: No on-disk
digest present
cib[19184]: 2009/04/14_13:36:25 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/
lib/heartbeat/crm/cib.xml.sig.last)
cib[19184]: 2009/04/14_13:36:25 WARN: validate_cib_digest: No on-disk
digest present
cib[19184]: 2009/04/14_13:36:25 info: write_cib_contents: Wrote
version 0.9.3 of the CIB to disk (digest:
ac4618bfb729aa80b50c08cc7df3d7a9)
cib[19184]: 2009/04/14_13:36:25 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/
heartbeat/crm/cib.xml.sig)
cib[19184]: 2009/04/14_13:36:25 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/
lib/heartbeat/crm/cib.xml.sig.last)
cib[19184]: 2009/04/14_13:36:25 WARN: validate_cib_digest: No on-disk
digest present
crmd[19180]: 2009/04/14_13:36:25 info: register_with_ha: UUID:
586817af-703a-4eff-ac9b-b96de063493a
crmd[19180]: 2009/04/14_13:36:25 info: populate_cib_nodes: Requesting
the list of configured nodes
mgmtd[19181]: 2009/04/14_13:36:25 info: Started.
cib[19176]: 2009/04/14_13:36:25 info: cib_client_status_callback:
Status update: Client afsitfs4.roma1.infn.it/cib now has status [online]
cib[19176]: 2009/04/14_13:36:25 info: mem_handle_event: Got an event
OC_EV_MS_NEW_MEMBERSHIP from ccm
cib[19176]: 2009/04/14_13:36:25 info: mem_handle_event: instance=2,
nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
cib[19176]: 2009/04/14_13:36:25 info: cib_ccm_msg_callback: PEER:
afsitfs4.roma1.infn.it
cib[19176]: 2009/04/14_13:36:25 info: cib_ccm_msg_callback: PEER:
afsitfs3.roma1.infn.it
crmd[19180]: 2009/04/14_13:36:26 notice: populate_cib_nodes: Node:
afsitfs4.roma1.infn.it (uuid: 08f3c79e-0799-47bc-bf0d-5d422324754e)
crmd[19180]: 2009/04/14_13:36:26 notice: populate_cib_nodes: Node:
afsitfs3.roma1.infn.it (uuid: 586817af-703a-4eff-ac9b-b96de063493a)
crmd[19180]: 2009/04/14_13:36:26 info: do_ha_control: Connected to
Heartbeat
crmd[19180]: 2009/04/14_13:36:26 info: do_ccm_control: CCM connection
established... waiting for first callback
crmd[19180]: 2009/04/14_13:36:26 info: do_started: Delaying start, CCM
(0000000000100000) not connected
crmd[19180]: 2009/04/14_13:36:26 notice: crmd_client_status_callback:
Status update: Client afsitfs3.roma1.infn.it/crmd now has status
[online]
crmd[19180]: 2009/04/14_13:36:27 notice: crmd_client_status_callback:
Status update: Client afsitfs3.roma1.infn.it/crmd now has status
[online]
crmd[19180]: 2009/04/14_13:36:27 notice: crmd_client_status_callback:
Status update: Client afsitfs4.roma1.infn.it/crmd now has status
[online]
crmd[19180]: 2009/04/14_13:36:27 info: mem_handle_event: Got an event
OC_EV_MS_NEW_MEMBERSHIP from ccm
crmd[19180]: 2009/04/14_13:36:27 info: mem_handle_event: instance=2,
nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
crmd[19180]: 2009/04/14_13:36:27 info: crmd_ccm_msg_callback: Quorum
(re)attained after event=NEW MEMBERSHIP (id=2)
crmd[19180]: 2009/04/14_13:36:27 info: ccm_event_detail: NEW
MEMBERSHIP: trans=2, nodes=2, new=2, lost=0 n_idx=0, new_idx=0,
old_idx=4
crmd[19180]: 2009/04/14_13:36:27 info: ccm_event_detail:
CURRENT: afsitfs4.roma1.infn.it [nodeid=1, born=1]
crmd[19180]: 2009/04/14_13:36:27 info: ccm_event_detail:
CURRENT: afsitfs3.roma1.infn.it [nodeid=0, born=2]
crmd[19180]: 2009/04/14_13:36:27 info: ccm_event_detail:
NEW: afsitfs4.roma1.infn.it [nodeid=1, born=1]
crmd[19180]: 2009/04/14_13:36:27 info: ccm_event_detail:
NEW: afsitfs3.roma1.infn.it [nodeid=0, born=2]
crmd[19180]: 2009/04/14_13:36:27 info: do_started: Delaying start,
Config not read (0000000000000040)
crmd[19180]: 2009/04/14_13:36:27 info: do_started: The local CRM is
operational
crmd[19180]: 2009/04/14_13:36:27 info: do_state_transition: State
transition S_STARTING -> S_PENDING [ input=I_PENDING
cause=C_FSA_INTERNAL origin=do_started ]
heartbeat[19162]: 2009/04/14_13:36:29 WARN: 1 lost packet(s) for
[afsitfs4.roma1.infn.it] [32:34]
heartbeat[19162]: 2009/04/14_13:36:29 info: No pkts missing from
afsitfs4.roma1.infn.it!
attrd[19179]: 2009/04/14_13:36:30 info: main: Starting mainloop...
pingd[19174]: 2009/04/14_13:36:33 info: do_node_walk: Requesting the
list of configured nodes
pingd[19174]: 2009/04/14_13:36:34 info: send_update: 1 active ping nodes
pingd[19174]: 2009/04/14_13:36:34 info: main: Starting pingd
attrd[19179]: 2009/04/14_13:36:34 info: find_hash_entry: Creating hash
entry for pingd
attrd[19179]: 2009/04/14_13:36:36 info: attrd_ha_callback: flush
message from afsitfs4.roma1.infn.it
attrd[19179]: 2009/04/14_13:36:36 info: attrd_perform_update: Sent
update 3: pingd=100
crmd[19180]: 2009/04/14_13:38:26 info: do_election_count_vote:
Election check: vote from afsitfs4.roma1.infn.it
crmd[19180]: 2009/04/14_13:38:28 info: update_dc: Set DC to
afsitfs4.roma1.infn.it (2.0)
cib[19176]: 2009/04/14_13:38:28 info: apply_xml_diff: Digest mis-
match: expected 2d45cb6f27a0360614053ffcd301a55b, calculated
4666d6044f14ef27d04201396c378d37
cib[19176]: 2009/04/14_13:38:28 info: cib_process_diff: Diff 0.9.3 ->
0.10.1 not applied to 0.9.3: Failed application of a global update.
Requesting full refresh.
cib[19176]: 2009/04/14_13:38:28 info: cib_process_diff: Requesting re-
sync from peer: Failed application of a global update. Requesting
full refresh.
cib[19176]: 2009/04/14_13:38:28 WARN: do_cib_notify: cib_apply_diff of
<diff > FAILED: Application of an update diff failed, requesting a
full refresh
cib[19176]: 2009/04/14_13:38:28 WARN: cib_process_request:
cib_apply_diff operation failed: Application of an update diff failed,
requesting a full refresh
cib[19176]: 2009/04/14_13:38:28 WARN: cib_process_diff: Not applying
diff 0.10.1 -> 0.10.2 (sync in progress)
cib[19176]: 2009/04/14_13:38:28 WARN: do_cib_notify: cib_apply_diff of
<diff > FAILED: Application of an update diff failed, requesting a
full refresh
cib[19176]: 2009/04/14_13:38:28 WARN: cib_process_request:
cib_apply_diff operation failed: Application of an update diff failed,
requesting a full refresh
attrd[19179]: 2009/04/14_13:38:29 info: attrd_ha_callback: flush
message from afsitfs4.roma1.infn.it
crmd[19180]: 2009/04/14_13:38:29 info: update_dc: Set DC to
afsitfs4.roma1.infn.it (2.0)
crmd[19180]: 2009/04/14_13:38:29 info: do_state_transition: State
transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE
origin=do_cl_join_finalize_respond ]
cib[19176]: 2009/04/14_13:38:29 info: cib_replace_notify: Replaced:
0.9.3 -> 0.10.2 from <null>
crmd[19180]: 2009/04/14_13:38:29 info: populate_cib_nodes: Requesting
the list of configured nodes
attrd[19179]: 2009/04/14_13:38:29 info: attrd_perform_update: Sent
update 5: pingd=100
cib[19186]: 2009/04/14_13:38:29 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/
heartbeat/crm/cib.xml.sig)
cib[19186]: 2009/04/14_13:38:29 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/
heartbeat/crm/cib.xml.sig)
cib[19186]: 2009/04/14_13:38:29 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/
lib/heartbeat/crm/cib.xml.sig.last)
cib[19186]: 2009/04/14_13:38:29 info: write_cib_contents: Wrote
version 0.11.3 of the CIB to disk (digest:
685843ed5582f7351c0c4894bbfef0b2)
cib[19186]: 2009/04/14_13:38:29 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/
heartbeat/crm/cib.xml.sig)
cib[19186]: 2009/04/14_13:38:29 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/
lib/heartbeat/crm/cib.xml.sig.last)
crmd[19180]: 2009/04/14_13:38:30 notice: populate_cib_nodes: Node:
afsitfs4.roma1.infn.it (uuid: 08f3c79e-0799-47bc-bf0d-5d422324754e)
crmd[19180]: 2009/04/14_13:38:31 notice: populate_cib_nodes: Node:
afsitfs3.roma1.infn.it (uuid: 586817af-703a-4eff-ac9b-b96de063493a)
crmd[19180]: 2009/04/14_13:38:31 info: do_lrm_rsc_op: Performing
op=drbddisk_1_monitor_0 key=11:0:7:cc5851a8-04dd-45a6-8700-954bea0f2c78)
lrmd[19177]: 2009/04/14_13:38:31 info: rsc:drbddisk_1: monitor
crmd[19180]: 2009/04/14_13:38:31 info: do_lrm_rsc_op: Performing
op=Filesystem_2_monitor_0
key=12:0:7:cc5851a8-04dd-45a6-8700-954bea0f2c78)
lrmd[19177]: 2009/04/14_13:38:31 info: rsc:Filesystem_2: monitor
crmd[19180]: 2009/04/14_13:38:31 info: do_lrm_rsc_op: Performing
op=drbddisk_3_monitor_0 key=13:0:7:cc5851a8-04dd-45a6-8700-954bea0f2c78)
lrmd[19177]: 2009/04/14_13:38:31 info: rsc:drbddisk_3: monitor
crmd[19180]: 2009/04/14_13:38:31 info: do_lrm_rsc_op: Performing
op=Filesystem_4_monitor_0
key=14:0:7:cc5851a8-04dd-45a6-8700-954bea0f2c78)
lrmd[19177]: 2009/04/14_13:38:31 info: rsc:Filesystem_4: monitor
crmd[19180]: 2009/04/14_13:38:31 info: do_lrm_rsc_op: Performing
op=IPaddr_141_108_26_31_monitor_0
key=15:0:7:cc5851a8-04dd-45a6-8700-954bea0f2c78)
crmd[19180]: 2009/04/14_13:38:31 info: do_lrm_rsc_op: Performing
op=afs_6_monitor_0 key=16:0:7:cc5851a8-04dd-45a6-8700-954bea0f2c78)
crmd[19180]: 2009/04/14_13:38:31 info: process_lrm_event: LRM
operation drbddisk_1_monitor_0 (call=2, rc=0) complete
crmd[19180]: 2009/04/14_13:38:31 info: process_lrm_event: LRM
operation drbddisk_3_monitor_0 (call=4, rc=0) complete
crmd[19180]: 2009/04/14_13:38:31 info: process_lrm_event: LRM
operation Filesystem_4_monitor_0 (call=5, rc=7) complete
crmd[19180]: 2009/04/14_13:38:31 info: process_lrm_event: LRM
operation Filesystem_2_monitor_0 (call=3, rc=7) complete
lrmd[19177]: 2009/04/14_13:38:32 info: rsc:IPaddr_141_108_26_31: monitor
lrmd[19177]: 2009/04/14_13:38:32 info: rsc:afs_6: monitor
crmd[19180]: 2009/04/14_13:38:32 info: process_lrm_event: LRM
operation afs_6_monitor_0 (call=7, rc=7) complete
crmd[19180]: 2009/04/14_13:38:32 info: process_lrm_event: LRM
operation IPaddr_141_108_26_31_monitor_0 (call=6, rc=7) complete
crmd[19180]: 2009/04/14_13:38:34 info: do_lrm_rsc_op: Performing
op=drbddisk_1_monitor_120000
key=7:1:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
crmd[19180]: 2009/04/14_13:38:34 info: do_lrm_rsc_op: Performing
op=drbddisk_3_stop_0 key=11:1:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
lrmd[19177]: 2009/04/14_13:38:34 info: rsc:drbddisk_3: stop
crmd[19180]: 2009/04/14_13:38:34 info: process_lrm_event: LRM
operation drbddisk_1_monitor_120000 (call=8, rc=0) complete
crmd[19180]: 2009/04/14_13:38:34 info: process_lrm_event: LRM
operation drbddisk_3_stop_0 (call=9, rc=0) complete
crmd[19180]: 2009/04/14_13:38:36 info: do_lrm_rsc_op: Performing
op=Filesystem_2_start_0 key=8:2:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
lrmd[19177]: 2009/04/14_13:38:36 info: rsc:Filesystem_2: start
Filesystem[19286]: 2009/04/14_13:38:36 INFO: Running start for /
dev/drbd1 on /vicepa
crmd[19180]: 2009/04/14_13:38:36 info: process_lrm_event: LRM
operation Filesystem_2_start_0 (call=10, rc=0) complete
crmd[19180]: 2009/04/14_13:38:37 info: do_lrm_rsc_op: Performing
op=Filesystem_2_monitor_120000
key=9:2:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
crmd[19180]: 2009/04/14_13:38:37 info: do_lrm_rsc_op: Performing
op=drbddisk_3_start_0 key=10:2:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
lrmd[19177]: 2009/04/14_13:38:37 info: rsc:drbddisk_3: start
crmd[19180]: 2009/04/14_13:38:37 info: process_lrm_event: LRM
operation drbddisk_3_start_0 (call=12, rc=0) complete
crmd[19180]: 2009/04/14_13:38:37 info: process_lrm_event: LRM
operation Filesystem_2_monitor_120000 (call=11, rc=0) complete
crmd[19180]: 2009/04/14_13:38:38 info: do_lrm_rsc_op: Performing
op=drbddisk_3_monitor_120000
key=11:2:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
crmd[19180]: 2009/04/14_13:38:38 info: do_lrm_rsc_op: Performing
op=Filesystem_4_start_0 key=12:2:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
lrmd[19177]: 2009/04/14_13:38:38 info: rsc:Filesystem_4: start
crmd[19180]: 2009/04/14_13:38:38 info: process_lrm_event: LRM
operation drbddisk_3_monitor_120000 (call=13, rc=0) complete
Filesystem[19380]: 2009/04/14_13:38:38 INFO: Running start for /
dev/drbd2 on /usr/afs
crmd[19180]: 2009/04/14_13:38:38 info: process_lrm_event: LRM
operation Filesystem_4_start_0 (call=14, rc=0) complete
crmd[19180]: 2009/04/14_13:38:40 info: do_lrm_rsc_op: Performing
op=Filesystem_4_monitor_120000
key=13:2:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
crmd[19180]: 2009/04/14_13:38:40 info: do_lrm_rsc_op: Performing
op=IPaddr_141_108_26_31_start_0
key=14:2:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
lrmd[19177]: 2009/04/14_13:38:40 info: rsc:IPaddr_141_108_26_31: start
crmd[19180]: 2009/04/14_13:38:40 info: process_lrm_event: LRM
operation Filesystem_4_monitor_120000 (call=15, rc=0) complete
IPaddr[19432]: 2009/04/14_13:38:40 INFO: Using calculated nic for
141.108.26.31: eth0
IPaddr[19432]: 2009/04/14_13:38:40 INFO: Using calculated netmask for
141.108.26.31: 255.255.255.0
IPaddr[19432]: 2009/04/14_13:38:40 INFO: eval ifconfig eth0:0
141.108.26.31 netmask 255.255.255.0 broadcast 141.108.26.255
crmd[19180]: 2009/04/14_13:38:40 info: process_lrm_event: LRM
operation IPaddr_141_108_26_31_start_0 (call=16, rc=0) complete
crmd[19180]: 2009/04/14_13:38:41 info: do_lrm_rsc_op: Performing
op=IPaddr_141_108_26_31_monitor_5000
key=15:2:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
crmd[19180]: 2009/04/14_13:38:41 info: do_lrm_rsc_op: Performing
op=afs_6_start_0 key=16:2:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
lrmd[19177]: 2009/04/14_13:38:41 info: rsc:afs_6: start
lrmd[19560]: 2009/04/14_13:38:41 WARN: For LSB init script, no
additional parameters are needed.
crmd[19180]: 2009/04/14_13:38:41 info: process_lrm_event: LRM
operation IPaddr_141_108_26_31_monitor_5000 (call=17, rc=0) complete
lrmd[19177]: 2009/04/14_13:38:41 info: RA output: (afs_6:start:stdout)
Starting Bosserver
lrmd[19177]: 2009/04/14_13:38:41 info: RA output: (afs_6:start:stdout)
lrmd[19177]: 2009/04/14_13:38:52 info: RA output: (afs_6:start:stdout)
Will start afsd with these options:
lrmd[19177]: 2009/04/14_13:38:52 info: RA output:
(afs_6:start:stdout) -nosettime -stat 4000 -daemons 8 -blocks 65536 -
memcache
lrmd[19177]: 2009/04/14_13:38:52 info: RA output: (afs_6:start:stdout)
Syncing clock with AFS server(s)...
lrmd[19177]: 2009/04/14_13:38:52 info: RA output: (afs_6:start:stdout)
Starting AFS client:
lrmd[19177]: 2009/04/14_13:38:52 info: RA output: (afs_6:start:stdout)
lrmd[19177]: 2009/04/14_13:38:52 info: RA output: (afs_6:start:stdout)
afsd: All AFS daemons started.
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
afsd: All AFS daemons started.
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
fs: new sysname set.
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
Invoking the AFS-startup script
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
Verifying consistency of CellServDB for AFS client..
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
CellServDB is consistent
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
Adjusting clock with 0.it.pool.ntp.org...
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
0.it.pool.ntp.org: delay:0.092920 offset:-0.033263 Tue Apr 14
13:38:55 2009
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
end of AFS-startup script
crmd[19180]: 2009/04/14_13:38:55 info: process_lrm_event: LRM
operation afs_6_start_0 (call=18, rc=0) complete
crmd[19180]: 2009/04/14_13:38:56 info: do_lrm_rsc_op: Performing
op=afs_6_monitor_120000 key=17:2:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
crmd[19180]: 2009/04/14_13:38:56 info: process_lrm_event: LRM
operation afs_6_monitor_120000 (call=19, rc=7) complete
lrmd[19177]: 2009/04/14_13:38:52 info: RA output: (afs_6:start:stdout)
Will start afsd with these options:
lrmd[19177]: 2009/04/14_13:38:52 info: RA output:
(afs_6:start:stdout) -nosettime -stat 4000 -daemons 8 -blocks 65536 -
memcache
lrmd[19177]: 2009/04/14_13:38:52 info: RA output: (afs_6:start:stdout)
Syncing clock with AFS server(s)...
lrmd[19177]: 2009/04/14_13:38:52 info: RA output: (afs_6:start:stdout)
Starting AFS client:
lrmd[19177]: 2009/04/14_13:38:52 info: RA output: (afs_6:start:stdout)
lrmd[19177]: 2009/04/14_13:38:52 info: RA output: (afs_6:start:stdout)
afsd: All AFS daemons started.
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
afsd: All AFS daemons started.
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
fs: new sysname set.
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
Invoking the AFS-startup script
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
Verifying consistency of CellServDB for AFS client..
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
CellServDB is consistent
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
Adjusting clock with 0.it.pool.ntp.org...
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
0.it.pool.ntp.org: delay:0.092920 offset:-0.033263 Tue Apr 14
13:38:55 2009
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
lrmd[19177]: 2009/04/14_13:38:55 info: RA output: (afs_6:start:stdout)
end of AFS-startup script
crmd[19180]: 2009/04/14_13:38:55 info: process_lrm_event: LRM
operation afs_6_start_0 (call=18, rc=0) complete
crmd[19180]: 2009/04/14_13:38:56 info: do_lrm_rsc_op: Performing
op=afs_6_monitor_120000 key=17:2:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
crmd[19180]: 2009/04/14_13:38:56 info: process_lrm_event: LRM
operation afs_6_monitor_120000 (call=19, rc=7) complete
lrmd[19177]: 2009/04/14_13:39:02 info: RA output: (afs_6:start:stdout)
lrmd[19177]: 2009/04/14_13:39:02 info: RA output: (afs_6:start:stdout)
afsd: All AFS daemons started.
lrmd[19177]: 2009/04/14_13:39:02 info: RA output: (afs_6:start:stdout)
afsd: All AFS daemons started.
lrmd[19177]: 2009/04/14_13:39:02 info: RA output: (afs_6:start:stdout)
fs: new sysname set.
lrmd[19177]: 2009/04/14_13:39:02 info: RA output: (afs_6:start:stdout)
Invoking the AFS-startup script
lrmd[19177]: 2009/04/14_13:39:02 info: RA output: (afs_6:start:stdout)
Verifying consistency of CellServDB for AFS client..
lrmd[19177]: 2009/04/14_13:39:02 info: RA output: (afs_6:start:stdout)
CellServDB is consistent
lrmd[19177]: 2009/04/14_13:39:02 info: RA output: (afs_6:start:stdout)
Adjusting clock with 0.it.pool.ntp.org...
lrmd[19177]: 2009/04/14_13:39:02 info: RA output: (afs_6:start:stdout)
0.it.pool.ntp.org: delay:0.010546 offset:0.028576 Tue Apr 14 13:39:02
2009
lrmd[19177]: 2009/04/14_13:39:02 info: RA output: (afs_6:start:stdout)
lrmd[19177]: 2009/04/14_13:39:02 info: RA output: (afs_6:start:stdout)
end of AFS-startup script
crmd[19180]: 2009/04/14_13:39:02 info: process_lrm_event: LRM
operation afs_6_start_0 (call=21, rc=0) complete
crmd[19180]: 2009/04/14_13:39:03 info: do_lrm_rsc_op: Performing
op=afs_6_monitor_120000 key=5:3:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
crmd[19180]: 2009/04/14_13:39:03 info: process_lrm_event: LRM
operation afs_6_monitor_120000 (call=22, rc=7) complete
crmd[19180]: 2009/04/14_13:39:04 info: do_lrm_rsc_op: Performing
op=afs_6_stop_0 key=6:4:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
lrmd[19177]: 2009/04/14_13:39:04 info: rsc:afs_6: stop
lrmd[22072]: 2009/04/14_13:39:04 WARN: For LSB init script, no
additional parameters are needed.
crmd[19180]: 2009/04/14_13:39:04 info: process_lrm_event: LRM
operation afs_6_monitor_120000 (call=22, rc=-2) Cancelled
lrmd[19177]: 2009/04/14_13:39:04 info: RA output: (afs_6:stop:stdout)
Stopping AFS client.....
lrmd[19177]: 2009/04/14_13:39:04 info: RA output: (afs_6:stop:stdout)
Sending all processes using /afs the TERM signal ...
lrmd[19177]: 2009/04/14_13:39:04 info: RA output: (afs_6:stop:stdout)
lrmd[19177]: 2009/04/14_13:39:04 info: RA output: (afs_6:stop:stdout)
Sending all processes using /afs the KILL signal ...
lrmd[19177]: 2009/04/14_13:39:05 info: RA output: (afs_6:stop:stdout)
lrmd[19177]: 2009/04/14_13:39:05 info: RA output: (afs_6:stop:stdout)
Killing AFS daemons...
lrmd[19177]: 2009/04/14_13:39:05 info: RA output: (afs_6:stop:stdout)
Stopping AFS Bosserver
lrmd[19177]: 2009/04/14_13:39:05 info: RA output: (afs_6:stop:stdout)
Removing AFS kernel module, libafs.o...
lrmd[19177]: 2009/04/14_13:39:05 info: RA output:
(afs_6:stop:stdout) ...done
crmd[19180]: 2009/04/14_13:39:05 info: process_lrm_event: LRM
operation afs_6_stop_0 (call=23, rc=0) complete
crmd[19180]: 2009/04/14_13:39:06 info: do_lrm_rsc_op: Performing
op=afs_6_start_0 key=22:4:0:cc5851a8-04dd-45a6-8700-954bea0f2c78)
lrmd[19177]: 2009/04/14_13:39:06 info: rsc:afs_6: start
lrmd[22153]: 2009/04/14_13:39:06 WARN: For LSB init script, no
additional parameters are needed.
lrmd[19177]: 2009/04/14_13:39:07 info: RA output: (afs_6:start:stdout)
Will start afsd with these options:
lrmd[19177]: 2009/04/14_13:39:07 info: RA output:
(afs_6:start:stdout) -nosettime -stat 4000 -daemons 8 -blocks 65536 -
memcache
lrmSyncing clock with AFS server(s)...
lrmd[19177]: 2009/04/14_13:39:08 info: RA output: (afs_6:start:stdout)
Starting AFS client:
lrmd[19177]: 2009/04/14_13:39:08 info: RA output: (afs_6:start:stdout)
lrmd[19177]: 2009/04/14_13:39:08 info: RA output: (afs_6:start:stdout)
afsd: All AFS daemons started.
lrmd[19177]: 2009/04/14_13:39:08 info: RA output: (afs_6:start:stdout)
afsd: All AFS daemons started.
lrmd[19177]: 2009/04/14_13:39:08 info: RA output: (afs_6:start:stdout)
fs: new sysname set.
lrmd[19177]: 2009/04/14_13:39:08 info: RA output: (afs_6:start:stdout)
Invoking the AFS-startup script
lrmd[19177]: 2009/04/14_13:39:08 info: RA output: (afs_6:start:stdout)
Verifying consistency of CellServDB for AFS client..
lrmd[19177]: 2009/04/14_13:39:08 info: RA output: (afs_6:start:stdout)
CellServDB is consistent
lrmd[19177]: 2009/04/14_13:39:08 info: RA output: (afs_6:start:stdout)
Adjusting clock with 0.it.pool.ntp.org...
lrmd[19177]: 2009/04/14_13:39:08 info: RA output: (afs_6:start:stdout)
0.it.pool.ntp.org: delay:0.012558 offset:0.023919 Tue Apr 14 13:39:08
2009
lrmd[19177]: 2009/04/14_13:39:08 info: RA output: (afs_6:start:stdout)
lrmd[19177]: 2009/04/14_13:39:08 info: RA output: (afs_6:start:stdout)
end of AFS-startup scriptd[19177]: 2009/04/14_13:39:07 info: RA
output: (afs_6:start:stdout)
More information about the Linux-HA
mailing list