Issue with bbproxy 🔗 link

Having an issue with bbproxy.  I have a main hobbit box 192.168.213.5
and a secondary box that currently has 192.168.213.4 (it will be moved
offsite after testing and setup is completed)  I want .4 to forward all
info to .5, but 4 does not need to display anything locally.

On .4 I have tried various things with no apparent progress.  In
hobbitlaunch.cfg I disabled hobbitd as instructed and set [bbproxy] up
as follows

[bbproxy]

        ENVFILE /usr/lib/hobbit/server/etc/hobbitserver.cfg

        CMD $BBHOME/bin/bbproxy --hobbitd --bbdisplay=192.168.213.5
--report=$MACHINE.bbproxy --pidfile=$BBSERVERLOGS/bbproxy.pid

 
On the main server .5, I get the following messages under hobbit process

Hostname 'apollo.tfc.com' in tree, but no host-info

Hostname 'bomgar' in tree, but no host-info

Hostname 'apollo.tfc.com' in tree, but no host-info

Hostname 'bomgar' in tree, but no host-info

Hostname 'apollo.tfc.com' in tree, but no host-info

Hostname 'bomgar' in tree, but no host-info

Hostname 'apollo.tfc.com' in tree, but no host-info

Hostname 'bomgar' in tree, but no host-info

Hostname 'apollo.tfc.com' in tree, but no host-info

Hostname 'bomgar' in tree, but no host-info

Hostname 'apollo.tfc.com' in tree, but no host-info

Hostname 'bomgar' in tree, but no host-info

 
Do I need to do something on .5?  I tried adding 'apollo.tfc.com' and
'bomgar' to the bbhosts file on .5 but that appears to have produced
resulted in .5 simply checking the hosts out for itself instead of using
.4's results.

So, several questions:

1) How to I display the result from .4 on .5?

2) Where will the info appear?  On the bb.html page or can I make it
appear in one of my existing PAGE groups?

3) In the future can I use --bbdisplay=192.168.213.5 to use the FQDN for
when I finally deploy it?

 
Thanks in advance,

Aaron Kincaid

On Tue, Oct 30, 2007 at 01:55:19PM -0500, Aaron Kincaid wrote:

So far it looks correct.

These are messages from hobbitd meaning that it does know there is a
host called "bomgar", but it cannot find any data about it from the
entry in the bb-hosts file. This shouldn't really be possible to 
trigger. So how did you do it - what does your "bomgar" entry in
bb-hosts look like ?

Also, if you force a reload of the bb-hosts file ("kill -HUP
<hobbitd-PID>"), do these messages go away ?

You do need the hosts in the bb-hosts file (if not there, they won't
show up on the web pages). To avoid doing the network tests, just put a
"noconn" on the entries.

Put these hosts in the bb-hosts file, and handle them - display-wise -
like any other host.

No, the --bbdisplay argument must be an IP-address. Shouldn't be
difficult to script it if you need to use the DNS name, though.


Regards,
Henrik

The bb-hosts file on .4 (the remote server) has these entries:

192.168.213.4 apollo.tfc.com #bbd http://apollo.tfc.com

192.168.213.6 bomgar  # ping http://192.168.213.6 

 
I added these entries into the bb-hosts file on .5 (the main server)
this morning 

192.168.213.4 apollo.tfc.com #noconn

192.168.213.6 bomgar  #noconn

 After doing this the messages in hobbitd went away

Hostname 'apollo.tfc.com' in tree, but no host-info

Hostname 'bomgar' in tree, but no host-info

 

Now my /hobbit/bb.html page shows both "remote" items but has no data on
them other then bbproxy, info and trends on .4. 

 
The bbproxy icon on the main servers /hobbit page shows this:

bbproxy for Hobbit version 4.2.0

 
Proxy statistics

 
Incoming messages        :         43 (0 msgs/second)

Outbound messages        :        292

 
Incoming message distribution

- Combo messages         :         12

- Status messages        :        253

  Messages merged        :         10

  Resulting combos       :          2

- Page messages          :          0

- Other messages         :         31

 
Proxy ressources

- Connection table size  :          1

- Buffer space           :          8 kByte

 
Timeout/failure details

- reading from client    :          0

- connecting to server   :        275

- sending to server      :          0

- recovered              :          0

- reading from server    :          0

- sending to client      :          0

 
Average queue time       :         30.618

 
On .4 hobbitlaunch.cfg I changed all the other services that had NEEDS
hobbitd to say NEEDS bbproxy as mentioned in
http://www.hswn.dk/hobbiton/2006/08/msg00833.html, but this did not
help.  What am I missing?

 
From: Aaron Kincaid 
Sent: Tuesday, October 30, 2007 1:55 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Issue with bbproxy

 
Having an issue with bbproxy.  I have a main hobbit box 192.168.213.5
and a secondary box that currently has 192.168.213.4 (it will be moved
offsite after testing and setup is completed)  I want .4 to forward all
info to .5, but 4 does not need to display anything locally.

On .4 I have tried various things with no apparent progress.  In
hobbitlaunch.cfg I disabled hobbitd as instructed and set [bbproxy] up
as follows

[bbproxy]

        ENVFILE /usr/lib/hobbit/server/etc/hobbitserver.cfg

        CMD $BBHOME/bin/bbproxy --hobbitd --bbdisplay=192.168.213.5
--report=$MACHINE.bbproxy --pidfile=$BBSERVERLOGS/bbproxy.pid

 
On the main server .5, I get the following messages under hobbit process

Hostname 'apollo.tfc.com' in tree, but no host-info

Hostname 'bomgar' in tree, but no host-info

Hostname 'apollo.tfc.com' in tree, but no host-info

Hostname 'bomgar' in tree, but no host-info

Hostname 'apollo.tfc.com' in tree, but no host-info

Hostname 'bomgar' in tree, but no host-info

Hostname 'apollo.tfc.com' in tree, but no host-info

Hostname 'bomgar' in tree, but no host-info

Hostname 'apollo.tfc.com' in tree, but no host-info

Hostname 'bomgar' in tree, but no host-info

Hostname 'apollo.tfc.com' in tree, but no host-info

Hostname 'bomgar' in tree, but no host-info

 
Do I need to do something on .5?  I tried adding 'apollo.tfc.com' and
'bomgar' to the bbhosts file on .5 but that appears to have produced
resulted in .5 simply checking the hosts out for itself instead of using
.4's results.

So, several questions:

1) How to I display the result from .4 on .5?

2) Where will the info appear?  On the bb.html page or can I make it
appear in one of my existing PAGE groups?

3) In the future can I use --bbdisplay=192.168.213.5 to use the FQDN for
when I finally deploy it?

 
Thanks in advance,

Aaron Kincaid

On Wednesday 31 October 2007 22:08:25 Aaron Kincaid wrote:

My bbproxy (been running for almost 2 years now with no real problems), 
reports:


bbproxy for Hobbit version 4.2.0

Proxy statistics

Incoming messages        :    1925513 (0 msgs/second)
Outbound messages        :    1871448

Incoming message distribution
- Combo messages         :       7512
- Status messages        :     939589
  Messages merged        :     145178
  Resulting combos       :      61297
- Page messages          :          0
- Other messages         :     985900

Proxy ressources
- Connection table size  :          1
- Buffer space           :          8 kByte

Timeout/failure details

- reading from client    :          1
- connecting to server   :          0

- sending to server      :          0
- recovered              :          0
- reading from server    :          0
- sending to client      :          0

Average queue time       :          0.742


So, your average queue time looks very high, and your "connecting to server" 
entry under "Timeout/failure details".

BTW, for some reason (can't remember now), I run my bbproxy with 
the --no-daemon option.

Regards,
Buchan

On Wed, Oct 31, 2007 at 03:08:25PM -0500, Aaron Kincaid wrote:

Average queue time       :         30.618

Very high. Check the bbproxy log file, I think your proxy cannot connect
to the Hobbit server on .5.


Henrik

I've been playing with this off and on for a while in our test
environment.

(Yes, I've read the wiki article).

I remember you said we should not need to strip the period out of the
value returned from vmstat, because the rrd is storing values in
floating point notation.

But -- in do_vmstat.c, you're populating the rrd update vector with this
statement : p += sprintf(p, ":%d", values[layout[defidx].index]);

Now I'm NOT a C programmer - but won't that ":%d" format explicitly
truncate the value to an integer?

The values I'm talking about are the rightmost two here:

nile:-:/home/kauffmant > vmstat 10 1

System configuration: lcpu=2 mem=8192MB ent=0.10

kthr    memory              page              faults              cpu
----- ----------- ------------------------ ------------
 r  b   avm   fre  re  pi  po  fr   sr  cy  in   sy  cs us sy id wa
pc    ec
 0  0 1080720 394462   0   0   0   0    0   0  28  260 147  2  7 91  0
0.01  10.2

Cpu_pc is 0.01 and cpu_ec is 10.2 -- which means I'm using 10.2 percent
of my 0.1 cpu entitlement, for a real cpu count of 0.01.

So, should I plug in the code to strip the decimal point and modify the
grapher definitions to divide by 100 and 10, or is there a simpler way
out?

TIA

Tom Kauffman
NIBCO, Inc
CONFIDENTIALITY NOTICE:  This email and any attachments are for the 
exclusive and confidential use of the intended recipient.  If you are not
the intended recipient, please do not read, distribute or take action in 
reliance upon this message. If you have received this in error, please 
notify us immediately by return email and promptly delete this message 
and its attachments from your computer system. We do not waive  
attorney-client or work product privilege by the transmission of this
message.

Henrick, the bbproxy.log was last updated on the 10/30/07, and hobbit
itself does not appear to even be working anymore.  Below are the
portions for hobbitlaunch.cfg and hobbitserver.cfg for both servers.

The only way I can get anything to work is to enable hobbitd and disable
bbproxy on .4's hobbitlaunch.cfg.  If I do anything else no data is
collected.


.4 server

---------bbproxy.log has not worked in days.  The last entries are:

2007-10-30 13:21:06 Caught TERM signal, terminating 

2007-10-30 13:21:08 bbproxy version 4.2.0 starting 

2007-10-30 13:21:08 Listening on 192.168.213.4:1984 

2007-10-30 13:21:08 Sending to BBDISPLAY(s) 127.0.0.1:1984
192.168.213.5:1984 

2007-10-30 13:21:08 Sending to BBPAGER(s) 127.0.0.1:1984
192.168.213.5:1984 2007-10-30 13:35:04 Caught TERM signal, terminating

 
---------hobbitlaunch.cfg

 [hobbitd]

DISABLED

      ENVFILE /usr/lib/hobbit/server/etc/hobbitserver.cfg

      CMD hobbitd --pidfile=$BBSERVERLOGS/hobbitd.pid
--restart=$BBTMP/hobbitd.chk --checkpoint-file=$BBTMP/hobbitd.chk
--checkpoint-interval=600 --log=$BBSERVERLOGS/hobbitd.log
--admin-senders=$BBSERVERIP --store-clientlogs=!msgs

 
[bbproxy]

      ENVFILE /usr/lib/hobbit/server/etc/hobbitserver.cfg

      CMD $BBHOME/bin/bbproxy --hobbitd  --bbdisplay=192.168.213.5
--report=$MACHINE.bbproxy --pidfile=$BBSERVERLOGS/bbproxy.pid LOGFILE
$BBSERVERLOGS/bbproxy.log

 
---------hobbitserver.cfg

BBSERVERHOSTNAME="apollo.tfc.com"         # The hostname of your server

BBSERVERIP="127.0.0.1"  

 
# General settings

BBPORT="1984"                 # Portnumber where hobbitd/bbd listens

BBDISP="192.168.213.4"        # IP of a single hobbit/bbd server

BBDISPLAYS=""                 # IP of multiple hobbit/bbd servers. If
used, BBDISP must be 0.0.0.0

FQDN="TRUE" 

 
---------hobbitlaunch.log

2007-11-02 14:24:07 Cannot bind to listen socket (Address already in
use)

2007-11-02 14:24:07 Task bbproxy terminated, status 1

2007-11-02 14:24:12 Cannot bind to listen socket (Address already in
use)

2007-11-02 14:24:12 Task bbproxy terminated, status 1

2007-11-02 14:24:17 Cannot bind to listen socket (Address already in
use)

2007-11-02 14:24:17 Task bbproxy terminated, status 1

2007-11-02 14:24:22 Cannot bind to listen socket (Address already in
use)

2007-11-02 14:24:22 Task bbproxy terminated, status 1

2007-11-02 14:24:27 Cannot bind to listen socket (Address already in
use)

2007-11-02 14:24:27 Task bbproxy terminated, status 1

 
.5 server:

---------hobbitlaunch.cfg

[hobbitd]

      HEARTBEAT

      ENVFILE /usr/lib/hobbit/server/etc/hobbitserver.cfg

      CMD hobbitd --pidfile=$BBSERVERLOGS/hobbitd.pid
--restart=$BBTMP/hobbitd.chk --checkpoint-file=$BBTMP/hobbitd.chk
--checkpoint-interval=600 --log=$BBSERVERLOGS/hobbitd.log
--admin-senders=127.0.0.1,$BBSERVERIP

 
[bbproxy]

      DISABLED

      ENVFILE /usr/lib/hobbit/server/etc/hobbitserver.cfg

      CMD $BBHOME/bin/bbproxy --hobbitd
--bbdisplay=YOUR.HOBBIT.SERVER.IP --report=$MACHINE.bbproxy --no-daemon
--pidfile=$BBSERVERLOGS/bbproxy.pid

      LOGFILE $BBSERVERLOGS/bbproxy.log

 
---------hobbitserver.cfg

BBSERVERHOSTNAME="zeus.tfc.com"           # The hostname of your server

# BBSERVERIP="192.168.213.5"              # The IP-address of your
server. Use the real one, not 127.0.0.1 .

BBSERVERIP="127.0.0.1"

 
# General settings

BBPORT="1984"                 # Portnumber where hobbitd/bbd listens

BBDISP="$BBSERVERIP"          # IP of a single hobbit/bbd server

BBDISPLAYS=""                 # IP of multiple hobbit/bbd servers. If
used, BBDISP must be 0.0.0.0

BBPAGE="$BBSERVERIP"          # IP of a single bbd BBPAGE server. Not
used by Hobbit.

BBPAGERS="" 

 
Again, I want .4 to relay all its data to .5, but .4 does not need to
display anything locally.

 
Thanks for your patience with this.