Route/Netstat Crashing and/or Ipconfig Not Working = Purple results
list Joe Birney Jr
Folks, we have three dell power edge 2950s that are running a Win2k3 OS as well as the Citrix Xenapp (version 5.0). What we see is that Hobbit will report the basic test purple (CPU, Disk, Mem, ect) after some time has pasted. When we logon to the systems we usually see a crash message saying that either route.exe or netstat has crashed. Checking the task manger on these boxes shows we can have a mix of netstat and route.exe still running (some times its just one, other there are 2 or more instances, or just one of them running, ect). Looking at the event viewer we will usually see: The agent stats generated this event message : failed to execute ipconfig /all But no other error indications on those boxes. And of course when we run this ipconfig command it works all the time for us. The simple fix is to kill any an all netstat.exe, route.exe and cmd windows they tried to run and then the servers go back to green. Problem is they will only last for some time until they go purple. And the time it takes is random. Finally we have 6 other Citrix servers all configured in the same manor that do NOT exhibit this behavior. So any ideas on how to find out why netstat/route keep crashing? Thanks! Jb
list Odinn
This sounds like an issue with the client, not the server. -- Jim Sloan Just remember, today is the day you thought tomorrow was going to be yesterday.
▸
From: Birney Jr Joe-FJB047 <user-8b72302a7dee@xymon.invalid>
To: user-ae9b8668bcde@xymon.invalid
Sent: Thu, January 14, 2010 8:46:16 AM
Subject: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working = Purple results
Folks,
we have three dell power edge 2950s that are running a Win2k3 OS as well as the Citrix Xenapp (version 5.0). What we see is that Hobbit will report the basic test purple (CPU, Disk, Mem, ect) after some time has pasted. When we logon to the systems we usually see a crash message saying that either route.exe or netstat has crashed. Checking the task manger on these boxes shows we can have a mix of netstat and route.exe still running (some times its just one, other there are 2 or more instances, or just one of them running, ect). Looking at the event viewer we will usually see:
The agent stats generated this event message : failed to execute ipconfig /all
But no other error indications on those boxes. And of course when we run this ipconfig command it works all the time for us. The simple fix is to kill any an all netstat.exe, route.exe and cmd windows they tried to run and then the servers go back to green. Problem is they will only last for some time until they go purple. And the time it takes is random. Finally we have 6 other Citrix servers all configured in the same manor that do NOT exhibit this behavior.
So any ideas on how to find out why netstat/route keep crashing?
Thanks!
Jb
list Joe Birney Jr
Thanks for the feedback. We had to install Hobbit on about 40 servers. We ended up scripting the install to make life easier and ensure all of the servers got the same version, installed the same day, ect. We also made sure that the we had set the mode on the citrix box to install before we ran the script. Is there any way that we can get Hobbit to run the commands in more of a verbose mode? We would love to see the cmd window that it spawns to run the netstat or ipconfig commands so we can see what its hanging up as... We tried to change one of the servers so bbwin runs as with a different account and left that account logged in hoping a CMD window or other data would be persevered. But no luck :( Jb
▸
From: Odinn [mailto:user-385fc81b8782@xymon.invalid]
Sent: Thursday, January 14, 2010 10:57 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working
= Purple results
This sounds like an issue with the client, not the server.
--
Jim Sloan
Just remember, today is the day you thought tomorrow was going to be
yesterday.
From: Birney Jr Joe-FJB047 <user-8b72302a7dee@xymon.invalid>
To: user-ae9b8668bcde@xymon.invalid
Sent: Thu, January 14, 2010 8:46:16 AM
Subject: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working =
Purple results
Folks,
we have three dell power edge 2950s that are running a Win2k3 OS as well
as the Citrix Xenapp (version 5.0). What we see is that Hobbit will
report the basic test purple (CPU, Disk, Mem, ect) after some time has
pasted. When we logon to the systems we usually see a crash message
saying that either route.exe or netstat has crashed. Checking the task
manger on these boxes shows we can have a mix of netstat and route.exe
still running (some times its just one, other there are 2 or more
instances, or just one of them running, ect). Looking at the event
viewer we will usually see:
The agent stats generated this event message : failed to execute
ipconfig /all
But no other error indications on those boxes. And of course when we run
this ipconfig command it works all the time for us. The simple fix is to
kill any an all netstat.exe, route.exe and cmd windows they tried to run
and then the servers go back to green. Problem is they will only last
for some time until they go purple. And the time it takes is random.
Finally we have 6 other Citrix servers all configured in the same manor
that do NOT exhibit this behavior.
So any ideas on how to find out why netstat/route keep crashing?
Thanks!
Jb
list Odinn
what client are you running on the Windows systems? BBWin v.?
▸
--
Jim Sloan
Just remember, today is the day you thought tomorrow was going to be yesterday.
▸
From: Birney Jr Joe-FJB047 <user-8b72302a7dee@xymon.invalid>
To: user-ae9b8668bcde@xymon.invalid
Sent: Thu, January 14, 2010 2:46:48 PM
Subject: RE: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working = Purple results
Thanks for the feedback. We had to install Hobbit on about 40 servers. We ended up scripting the install to make life easier and ensure all of the servers got the same version, installed the same day, ect. We also made sure that the we had set the mode on the citrix box to install before we ran the script. Is there any way that we can get Hobbit to run the commands in more of a verbose mode? We would love to see the cmd window that it spawns to run the netstat or ipconfig commands so we can see what its hanging up as... We tried to change one of the servers so bbwin runs as with a different account and left that account logged in hoping a CMD window or other data would be persevered. But no luck :(
Jb
From: Odinn [mailto:user-385fc81b8782@xymon.invalid] Sent: Thursday, January 14, 2010 10:57 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working = Purple results
This sounds like an issue with the client, not the server.
--
Jim Sloan
Just remember, today is the day you thought tomorrow was going to be yesterday.
From: Birney Jr Joe-FJB047 <user-8b72302a7dee@xymon.invalid>
To: user-ae9b8668bcde@xymon.invalid
Sent: Thu, January 14, 2010 8:46:16 AM
Subject: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working = Purple results
Folks,
we have three dell power edge 2950s that are running a Win2k3 OS as well as the Citrix Xenapp (version 5.0). What we see is that Hobbit will report the basic test purple (CPU, Disk, Mem, ect) after some time has pasted. When we logon to the systems we usually see a crash message saying that either route.exe or netstat has crashed. Checking the task manger on these boxes shows we can have a mix of netstat and route.exe still running (some times its just one, other there are 2 or more instances, or just one of them running, ect). Looking at the event viewer we will usually see: The agent stats generated this event message : failed to execute ipconfig /all But no other error indications on those boxes. And of course when we run this ipconfig command it works all the time for us. The simple fix is to kill any an all netstat.exe, route.exe and cmd windows they tried to run and then the servers go back to green. Problem is they will only last for some time until they go purple. And the time it takes is random. Finally we have 6 other Citrix servers all configured in the same manor that do NOT exhibit this behavior.
So any ideas on how to find out why netstat/route keep crashing?
Thanks! Jb
list Malcolm Hunter
▸
Is there any way that we can get Hobbit to run the commands in more of a verbose mode? We would love to see the cmd window that it spawns to run the netstat or ipconfig commands so we can see what its hanging up as... We tried to change one of the servers so bbwin runs as with a different account and left that account logged in hoping a CMD window or other data would be persevered. But no luck :(
You can run bbwin.exe --debug from the command line but I'm not sure whether that will help. I'm surprised that bbwin is shelling out to call route, ipconfig and netstat but then some of the other code isn't that great either. Malcolm -- Technical copy-editor & proofreader KDE Proofreading Team KDE British English Translation Team http://l10n.kde.org/team-infos.php?teamcode=en_GB Facebook: http://www.facebook.com/FriendlyAtheist Preisknaller: GMX DSL Flatrate für nur 16,99 Euro/mtl.! http://portal.gmx.net/de/go/dsl02
list Joe Birney Jr
Folks, all servers are running Win2003 w/SP 2 as the OS. BBWin is version 0.12
▸
From: Odinn [mailto:user-385fc81b8782@xymon.invalid]
Sent: Thursday, January 14, 2010 3:11 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working
= Purple results
what client are you running on the Windows systems? BBWin v.?
--
Jim Sloan
Just remember, today is the day you thought tomorrow was going to be
yesterday.
From: Birney Jr Joe-FJB047 <user-8b72302a7dee@xymon.invalid>
To: user-ae9b8668bcde@xymon.invalid
Sent: Thu, January 14, 2010 2:46:48 PM
Subject: RE: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working
= Purple results
Thanks for the feedback. We had to install Hobbit on about 40 servers.
We ended up scripting the install to make life easier and ensure all of
the servers got the same version, installed the same day, ect. We also
made sure that the we had set the mode on the citrix box to install
before we ran the script.
Is there any way that we can get Hobbit to run the commands in more of a
verbose mode? We would love to see the cmd window that it spawns to run
the netstat or ipconfig commands so we can see what its hanging up as...
We tried to change one of the servers so bbwin runs as with a different
account and left that account logged in hoping a CMD window or other
data would be persevered. But no luck :(
Jb
From: Odinn [mailto:user-385fc81b8782@xymon.invalid]
Sent: Thursday, January 14, 2010 10:57 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working
= Purple results
This sounds like an issue with the client, not the server.
--
Jim Sloan
Just remember, today is the day you thought tomorrow was going to be
yesterday.
From: Birney Jr Joe-FJB047 <user-8b72302a7dee@xymon.invalid>
To: user-ae9b8668bcde@xymon.invalid
Sent: Thu, January 14, 2010 8:46:16 AM
Subject: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working =
Purple results
Folks,
we have three dell power edge 2950s that are running a Win2k3 OS as well
as the Citrix Xenapp (version 5.0). What we see is that Hobbit will
report the basic test purple (CPU, Disk, Mem, ect) after some time has
pasted. When we logon to the systems we usually see a crash message
saying that either route.exe or netstat has crashed. Checking the task
manger on these boxes shows we can have a mix of netstat and route.exe
still running (some times its just one, other there are 2 or more
instances, or just one of them running, ect). Looking at the event
viewer we will usually see:
The agent stats generated this event message : failed to execute
ipconfig /all
But no other error indications on those boxes. And of course when we run
this ipconfig command it works all the time for us. The simple fix is to
kill any an all netstat.exe, route.exe and cmd windows they tried to run
and then the servers go back to green. Problem is they will only last
for some time until they go purple. And the time it takes is random.
Finally we have 6 other Citrix servers all configured in the same manor
that do NOT exhibit this behavior.
So any ideas on how to find out why netstat/route keep crashing?
Thanks!
Jb
list Jim Sloan
Are you running BBWin in local or central mode? Do you have any external scripts running besides the defaults? BBWin shouldn't be executing ipconfig or netstat In the bbwin.cfg change the following line <setting name="loglevel" value="0"> Change 0 to 1 No need to restart as bbwin will restart on a change of the cfg file. Jim Sloan Chief Systems Architect - Corporate IT S1 Corporation Tel (direct): +X XXX XXX XXXX Tel (switchboard): +X XXX XXX XXXX user-682ab7a92de7@xymon.invalid <mailto:user-682ab7a92de7@xymon.invalid> www.s1.com Notice: This communication contains information that may be privileged, confidential and/or exempt from disclosure under applicable law. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution, or use of the information contained herein (including any reliance thereon) is strictly prohibited. If you received this transmission in error, please immediately contact the sender and delete this communication.
▸
From: Birney Jr Joe-FJB047 [mailto:user-8b72302a7dee@xymon.invalid]
Sent: Friday, January 15, 2010 7:57 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working
= Purple results
Folks,
all servers are running Win2003 w/SP 2 as the OS.
BBWin is version 0.12
From: Odinn [mailto:user-385fc81b8782@xymon.invalid]
Sent: Thursday, January 14, 2010 3:11 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working
= Purple results
what client are you running on the Windows systems? BBWin v.?
--
Jim Sloan
Just remember, today is the day you thought tomorrow was going to be
yesterday.
From: Birney Jr Joe-FJB047 <user-8b72302a7dee@xymon.invalid>
To: user-ae9b8668bcde@xymon.invalid
Sent: Thu, January 14, 2010 2:46:48 PM
Subject: RE: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working
= Purple results
Thanks for the feedback. We had to install Hobbit on about 40 servers.
We ended up scripting the install to make life easier and ensure all of
the servers got the same version, installed the same day, ect. We also
made sure that the we had set the mode on the citrix box to install
before we ran the script.
Is there any way that we can get Hobbit to run the commands in more of a
verbose mode? We would love to see the cmd window that it spawns to run
the netstat or ipconfig commands so we can see what its hanging up as...
We tried to change one of the servers so bbwin runs as with a different
account and left that account logged in hoping a CMD window or other
data would be persevered. But no luck :(
Jb
From: Odinn [mailto:user-385fc81b8782@xymon.invalid]
Sent: Thursday, January 14, 2010 10:57 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working
= Purple results
This sounds like an issue with the client, not the server.
--
Jim Sloan
Just remember, today is the day you thought tomorrow was going to be
yesterday.
From: Birney Jr Joe-FJB047 <user-8b72302a7dee@xymon.invalid>
To: user-ae9b8668bcde@xymon.invalid
Sent: Thu, January 14, 2010 8:46:16 AM
Subject: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working =
Purple results
Folks,
we have three dell power edge 2950s that are running a Win2k3 OS as well
as the Citrix Xenapp (version 5.0). What we see is that Hobbit will
report the basic test purple (CPU, Disk, Mem, ect) after some time has
pasted. When we logon to the systems we usually see a crash message
saying that either route.exe or netstat has crashed. Checking the task
manger on these boxes shows we can have a mix of netstat and route.exe
still running (some times its just one, other there are 2 or more
instances, or just one of them running, ect). Looking at the event
viewer we will usually see:
The agent stats generated this event message : failed to execute
ipconfig /all
But no other error indications on those boxes. And of course when we run
this ipconfig command it works all the time for us. The simple fix is to
kill any an all netstat.exe, route.exe and cmd windows they tried to run
and then the servers go back to green. Problem is they will only last
for some time until they go purple. And the time it takes is random.
Finally we have 6 other Citrix servers all configured in the same manor
that do NOT exhibit this behavior.
So any ideas on how to find out why netstat/route keep crashing?
Thanks!
Jb
list Malcolm Hunter
▸
Are you running BBWin in local or central mode? Do you have any external scripts running besides the defaults? BBWin shouldn't be executing ipconfig or netstat
BBWin does shell out and call ipconfig and netstat. However, I could only find netstat.tmp being generated in %TEMP%. I think it runs these in both central and local modes.
▸
Malcolm -- Technical copy-editor & proofreader KDE Proofreading Team KDE British English Translation Team http://l10n.kde.org/team-infos.php?teamcode=en_GB Facebook: http://www.facebook.com/FriendlyAtheist Preisknaller: GMX DSL Flatrate für nur 16,99 Euro/mtl.! http://portal.gmx.net/de/go/dsl02
list Joe Birney Jr
Folks I had enabled most versbose logging in order to see if this helps to show what is going on one of the servers. This is the output: 009/12/21 14:46:40 [DEBUG]: [svcs]: start AgentSvcs::InitCentralMode 2009/12/21 14:46:40 [DEBUG]: [svcs]: checking file c:\Program Files\BBWin\tmp\clientlocal.cfg 2009/12/21 14:46:40 [DEBUG]: [svcs]: reading file c:\Program Files\BBWin\tmp\clientlocal.cfg 2009/12/21 14:49:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 14:51:41 [DEBUG]: [cpu]: cpu review started 2009/12/21 14:51:41 [DEBUG]: [cpu]: cpu review ended 2009/12/21 14:51:41 [DEBUG]: [disk]: drive string C:\ 2009/12/21 14:51:41 [DEBUG]: [disk]: drive string D:\ 2009/12/21 14:51:41 [DEBUG]: [disk]: drive string E:\ 2009/12/21 14:51:41 [DEBUG]: [disk]: drive string V:\ 2009/12/21 14:51:41 [DEBUG]: [disk]: drive string X:\ 2009/12/21 14:51:41 [DEBUG]: [msgs]: start AgentMsgs::InitCentralMode 2009/12/21 14:51:41 [DEBUG]: [msgs]: checking file c:\Program Files\BBWin\tmp\clientlocal.cfg 2009/12/21 14:51:41 [DEBUG]: [msgs]: reading file c:\Program Files\BBWin\tmp\clientlocal.cfg 2009/12/21 14:51:41 [DEBUG]: [msgs]: will use maxdata size : 10240 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : is an invalid print stream 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : permission settings do not grant 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Office Document Image Writer 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : warning 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Warning 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Print 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : print 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : pages printed 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : information 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Information 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : perflib 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Perflib 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : AutoEnrollment 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : LoadPerf 2009/12/21 14:51:41 [DEBUG]: [msgs]: will use maxdata size : 10240 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : BigBrotherHobbitClient 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : bigbrotherhobbitclient 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : information 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Information 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : cccredmgr 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : userenv 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Userenv 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : warning 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Warning 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Windows saved user 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Windows cannot unload your classes registry file 2009/12/21 14:51:41 [DEBUG]: [msgs]: will use maxdata size : 10240 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Restricted Sid Count 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : auditable protected data 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Backup of data protection master key 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : success 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Success 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : process 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Destination DRA 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : The description for Event ID 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Handle Closed 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Logon attempt 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Successful Network Logon 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : User Logoff 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Service Ticket Renewed 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Service Ticket Request 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Authentication Ticket Request 2009/12/21 14:51:41 [DEBUG]: [msgs]: will use maxdata size : 10240 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Health 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : health 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : information 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : Information 2009/12/21 14:51:41 [DEBUG]: [msgs]: will ignore : failed 2009/12/21 14:52:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 14:55:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 14:58:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:01:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:04:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:07:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:10:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:13:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:16:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:19:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:22:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:25:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:28:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:31:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:34:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:37:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:40:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:43:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:46:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:49:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:52:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:55:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 15:58:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 16:01:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 16:04:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 16:07:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 16:10:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 16:13:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 16:16:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 16:19:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 16:22:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' 2009/12/21 16:25:05 [DEBUG]: [externals]: starting external 'cmd /c ..\ext\termusers\termusers.bat' Then it just keeps going like that until we correct it. I can try to disable the external script (that is suppose to report the number of Terminal users back to hobbit). I want to double check to make sure I anser the local vrs central mode. One thing I thought, could something else running on the server cause issues with hobbit (maybe another tool/script is causing the crash and holding hobbit up)?
▸
From: Jim Sloan [mailto:user-682ab7a92de7@xymon.invalid]
Sent: Friday, January 15, 2010 9:50 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working
= Purple results
Are you running BBWin in local or central mode?
Do you have any external scripts running besides the defaults?
BBWin shouldn't be executing ipconfig or netstat
In the bbwin.cfg change the following line
<setting name="loglevel" value="0">
Change 0 to 1
No need to restart as bbwin will restart on a change of the cfg file.
Jim Sloan
Chief Systems Architect - Corporate IT
S1 Corporation
Tel (direct): +X XXX XXX XXXX
Tel (switchboard): +X XXX XXX XXXX
user-682ab7a92de7@xymon.invalid <mailto:user-682ab7a92de7@xymon.invalid>
www.s1.com
Notice: This communication contains information that may be privileged,
confidential and/or exempt from disclosure under applicable law. If you
are not the intended recipient, you are hereby notified that any
disclosure, copying, distribution, or use of the information contained
herein (including any reliance thereon) is strictly prohibited. If you
received this transmission in error, please immediately contact the
sender and delete this communication.
From: Birney Jr Joe-FJB047 [mailto:user-8b72302a7dee@xymon.invalid]
Sent: Friday, January 15, 2010 7:57 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: RE: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working
= Purple results
Folks,
all servers are running Win2003 w/SP 2 as the OS.
BBWin is version 0.12
From: Odinn [mailto:user-385fc81b8782@xymon.invalid]
Sent: Thursday, January 14, 2010 3:11 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working
= Purple results
what client are you running on the Windows systems? BBWin v.?
--
Jim Sloan
Just remember, today is the day you thought tomorrow was going to be
yesterday.
From: Birney Jr Joe-FJB047 <user-8b72302a7dee@xymon.invalid>
To: user-ae9b8668bcde@xymon.invalid
Sent: Thu, January 14, 2010 2:46:48 PM
Subject: RE: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working
= Purple results
Thanks for the feedback. We had to install Hobbit on about 40 servers.
We ended up scripting the install to make life easier and ensure all of
the servers got the same version, installed the same day, ect. We also
made sure that the we had set the mode on the citrix box to install
before we ran the script.
Is there any way that we can get Hobbit to run the commands in more of a
verbose mode? We would love to see the cmd window that it spawns to run
the netstat or ipconfig commands so we can see what its hanging up as...
We tried to change one of the servers so bbwin runs as with a different
account and left that account logged in hoping a CMD window or other
data would be persevered. But no luck :(
Jb
From: Odinn [mailto:user-385fc81b8782@xymon.invalid]
Sent: Thursday, January 14, 2010 10:57 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working
= Purple results
This sounds like an issue with the client, not the server.
--
Jim Sloan
Just remember, today is the day you thought tomorrow was going to be
yesterday.
From: Birney Jr Joe-FJB047 <user-8b72302a7dee@xymon.invalid>
To: user-ae9b8668bcde@xymon.invalid
Sent: Thu, January 14, 2010 8:46:16 AM
Subject: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working =
Purple results
Folks,
we have three dell power edge 2950s that are running a Win2k3 OS as well
as the Citrix Xenapp (version 5.0). What we see is that Hobbit will
report the basic test purple (CPU, Disk, Mem, ect) after some time has
pasted. When we logon to the systems we usually see a crash message
saying that either route.exe or netstat has crashed. Checking the task
manger on these boxes shows we can have a mix of netstat and route.exe
still running (some times its just one, other there are 2 or more
instances, or just one of them running, ect). Looking at the event
viewer we will usually see:
The agent stats generated this event message : failed to execute
ipconfig /all
But no other error indications on those boxes. And of course when we run
this ipconfig command it works all the time for us. The simple fix is to
kill any an all netstat.exe, route.exe and cmd windows they tried to run
and then the servers go back to green. Problem is they will only last
for some time until they go purple. And the time it takes is random.
Finally we have 6 other Citrix servers all configured in the same manor
that do NOT exhibit this behavior.
So any ideas on how to find out why netstat/route keep crashing?
Thanks!
Jb
list Joe Birney Jr
Malcolm, Thanks for your input! Are you saying that there is a netstat.tmp file that may still be in the %TEMP% dir? If so I can look for it to see if there is anything in that file that may shed light on this issue. Thanks again! Jb
▸
-----Original Message-----
From: Malcolm Hunter [mailto:user-b3e590ffeb6d@xymon.invalid]
Sent: Friday, January 15, 2010 10:03 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: RE: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working = Purple results
Are you running BBWin in local or central mode? Do you have any external scripts running besides the defaults? BBWin shouldn't be executing ipconfig or netstat
BBWin does shell out and call ipconfig and netstat. However, I could only find netstat.tmp being generated in %TEMP%. I think it runs these in both central and local modes. Malcolm -- Technical copy-editor & proofreader KDE Proofreading Team KDE British English Translation Team http://l10n.kde.org/team-infos.php?teamcode=en_GB Facebook: http://www.facebook.com/FriendlyAtheist Preisknaller: GMX DSL Flatrate für nur 16,99 Euro/mtl.! http://portal.gmx.net/de/go/dsl02
list Malcolm Hunter
▸
Malcolm, Thanks for your input! Are you saying that there is a netstat.tmp file that may still be in the %TEMP% dir? If so I can look for it to see if there is anything in that file that may shed light on this issue.
Yes, it should contain the output from netstat -s. Also, I suggest disabling the external script to see if that helps. Regards,
▸
Malcolm -- Technical copy-editor & proofreader KDE Proofreading Team KDE British English Translation Team http://l10n.kde.org/team-infos.php?teamcode=en_GB Facebook: http://www.facebook.com/FriendlyAtheist
GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT! Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01
list Joe Birney Jr
Malcolm, Thanks again for your inputs. We removed the ext script and that did not help. Looking into the BBWIN\tmp dir we see that there was a msg file that seems it was hung up. As soon as we killed one of the CMD process we saw running, the file was sent and then the stats went green. The file was msg.servername.number (where number looked like a randomly generated 4 digit value). Before we killed that process we saw that last line of this file had data about ports in it: [ports] Active Connections Nothing else looked out of place in the file! So at this point should we try something like process explorer to see were that CMD is coming from that's holding that msg file?
▸
Jb
-----Original Message-----
From: Malcolm Hunter [mailto:user-b3e590ffeb6d@xymon.invalid]
Sent: Friday, January 15, 2010 12:10 PM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: RE: RE: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working = Purple results
Malcolm, Thanks for your input! Are you saying that there is a netstat.tmp file that may still be in the %TEMP% dir? If so I can look for it to see if there is anything in that file that may shed light on this issue.
Yes, it should contain the output from netstat -s. Also, I suggest disabling the external script to see if that helps. Regards, Malcolm -- Technical copy-editor & proofreader KDE Proofreading Team KDE British English Translation Team http://l10n.kde.org/team-infos.php?teamcode=en_GB Facebook: http://www.facebook.com/FriendlyAtheist GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT! Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01
list Malcolm Hunter
▸
Thanks again for your inputs. We removed the ext script and that did not help. Looking into the BBWIN\tmp dir we see that there was a msg file that seems it was hung up. As soon as we killed one of the CMD process we saw running, the file was sent and then the stats went green. The file was msg.servername.number (where number looked like a randomly generated 4 digit value). Before we killed that process we saw that last line of this file had data about ports in it: [ports] Active Connections Nothing else looked out of place in the file! So at this point should we try something like process explorer to see were that CMD is coming from that's holding that msg file?
You'll probably find that it's spawned by BBwin. Have you tried running BBwin in local mode instead of central? One of the reasons I switched from using central mode was it's so buggy.
▸
Malcolm -- Technical copy-editor & proofreader KDE Proofreading Team KDE British English Translation Team http://l10n.kde.org/team-infos.php?teamcode=en_GB Facebook: http://www.facebook.com/FriendlyAtheist GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT! Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01
list Joe Birney Jr
Folks, Just wanted to close the loop on this one. We changed a few of the servers from Central to local mode and ran them for a few weeks. We did not have a single crash or issue. We then converted the rest of the Citrix boxes over to use local and still no crashing. Thanks again for all your time/help (esp you Malcolm).
▸
Jb
-----Original Message-----
From: Malcolm Hunter [mailto:user-b3e590ffeb6d@xymon.invalid] Sent: Friday, January 15, 2010 10:03 AM
To: user-ae9b8668bcde@xymon.invalid
Subject: Re: RE: [hobbit] Route/Netstat Crashing and/or Ipconfig Not Working = Purple results
Are you running BBWin in local or central mode? Do you have any external scripts running besides the defaults? BBWin shouldn't be executing ipconfig or netstat
BBWin does shell out and call ipconfig and netstat. However, I could only find netstat.tmp being generated in %TEMP%. I think it runs these in both central and local modes. Malcolm -- Technical copy-editor & proofreader KDE Proofreading Team KDE British English Translation Team http://l10n.kde.org/team-infos.php?teamcode=en_GB Facebook: http://www.facebook.com/FriendlyAtheist Preisknaller: GMX DSL Flatrate für nur 16,99 Euro/mtl.! http://portal.gmx.net/de/go/dsl02